scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-11 03:38:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 84
24901 commits 3446 branches 1449 tags 5.3 GiB
Commit graph

24901 commits

This branch
This branch
All branches
Author SHA1 Message Date
sudu
902e5e71e1
Update simple_shuffle.py, choose weights by 'weight', 'rpm', 'tpm' in one loop 2025-08-13 12:40:34 +08:00
Ishaan Jaff
38d0736599 bump fastapi-offline 2025-08-12 21:19:29 -07:00
Sameer Kankute
74496eefea
Implement GitHub Action to auto-label issues with provider keywords (#13537) 
* Add auto issue labelling for llm_translation

* Add logging

* make the formatting better

* make the formatting better

* make the formatting better

* make the formatting better
 2025-08-12 21:18:20 -07:00
Jugal D. Bhatt
e51c15705c
[Feat] Add CredentialDeleteModal component and integrate with CredentialsPanel (#13550) 
* [Feat] Add CredentialDeleteModal component and integrate with CredentialsPanel

* Implement CredentialDeleteModal for confirming credential deletions.
* Update CredentialsPanel to manage delete modal state and handle credential deletion.
* Ensure user confirmation before deleting credentials to prevent accidental removals.

* Update CredentialDeleteModal to use smart quotes for credential name in confirmation message

* Enhance CredentialDeleteModal with confirmation input and validation

* Added input field for user to confirm credential deletion by typing the credential name.
* Updated modal behavior to handle confirmation and cancellation actions.
* Removed unnecessary state management in CredentialsPanel for delete modal visibility.

* Fix HTML entity for apostrophe in CredentialDeleteModal confirmation message
 2025-08-12 21:17:39 -07:00
Ishaan Jaff
1249385a99
[Feat] GEMINI CLI - Add Token Counter for VertexAI Models (#13558) 
* add VertexAIModelInfo

* working API call to vertex ai

* add count_tokens MODE

* _construct_url

* test_vertex_ai_gemini_token_counting_with_contents
 2025-08-12 20:53:47 -07:00
Ishaan Jaff
74ddd21067
[Bug fix] SCIM Team Memberships - handle metadata (#13553) 
* test_update_group_metadata_serialization_issue

* fixes for update_group

* test_update_group_metadata_serialization_issue
 2025-08-12 20:53:12 -07:00
TensorNull
7cce327d09
Merge branch 'BerriAI:main' into main 2025-08-13 09:05:33 +08:00
tanjiro
ebae03cf93
Enhance chart readability with short-form notation for large numbers (#12370) 
* format y-axis value for total tokens

* format y-axis for the rest of the charts on model-activity

* revert changes for requests per day

* labels modified to plain text

* added plain text label for api_requests and spend

* minor

* move components to utils
 2025-08-12 17:24:03 -07:00
tanjiro
88e4d302a2
Fix internal users table overflow (#12736) 
* modify column name

* fix overflow

* remove height
 2025-08-12 17:23:23 -07:00
tanjiro
e4364ad1c4
Team Member Permissions Page - Access Column Changes (#13145) 
* revert prettier

* move allow access to right
 2025-08-12 17:22:24 -07:00
tanjiro
911b0cfd73
Display Error from Backend on the UI - Keys Page (#13435) 
* fix sso logout

- add a new login page with sso button

* lint fix

* lint fix

* lint fix

* fix tests

* fix test

* Revert "fix test"

This reverts commit 74eb734571.

* Reapply "fix test"

This reverts commit 72d0b2d4c6.

* add host to add modal

* close modal after save is clicked. and auto-refresh

* show old values in edit modal

* send the whole payload on edit

* Update settings.tsx

* resolve conflict

* fix conflict

* merge main

* first draft of notifications added to settings

* add error compatibility by taking errors from the backend

- db errors
- auth errors

* add support for different types of errors

* minor

* name change

* email alerts page notifications modified

* remove unused code

* move create_key to organisms/ folder

* move view_key_table to templates

* keys page notifications

* move regenerate_key to organisms

* notifications for regenerate key modal

* move key info view and key edit view to templates/ folder

* replace "Network response was not ok" with error data

* resolve merge conflict
 2025-08-12 17:21:04 -07:00
Krrish Dholakia
280ad6f049 fix(main.py): add sambanova api base support to embeddings 2025-08-12 17:17:19 -07:00
Jorge Piedrahita Ortiz
6a77780c0e
Feat/sambanova embeddings (#13308) 
* add sambanova embeddings

* fmt

* minor fix

* add sambanova embeddings call

* fmt

* include embeddings in sambanova docs

* add sambanova embeddigns unit test

* remove unused import

* minor fix

* fmt

* update sambanova embeding to inherit from BaseEmbeddingConfig

* fmt

* fmt

* hot fix

* fmt
 2025-08-12 17:15:26 -07:00
Jugal Bhatt
bb32ec991f Merge branch 'main' into litellm_mcp_config_fix 2025-08-12 17:10:18 -07:00
Ishaan Jaff
afe159bb8b
[Feat] GEMINI CLI Integration - Add /countTokens endpoint support (#13545) 
* stash changes for token counter

* working TokenCountRequest

* working acount_tokens

* add GoogleAIStudioTokenCounter

* re-use validate_environment

* fixes count_tokens

* fixes google_count_tokens

* fixes token counter base class

* fix TokenCountResponse

* fix - use BaseTokenCounter

* add should_use_token_counting_api

* fixes for GoogleAIStudioTokenCounter

* fixes for should_use_token_counting_api

* fixes for google_count_tokens

* fixes for /messages count_tokens

* fixes for should_use_token_counting_api

* working e2e gemini token counter

* ruff check fixes

* fixes for token counter

* fixes for TokenCountResponse

* cleanup TokenCountRequest

* add TokenCountDetailsResponse

* fix use well typed Responses

* fix typing for TokenCountDetailsResponse

* test_vertex_ai_gemini_token_counting_with_contents

* fixes for TokenCountDetailsResponse

* test fixes

* test_factory_registration

* test_proxy_token_counter.py

* TestGoogleAIStudioTokenCounter

* fix token_counter
 2025-08-12 16:19:58 -07:00
Jugal Bhatt
f487816b9f [fix] Enhance MCPServerManager with access groups and description support 
* Added access_groups and description fields to MCPServerManager for better server configuration.
* Implemented tests to verify integration of config-based servers with database servers, ensuring correct handling of access_groups and description.
* Updated add_update_server method to accommodate new fields and validate server addition in the registry.
 2025-08-12 14:22:40 -07:00
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346) 
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input

* fix for should_fake_stream

* TestBedrockGPTOSS

* should_fake_stream

* update supports vision field for openai.gpt-oss models

* fixes for bedrock gpt oss

* fixes for should_fake_stream

* docs bedrock gpt oss models
 2025-08-12 08:39:36 -07:00
Timothy Lowrimore
bb259a651c removes extraneous heading from readme 2025-08-12 09:11:16 -06:00
Timothy Lowrimore
c0d82545d3
Merge branch 'main' into heroku-llms 2025-08-12 09:02:51 -06:00
Timothy Lowrimore
cccf41c0df
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:46:48 -06:00
Timothy Lowrimore
1342abf163
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:46:16 -06:00
Timothy Lowrimore
586c0a7be5
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:47 -06:00
Timothy Lowrimore
7b0ecb1847
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:36 -06:00
Timothy Lowrimore
d4e320a4ce
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:21 -06:00
Timothy Lowrimore
5857d17fad
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:06 -06:00
Timothy Lowrimore
3cfb85228f
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:44:52 -06:00
Timothy Lowrimore
417b18a727
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:42:46 -06:00
Timothy Lowrimore
fa587c2eba
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:42:27 -06:00
Timothy Lowrimore
1be33ec47f
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:41:38 -06:00
Timothy Lowrimore
00c9f1fe0e
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:41:22 -06:00
Timothy Lowrimore
e97fa833b3
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:41:08 -06:00
Timothy Lowrimore
b20b28a912
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:40:54 -06:00
Timothy Lowrimore
e2165ff76e
Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:40:43 -06:00
Edward Samuel Pasaribu
36f160b582
Update openrouter/openai/gpt-5-mini pricing 2025-08-12 18:54:06 +08:00
Edward Samuel Pasaribu
d898f9e0dd
Add openrouter gpt-5 family models pricing 2025-08-12 18:51:56 +08:00
TensorNull
a3bf332697
Merge pull request #3 from cometapi-dev/dev 
docs: Add CometAPI documentation with authentication, usage examples, and error handling
 2025-08-12 17:35:48 +08:00
TensorNull
fa81c20df6 fix: Remove outdated models from the model list in the CometAPI document 2025-08-12 17:28:10 +08:00
TensorNull
8b602f9507 [Feat] - Add CometAPI documentation with authentication, usage examples, and error handling 2025-08-12 17:18:33 +08:00
NULL
4d2b5076a0
Merge branch 'BerriAI:main' into dev 2025-08-12 16:51:25 +08:00
NULL
12aba1352c
Merge branch 'BerriAI:main' into main 2025-08-12 16:51:07 +08:00
Krrish Dholakia
79e262d12b feat(common_utils.py): make default azure openai responses api use /openai/v1/responses logic 
Fixes https://github.com/BerriAI/litellm/issues/13527#issuecomment-3177882103
 2025-08-11 23:40:05 -07:00
Krrish Dholakia
e1fd49ce91 build(model_prices_and_context_window.json): fix claude-sonnet-4 on openrouter 
Fixes https://github.com/BerriAI/litellm/issues/13520
 2025-08-11 23:26:06 -07:00
Krrish Dholakia
2aacf64db1 test: add unit tests 2025-08-11 22:58:58 -07:00
Krrish Dholakia
72c7e82ef8 fix(azure/common_utils.py): generify api version logic 2025-08-11 22:54:44 -07:00
Krrish Dholakia
ca642d32e1 fix(azure/common_utils.py): add default api version for openai responses api calls 2025-08-11 22:53:45 -07:00
Ishaan Jaff
008ea864a7
[Feat] - Add key/team logging for Langfuse OTEL Logger (#13512) 
* feat - add key/team logging for LF

* test_construct_dynamic_otel_headers_with_langfuse_keys

* update LangfuseOtelLogger

* test_construct_dynamic_otel_headers_with_langfuse_keys

* cleanup

* OpenTelemetryConfig fixes

* fix code qa checks

* TestLangfuseOtelIntegration
 2025-08-11 22:06:25 -07:00
Krrish Dholakia
bc9d0484e4 fix(cooldown_cache.py): mask error string to avoid leaking sensitive prompt data 
Fixes https://github.com/BerriAI/litellm/issues/13329
 2025-08-11 18:37:57 -07:00
Krrish Dholakia
dab3acdd26 fix(handle_error.py): add unit tests 2025-08-11 18:25:30 -07:00
Krrish Dholakia
56241e937a fix(handle_error.py): don't return backend exception to user - can contain prompt leakage 
Fixes https://github.com/BerriAI/litellm/issues/13329
 2025-08-11 18:19:47 -07:00
tanjiro
d5135bba31
Allow unsetting TPM and RPM - Teams Settings (#13430) 
* modified tpm rpm for 0 and null values

* show unlimited if tpm/rpm 0 or null

* bring back unlimited
 2025-08-11 18:11:43 -07:00