scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-06 02:48:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103
24591 commits 3198 branches 1436 tags 4.5 GiB
Commit graph

24591 commits

This branch
This branch
All branches
Author SHA1 Message Date
tanjiro
ebae03cf93
Enhance chart readability with short-form notation for large numbers (#12370) 
* format y-axis value for total tokens

* format y-axis for the rest of the charts on model-activity

* revert changes for requests per day

* labels modified to plain text

* added plain text label for api_requests and spend

* minor

* move components to utils
 2025-08-12 17:24:03 -07:00
tanjiro
88e4d302a2
Fix internal users table overflow (#12736) 
* modify column name

* fix overflow

* remove height
 2025-08-12 17:23:23 -07:00
tanjiro
e4364ad1c4
Team Member Permissions Page - Access Column Changes (#13145) 
* revert prettier

* move allow access to right
 2025-08-12 17:22:24 -07:00
tanjiro
911b0cfd73
Display Error from Backend on the UI - Keys Page (#13435) 
* fix sso logout

- add a new login page with sso button

* lint fix

* lint fix

* lint fix

* fix tests

* fix test

* Revert "fix test"

This reverts commit 74eb734571.

* Reapply "fix test"

This reverts commit 72d0b2d4c6.

* add host to add modal

* close modal after save is clicked. and auto-refresh

* show old values in edit modal

* send the whole payload on edit

* Update settings.tsx

* resolve conflict

* fix conflict

* merge main

* first draft of notifications added to settings

* add error compatibility by taking errors from the backend

- db errors
- auth errors

* add support for different types of errors

* minor

* name change

* email alerts page notifications modified

* remove unused code

* move create_key to organisms/ folder

* move view_key_table to templates

* keys page notifications

* move regenerate_key to organisms

* notifications for regenerate key modal

* move key info view and key edit view to templates/ folder

* replace "Network response was not ok" with error data

* resolve merge conflict
 2025-08-12 17:21:04 -07:00
Krrish Dholakia
280ad6f049 fix(main.py): add sambanova api base support to embeddings 2025-08-12 17:17:19 -07:00
Jorge Piedrahita Ortiz
6a77780c0e
Feat/sambanova embeddings (#13308) 
* add sambanova embeddings

* fmt

* minor fix

* add sambanova embeddings call

* fmt

* include embeddings in sambanova docs

* add sambanova embeddigns unit test

* remove unused import

* minor fix

* fmt

* update sambanova embeding to inherit from BaseEmbeddingConfig

* fmt

* fmt

* hot fix

* fmt
 2025-08-12 17:15:26 -07:00
Jugal Bhatt
bb32ec991f Merge branch 'main' into litellm_mcp_config_fix 2025-08-12 17:10:18 -07:00
Ishaan Jaff
afe159bb8b
[Feat] GEMINI CLI Integration - Add /countTokens endpoint support (#13545) 
* stash changes for token counter

* working TokenCountRequest

* working acount_tokens

* add GoogleAIStudioTokenCounter

* re-use validate_environment

* fixes count_tokens

* fixes google_count_tokens

* fixes token counter base class

* fix TokenCountResponse

* fix - use BaseTokenCounter

* add should_use_token_counting_api

* fixes for GoogleAIStudioTokenCounter

* fixes for should_use_token_counting_api

* fixes for google_count_tokens

* fixes for /messages count_tokens

* fixes for should_use_token_counting_api

* working e2e gemini token counter

* ruff check fixes

* fixes for token counter

* fixes for TokenCountResponse

* cleanup TokenCountRequest

* add TokenCountDetailsResponse

* fix use well typed Responses

* fix typing for TokenCountDetailsResponse

* test_vertex_ai_gemini_token_counting_with_contents

* fixes for TokenCountDetailsResponse

* test fixes

* test_factory_registration

* test_proxy_token_counter.py

* TestGoogleAIStudioTokenCounter

* fix token_counter
 2025-08-12 16:19:58 -07:00
Jugal Bhatt
f487816b9f [fix] Enhance MCPServerManager with access groups and description support 
* Added access_groups and description fields to MCPServerManager for better server configuration.
* Implemented tests to verify integration of config-based servers with database servers, ensuring correct handling of access_groups and description.
* Updated add_update_server method to accommodate new fields and validate server addition in the registry.
 2025-08-12 14:22:40 -07:00
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346) 
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input

* fix for should_fake_stream

* TestBedrockGPTOSS

* should_fake_stream

* update supports vision field for openai.gpt-oss models

* fixes for bedrock gpt oss

* fixes for should_fake_stream

* docs bedrock gpt oss models
 2025-08-12 08:39:36 -07:00
Edward Samuel Pasaribu
36f160b582
Update openrouter/openai/gpt-5-mini pricing 2025-08-12 18:54:06 +08:00
Edward Samuel Pasaribu
d898f9e0dd
Add openrouter gpt-5 family models pricing 2025-08-12 18:51:56 +08:00
TensorNull
a3bf332697
Merge pull request #3 from cometapi-dev/dev 
docs: Add CometAPI documentation with authentication, usage examples, and error handling
 2025-08-12 17:35:48 +08:00
TensorNull
fa81c20df6 fix: Remove outdated models from the model list in the CometAPI document 2025-08-12 17:28:10 +08:00
TensorNull
8b602f9507 [Feat] - Add CometAPI documentation with authentication, usage examples, and error handling 2025-08-12 17:18:33 +08:00
NULL
4d2b5076a0
Merge branch 'BerriAI:main' into dev 2025-08-12 16:51:25 +08:00
NULL
12aba1352c
Merge branch 'BerriAI:main' into main 2025-08-12 16:51:07 +08:00
Krrish Dholakia
79e262d12b feat(common_utils.py): make default azure openai responses api use /openai/v1/responses logic 
Fixes https://github.com/BerriAI/litellm/issues/13527#issuecomment-3177882103
 2025-08-11 23:40:05 -07:00
Krrish Dholakia
e1fd49ce91 build(model_prices_and_context_window.json): fix claude-sonnet-4 on openrouter 
Fixes https://github.com/BerriAI/litellm/issues/13520
 2025-08-11 23:26:06 -07:00
Krrish Dholakia
2aacf64db1 test: add unit tests 2025-08-11 22:58:58 -07:00
Krrish Dholakia
72c7e82ef8 fix(azure/common_utils.py): generify api version logic 2025-08-11 22:54:44 -07:00
Krrish Dholakia
ca642d32e1 fix(azure/common_utils.py): add default api version for openai responses api calls 2025-08-11 22:53:45 -07:00
Ishaan Jaff
008ea864a7
[Feat] - Add key/team logging for Langfuse OTEL Logger (#13512) 
* feat - add key/team logging for LF

* test_construct_dynamic_otel_headers_with_langfuse_keys

* update LangfuseOtelLogger

* test_construct_dynamic_otel_headers_with_langfuse_keys

* cleanup

* OpenTelemetryConfig fixes

* fix code qa checks

* TestLangfuseOtelIntegration
 2025-08-11 22:06:25 -07:00
Krrish Dholakia
bc9d0484e4 fix(cooldown_cache.py): mask error string to avoid leaking sensitive prompt data 
Fixes https://github.com/BerriAI/litellm/issues/13329
 2025-08-11 18:37:57 -07:00
Krrish Dholakia
dab3acdd26 fix(handle_error.py): add unit tests 2025-08-11 18:25:30 -07:00
Krrish Dholakia
56241e937a fix(handle_error.py): don't return backend exception to user - can contain prompt leakage 
Fixes https://github.com/BerriAI/litellm/issues/13329
 2025-08-11 18:19:47 -07:00
tanjiro
d5135bba31
Allow unsetting TPM and RPM - Teams Settings (#13430) 
* modified tpm rpm for 0 and null values

* show unlimited if tpm/rpm 0 or null

* bring back unlimited
 2025-08-11 18:11:43 -07:00
NULL
f3dcae2528
feat: add CometAPI provider support with chat completions and streaming (#13458) 
* feat: add CometAPI support with config, error handling and tests

* fix: specify type for extra_body in CometAPIConfig

---------

Signed-off-by: NULL <129579691+TensorNull@users.noreply.github.com>
 2025-08-11 18:06:37 -07:00
breno-aumo
7484a19edf
Fix OCI streaming (#13437) 
* add oci models to model_prices_and_context_window.json

* remove unsupported and unavailable oci models from docs

* fix: split data chunks when using async streaming

* add oci models to model_prices_and_context_window.json

* fix: split data chunks when using async streaming

* revert model.json modifications
 2025-08-11 18:04:58 -07:00
Ishaan Jaff
49ca4dc792
Sending tags to LiteLLM Proxy (#13517) 2025-08-11 17:58:50 -07:00
Krrish Dholakia
21e067e47f fix: fix check 2025-08-11 17:56:19 -07:00
Krrish Dholakia
92ebf5b918 fix(router.py): fix print statement 2025-08-11 17:46:14 -07:00
Jugal D. Bhatt
5efe59e6e2
[Draft] [LLM Translation] Add model id check (#13507) 
* Add model id check

* add ruff fix
 2025-08-11 15:41:08 -07:00
Ishaan Jaff
9f78287000
[Bug Fix]: Azure OpenAI GPT-5 max_tokens + reasoning param support (#13510) 
* add AzureOpenAIGPT5Config

* add AzureOpenAIGPT5Config

* add AzureOpenAIGPT5Config

* add AzureOpenAIGPT5Config

* test_azure_gpt5_supports_reasoning_effort

* test_azure_gpt5_reasoning

* test_azure_gpt5_reasoning

* ruff check fixes

* docs azure gpt5
 2025-08-11 15:40:53 -07:00
Cole McIntosh
8197fd74d5 Revert "merge from upstream" 
This reverts commit e6ca91869a.
 2025-08-11 07:54:47 -06:00
Cole McIntosh
e6ca91869a merge from upstream 2025-08-11 07:38:16 -06:00
Cole McIntosh
d5d7e00d34 Enhance chunk parsing for Ollama streaming responses 
Updated the chunk_parser method to return a ModelResponseStream when handling 'thinking' field content, allowing UIs to render reasoning information. Adjusted tests to verify the new behavior, ensuring that reasoning content is correctly returned in the response.
 2025-08-11 07:02:25 -06:00
Cole McIntosh
7a1c6efa0a
Merge branch 'BerriAI:main' into fix/ollama-gpt-oss-thinking-field 2025-08-11 06:54:51 -06:00
Ishaan Jaff
1cd827874f
[Bug Fix] - Allow using reasoning_effort for gpt-5 model family and reasoning for Responses API (#13475) 
* test_openai_gpt5_reasoning

* test_openai_gpt5_reasoning_effort_parameter

* add OpenAIGPT5ResponsesAPIConfig

* test_openai_gpt5_reasoning_effort_parameter

* fixes
 2025-08-10 09:55:36 -07:00
Krrish Dholakia
bd8a0ae0d0 docs: fix order 2025-08-10 09:42:55 -07:00
Krrish Dholakia
1dbac75675 docs(index.md): update release with deployment information 2025-08-10 09:31:28 -07:00
Krish Dholakia
0aeb4f1653
fix(health_check_helpers.py): set max tokens for wildcard call to 10, fixes calling gpt-5-nano via wildcard on openai (#13482) 
gpt-5-nano raises errors for max_tokens=1
 2025-08-10 09:23:36 -07:00
Krish Dholakia
184687157e
Litellm model cost map fixes (#13480) 
* build(model_prices_and_context_window.json): fix max token values

* build(model_prices_and_context_window.json): fix max token values

* build(model_prices_and_context_window.json): fix azure gpt-5-chat pricing
 2025-08-10 07:38:35 -07:00
Krish Dholakia
c742c76288
Litellm release notes 08 10 2025 (#13479) 
* docs(index.md): initial doc

* build(index.md): initial notes

* docs(index.md): add llm translation tickets

* docs(index.md): document new model support

* docs(index.md): document all pricing changes

* docs(index.md): add llm api endpoints

* docs(index.md): add doc on mcp gateway

* docs(index.md): add all remaining rc notes

* docs(index.md): cleanup
 2025-08-10 07:32:11 -07:00
Krrish Dholakia
ece2c9c65d bump: version 1.75.4 → 1.75.5 2025-08-09 16:31:51 -07:00
Krrish Dholakia
0eedf7c447 build: update local model cost map 2025-08-09 16:31:41 -07:00
Krish Dholakia
9f6f96d76c
Litellm dev 08 07 2025 p1 (#13418) 
* fix(router.py): support base model for model group usage

allows model group info to show accurate cost information for azure models

* fix(router.py): fix changes

* test: add unit tests

* build(pyproject.toml): bump openai version requirements

support custom tool from responses api

 Closes https://github.com/BerriAI/litellm/issues/13391

* docs(responses_api.md): add verbosity + free-form function calling parameters

* docs(responses_api.md): add cfg + minimal reasoning to docs

Closes https://github.com/BerriAI/litellm/issues/13391

* docs(responses_api.md): add proxy examples to docs

* refactor: fix ruff error
 2025-08-09 16:30:04 -07:00
Sannan Nasir
0e53b1feab
Add digitalocean provider (#12169) 
* Add digitalocean provider

* Add digitalocean provider

* Revert "Add digitalocean provider"

This reverts commit 96dda40f45.

* changes

* fixes

* Update transformation

* refactoring

* rename provider to Gradient AI

* fixes

* Incorporte review comments

* revert changes

* fix typo

* revert change

* incorporated review comments

* Revert "Incorporte review comments"

This reverts commit 37bd51bd54.

* changes

* Revert "Revert "Incorporte review comments"

This reverts commit 37bd51bd54ef4fd52ccc12866e47f8de9476d597."

This reverts commit 68c8a198ee.

* changes

* fixes

* Update provider_specific_fields.tsx
 2025-08-09 16:26:33 -07:00
Ishaan Jaff
f60a9cf908
[Bug]: Fix JWTs access not working with model groups (#13474) 
* fix can_team_access_model

* test_find_team_with_model_access_model_group
 2025-08-09 16:14:51 -07:00
Jugal D. Bhatt
95fbe59c46
Add local storage auth (#13473) 2025-08-09 16:13:56 -07:00