Jugal Bhatt
f487816b9f
[fix] Enhance MCPServerManager with access groups and description support
...
* Added access_groups and description fields to MCPServerManager for better server configuration.
* Implemented tests to verify integration of config-based servers with database servers, ensuring correct handling of access_groups and description.
* Updated add_update_server method to accommodate new fields and validate server addition in the registry.
2025-08-12 14:22:40 -07:00
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family ( #13346 )
...
* add openai.gpt-oss-20b-1:0
* update BEDROCK_CONVERSE_MODELS
* openai.gpt-oss-20b-1:0 fixes
* fix PDF input
* fix for should_fake_stream
* TestBedrockGPTOSS
* should_fake_stream
* update supports vision field for openai.gpt-oss models
* fixes for bedrock gpt oss
* fixes for should_fake_stream
* docs bedrock gpt oss models
2025-08-12 08:39:36 -07:00
Timothy Lowrimore
bb259a651c
removes extraneous heading from readme
2025-08-12 09:11:16 -06:00
Timothy Lowrimore
c0d82545d3
Merge branch 'main' into heroku-llms
2025-08-12 09:02:51 -06:00
Timothy Lowrimore
cccf41c0df
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:46:48 -06:00
Timothy Lowrimore
1342abf163
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:46:16 -06:00
Timothy Lowrimore
586c0a7be5
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:47 -06:00
Timothy Lowrimore
7b0ecb1847
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:36 -06:00
Timothy Lowrimore
d4e320a4ce
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:21 -06:00
Timothy Lowrimore
5857d17fad
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:45:06 -06:00
Timothy Lowrimore
3cfb85228f
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:44:52 -06:00
Timothy Lowrimore
417b18a727
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:42:46 -06:00
Timothy Lowrimore
fa587c2eba
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:42:27 -06:00
Timothy Lowrimore
1be33ec47f
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:41:38 -06:00
Timothy Lowrimore
00c9f1fe0e
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:41:22 -06:00
Timothy Lowrimore
e97fa833b3
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:41:08 -06:00
Timothy Lowrimore
b20b28a912
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:40:54 -06:00
Timothy Lowrimore
e2165ff76e
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
2025-08-12 08:40:43 -06:00
Edward Samuel Pasaribu
36f160b582
Update openrouter/openai/gpt-5-mini pricing
2025-08-12 18:54:06 +08:00
Edward Samuel Pasaribu
d898f9e0dd
Add openrouter gpt-5 family models pricing
2025-08-12 18:51:56 +08:00
TensorNull
a3bf332697
Merge pull request #3 from cometapi-dev/dev
...
docs: Add CometAPI documentation with authentication, usage examples, and error handling
2025-08-12 17:35:48 +08:00
TensorNull
fa81c20df6
fix: Remove outdated models from the model list in the CometAPI document
2025-08-12 17:28:10 +08:00
TensorNull
8b602f9507
[Feat] - Add CometAPI documentation with authentication, usage examples, and error handling
2025-08-12 17:18:33 +08:00
NULL
4d2b5076a0
Merge branch 'BerriAI:main' into dev
2025-08-12 16:51:25 +08:00
NULL
12aba1352c
Merge branch 'BerriAI:main' into main
2025-08-12 16:51:07 +08:00
Krrish Dholakia
79e262d12b
feat(common_utils.py): make default azure openai responses api use /openai/v1/responses logic
...
Fixes https://github.com/BerriAI/litellm/issues/13527#issuecomment-3177882103
2025-08-11 23:40:05 -07:00
Krrish Dholakia
e1fd49ce91
build(model_prices_and_context_window.json): fix claude-sonnet-4 on openrouter
...
Fixes https://github.com/BerriAI/litellm/issues/13520
2025-08-11 23:26:06 -07:00
Krrish Dholakia
2aacf64db1
test: add unit tests
2025-08-11 22:58:58 -07:00
Krrish Dholakia
72c7e82ef8
fix(azure/common_utils.py): generify api version logic
2025-08-11 22:54:44 -07:00
Krrish Dholakia
ca642d32e1
fix(azure/common_utils.py): add default api version for openai responses api calls
2025-08-11 22:53:45 -07:00
Ishaan Jaff
008ea864a7
[Feat] - Add key/team logging for Langfuse OTEL Logger ( #13512 )
...
* feat - add key/team logging for LF
* test_construct_dynamic_otel_headers_with_langfuse_keys
* update LangfuseOtelLogger
* test_construct_dynamic_otel_headers_with_langfuse_keys
* cleanup
* OpenTelemetryConfig fixes
* fix code qa checks
* TestLangfuseOtelIntegration
2025-08-11 22:06:25 -07:00
Krrish Dholakia
bc9d0484e4
fix(cooldown_cache.py): mask error string to avoid leaking sensitive prompt data
...
Fixes https://github.com/BerriAI/litellm/issues/13329
2025-08-11 18:37:57 -07:00
Krrish Dholakia
dab3acdd26
fix(handle_error.py): add unit tests
2025-08-11 18:25:30 -07:00
Krrish Dholakia
56241e937a
fix(handle_error.py): don't return backend exception to user - can contain prompt leakage
...
Fixes https://github.com/BerriAI/litellm/issues/13329
2025-08-11 18:19:47 -07:00
tanjiro
d5135bba31
Allow unsetting TPM and RPM - Teams Settings ( #13430 )
...
* modified tpm rpm for 0 and null values
* show unlimited if tpm/rpm 0 or null
* bring back unlimited
2025-08-11 18:11:43 -07:00
NULL
f3dcae2528
feat: add CometAPI provider support with chat completions and streaming ( #13458 )
...
* feat: add CometAPI support with config, error handling and tests
* fix: specify type for extra_body in CometAPIConfig
---------
Signed-off-by: NULL <129579691+TensorNull@users.noreply.github.com>
2025-08-11 18:06:37 -07:00
breno-aumo
7484a19edf
Fix OCI streaming ( #13437 )
...
* add oci models to model_prices_and_context_window.json
* remove unsupported and unavailable oci models from docs
* fix: split data chunks when using async streaming
* add oci models to model_prices_and_context_window.json
* fix: split data chunks when using async streaming
* revert model.json modifications
2025-08-11 18:04:58 -07:00
Ishaan Jaff
49ca4dc792
Sending tags to LiteLLM Proxy ( #13517 )
2025-08-11 17:58:50 -07:00
Krrish Dholakia
21e067e47f
fix: fix check
2025-08-11 17:56:19 -07:00
Krrish Dholakia
92ebf5b918
fix(router.py): fix print statement
2025-08-11 17:46:14 -07:00
Jugal D. Bhatt
5efe59e6e2
[Draft] [LLM Translation] Add model id check ( #13507 )
...
* Add model id check
* add ruff fix
2025-08-11 15:41:08 -07:00
Ishaan Jaff
9f78287000
[Bug Fix]: Azure OpenAI GPT-5 max_tokens + reasoning param support ( #13510 )
...
* add AzureOpenAIGPT5Config
* add AzureOpenAIGPT5Config
* add AzureOpenAIGPT5Config
* add AzureOpenAIGPT5Config
* test_azure_gpt5_supports_reasoning_effort
* test_azure_gpt5_reasoning
* test_azure_gpt5_reasoning
* ruff check fixes
* docs azure gpt5
2025-08-11 15:40:53 -07:00
Timothy Lowrimore
cc3ec33fe9
removes unused imports that are causing linting failures
2025-08-11 09:52:20 -06:00
Timothy Lowrimore
95d9e30448
Merge branch 'main' into heroku-llms
2025-08-11 09:45:52 -06:00
Timothy Lowrimore
51b52534fb
fixes misconfigured OCI models by setting supports_tool_choice: true
2025-08-11 09:40:40 -06:00
Cole McIntosh
8197fd74d5
Revert "merge from upstream"
...
This reverts commit e6ca91869a
2025-08-11 07:54:47 -06:00
Cole McIntosh
e6ca91869a
merge from upstream
2025-08-11 07:38:16 -06:00
Cole McIntosh
d5d7e00d34
Enhance chunk parsing for Ollama streaming responses
...
Updated the chunk_parser method to return a ModelResponseStream when handling 'thinking' field content, allowing UIs to render reasoning information. Adjusted tests to verify the new behavior, ensuring that reasoning content is correctly returned in the response.
2025-08-11 07:02:25 -06:00
Cole McIntosh
7a1c6efa0a
Merge branch 'BerriAI:main' into fix/ollama-gpt-oss-thinking-field
2025-08-11 06:54:51 -06:00
Ishaan Jaff
1cd827874f
[Bug Fix] - Allow using reasoning_effort for gpt-5 model family and reasoning for Responses API ( #13475 )
...
* test_openai_gpt5_reasoning
* test_openai_gpt5_reasoning_effort_parameter
* add OpenAIGPT5ResponsesAPIConfig
* test_openai_gpt5_reasoning_effort_parameter
* fixes
2025-08-10 09:55:36 -07:00
