Commit graph

24591 commits

Author SHA1 Message Date
TomeHirata
1ac7f875c9 fix test 2025-09-01 17:21:47 +09:00
TomeHirata
e334f48699 Add supported text field to anthropic citation response 2025-09-01 16:46:54 +09:00
mubashir1osmani (aider)
a8f2ebed9c fix: import verbose_proxy_logger to resolve undefined name errors 2025-09-01 01:17:46 -04:00
mubashir1osmani (aider)
83654c5608 feat: add UI support for displaying and managing guardrails on virtual keys 2025-09-01 01:17:08 -04:00
mubashir1osmani (aider)
6cd5afa8b1 feat: add persistence and management for guardrails on virtual keys 2025-09-01 00:56:22 -04:00
Krrish Dholakia
0c9051abba docs(docker_quick_start.md): add docker compose to quick start 2025-08-31 21:24:30 -07:00
Krrish Dholakia
2ad77d9bf6 feat(ollama/completion): output parse thinking content on streaming + non-streaming for ollama completion calls
Completes 'thinking' param support for ollama
2025-08-31 21:17:10 -07:00
Krrish Dholakia
e6429f6565 feat(ollama_chat/transformation.py): handle thinking content on streaming for ollama chat models
Output parse correctly to 'reasoning_content'
2025-08-31 20:55:01 -07:00
Krrish Dholakia
90bd89c7fd feat(ollama_chat/): add 'think' param support + output parse '<think>' content into 'reasoning_content'
Ensures consistent use of thinking
2025-08-31 20:38:52 -07:00
Krrish Dholakia
3a68ca5140 fix(ollama/chat): add 'think' param support 2025-08-31 20:29:21 -07:00
Krrish Dholakia
130c1dd4fc fix(types/openai.py): add default none values to responsesapiresponse object
Fixes https://github.com/BerriAI/litellm/issues/14061
2025-08-31 20:25:12 -07:00
tanjiro
15baaf68db back to logs added conditionally 2025-08-31 17:09:11 +09:00
tanjiro
eed2358335 move filter inside user table 2025-08-31 14:03:32 +09:00
Krrish Dholakia
b6f6dc5c1c feat(vertex_ai.py): support parsing thinking content into gemini format
allows function calls with thought signatures to be sent back to gemini

  Closes https://github.com/BerriAI/litellm/pull/13842
2025-08-30 18:49:34 -07:00
Krrish Dholakia
51c73dc60b fix(vertex_and_google_ai_studio_gemini.py): bubble up thoughtsignature back to client 2025-08-30 17:26:18 -07:00
Ishaan Jaff
dea3b53578 UI new build 2025-08-30 17:13:48 -07:00
Krrish Dholakia
599071321d fix(braintrust_logging.py): refactor to consistently use standard logging payload 2025-08-30 16:24:03 -07:00
Krrish Dholakia
9cffabb433 refactor(braintrust_logging.py): migrate braintrust logging to standard logging payload
avoids issue with span in request metadata

standard logging payload is always json serializable
2025-08-30 16:17:57 -07:00
Krrish Dholakia
cb5464421f fix(braintrust_logging.py): filter metadata before logging
avoid unserializable json
2025-08-30 16:11:39 -07:00
Ishaan Jaff
ccb7ce03a3
[Docs] v1.76.1-stable (#14094)
* docs 1.76.1

* fix docs

* docs 1.76.1

* New Model Support

* docs fixes
2025-08-30 14:54:27 -07:00
Ishaan Jaff
34275ab273 Revert "Merge pull request #14005 from moshemorad/bedrock_fix_structure_output"
This reverts commit 75c327cb9e, reversing
changes made to afa687182a.
2025-08-30 13:37:10 -07:00
Ishaan Jaff
48d3aad68f test_caching_with_models_v2 2025-08-30 13:21:14 -07:00
Ishaan Jaff
c9b86775a7 test_system_message_with_no_user_message 2025-08-30 13:09:25 -07:00
Ishaan Jaff
7ff93cd1b1 Revert "Merge pull request #12865 from aholmberg/holmberg/default-reasoning"
This reverts commit 68f4847659, reversing
changes made to df39320889.
2025-08-30 13:07:33 -07:00
Ishaan Jaff
3cb8e23dfe Revert "Merge pull request #14026 from TomeHirata/citation-supported-text"
This reverts commit afa687182a, reversing
changes made to 55186dad4c.
2025-08-30 11:23:18 -07:00
Ishaan Jaff
dc6161535a fix for supports_reasoning check added in 68f4847659 2025-08-30 11:06:02 -07:00
Ishaan Jaff
de6b08e76e test_supports_tool_choice 2025-08-30 10:35:16 -07:00
Ishaan Jaff
3fc2198d27 fix: test_gemini_image_generation_async_stream 2025-08-30 10:33:23 -07:00
Ishaan Jaff
efebf7ec7b test_gemini_image_generation_async 2025-08-30 10:29:24 -07:00
Ishaan Jaff
fa4c833e58 fix: supports reasoning 2025-08-30 10:29:08 -07:00
Ishaan Jaff
fd39f22e3e test_completion_openrouter_reasoning_content 2025-08-30 09:27:37 -07:00
superpoussin22
7ed4a84393
Fix indentation in get_llm_provider_logic.py (#14088)
* Fix indentation in get_llm_provider_logic.py

fix missing closing )

* Fix indentation in get_llm_provider_logic.py

fix typo
2025-08-30 09:24:41 -07:00
Krish Dholakia
4d0c1a1769
Merge pull request #13144 from joshualipman123/add-vercel-ai-gateway-provider
Add Vercel AI Gateway provider
2025-08-29 22:27:20 -07:00
Krish Dholakia
8b11452d9e
Merge branch 'main' into add-vercel-ai-gateway-provider 2025-08-29 22:27:08 -07:00
Krish Dholakia
ead7e7259b
Merge pull request #13152 from betterthanbreakfast/bug-openmeter-user-id-from-token
[Bug]: Set user from token user_id for OpenMeter integration
2025-08-29 22:21:26 -07:00
Krish Dholakia
85640e57cd
Merge pull request #14075 from BerriAI/fix-collapsible-nav
Fix collapsible navbar design
2025-08-29 22:16:25 -07:00
Krish Dholakia
75c327cb9e
Merge pull request #14005 from moshemorad/bedrock_fix_structure_output
Bedrock fix structure output
2025-08-29 22:04:51 -07:00
Krish Dholakia
afa687182a
Merge pull request #14026 from TomeHirata/citation-supported-text
Add supported text field to anthropic citation response
2025-08-29 22:02:18 -07:00
Krrish Dholakia
55186dad4c fix: fix linting error 2025-08-29 21:53:37 -07:00
Zain Hasan
8a5df2eb74
update together models
- add tool choice for models
- add deepseek v3.1
2025-08-30 00:44:42 -04:00
Ishaan Jaff
562790cb31 fix: /v1/realtime check 2025-08-29 18:38:14 -07:00
Ishaan Jaff
37d885e46a
[Fix] LiteLLM does not support new web_search tool (Responses API) (#14083)
* test_basic_openai_responses_with_websearch

* fix: ResponsesAPIResponse

* fix: StandardBuiltInToolCostTracking
2025-08-29 18:33:52 -07:00
Ishaan Jaff
d9ca0f9300
security: fix next js version (#14084) 2025-08-29 18:09:11 -07:00
Ishaan Jaff
be86861eb8
feat: add gpt-realtime models - gpt-realtime (#14082)
* feat: add gpt-realtime models

* add input_cost_per_image
2025-08-29 17:49:47 -07:00
WilsonSunBritten
6d81d75948
docs: Add documentation for MAX_STRING_LENGTH_PROMPT_IN_DB environment variable (#14079)
Added documentation for the new MAX_STRING_LENGTH_PROMPT_IN_DB environment variable to the config settings guide. This variable controls the maximum length of strings in spend logs when sanitizing request bodies, with a default value of 1000 characters.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-29 17:38:50 -07:00
Ishaan Jaff
5ee7a675f2
[Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 (#14078)
* fix: _supports_frequency_penalty

* _supports_frequency_penalty

* test_xai_grok_4_frequency_penalty_not_supported
2025-08-29 17:31:48 -07:00
Mubashir Osmani
38df2500b6
docs: usaged-based routing perf warnings (#14080) 2025-08-29 17:31:12 -07:00
Krrish Dholakia
86c5de17bc fix(handle_jwt.py): document the raw received jwt token 2025-08-29 14:53:07 -07:00
Ishaan Jaff
607f425cc6
[Bug]: Fix Can't set reasoning_effort for DeepSeek-V3.1 on DeepInfra by default (#14053)
* fix DeepInfraConfig

* track supports reasoning

* fix: get_supported_openai_params

* test_deepseek_supported_openai_params
2025-08-29 13:15:43 -07:00
Carson Gee
e74f1b6b62
Added DataRobot provider to sidebar (#14074) 2025-08-29 13:15:33 -07:00