Commit graph

42355 commits

Author SHA1 Message Date
Sameer Kankute
1ec89b8a04 Feat: add inference_geo based pricing 2026-02-06 13:58:47 +05:30
Sameer Kankute
0934a4ab68 Correct litellm/litellm/llms/anthropic/chat/transformation.py 2026-02-06 13:08:43 +05:30
Sameer Kankute
358a081f63 Add compaction support for vertex ai 2026-02-06 12:52:28 +05:30
Sameer Kankute
1396813d74 The compact beta feature is not currently supported on the Converse and ConverseStream APIs 2026-02-06 12:52:28 +05:30
Sameer Kankute
d0444f402c Add test for compaction in anthropic 2026-02-06 12:52:28 +05:30
Sameer Kankute
7a473f2954
Apply suggestion from @greptile-apps[bot]
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-06 12:07:13 +05:30
Sameer Kankute
ea518a7684
Apply suggestion from @greptile-apps[bot]
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-06 12:06:50 +05:30
Sameer Kankute
887a977ab4 Add doc on how to enable compaction via chat completion 2026-02-06 12:05:36 +05:30
Sameer Kankute
24dda99bd7 Handle compaction block in the input request 2026-02-06 11:55:12 +05:30
Sameer Kankute
c03ba8394e Add compaction block in provider spcific fields streaming+ non streaming 2026-02-06 11:54:47 +05:30
Sameer Kankute
039b37fac1 Add compaction type block in the output 2026-02-06 11:31:35 +05:30
yuneng-jiang
0cb79ace97 Fixing tests 2026-02-05 21:44:00 -08:00
yuneng-jiang
b3f0dccf56 enterprise build 2026-02-05 21:31:20 -08:00
yuneng-jiang
e39530d0e6 bump: version 0.1.30 → 0.1.31 2026-02-05 21:28:13 -08:00
yuneng-jiang
b60d94d655 addressing comments 2026-02-05 21:27:42 -08:00
yuneng-jiang
de70a1c273
Merge pull request #20554 from BerriAI/ui_build_yj_03
[Refactor] Rename admins to AdminPanel
2026-02-05 21:12:48 -08:00
yuneng-jiang
968b953f84 rename admins to AdminPanel 2026-02-05 21:11:26 -08:00
yuneng-jiang
3504f05a5c Adding tests + update pyproject 2026-02-05 21:00:05 -08:00
yuneng-jiang
704fac56fe reverting .29 deletion 2026-02-05 20:51:55 -08:00
yuneng-jiang
7f11fa0a05 enterprise build 2026-02-05 20:48:07 -08:00
yuneng-jiang
828b13279e bump: version 0.1.29 → 0.1.30 2026-02-05 20:44:43 -08:00
yuneng-jiang
ec5dc0be51 email soft budgets 2026-02-05 20:42:43 -08:00
Swayambhu
eee37c569d fix: ensure Ant Design notification instance is initialized only once using useRef. 2026-02-06 10:01:44 +05:30
yuneng-jiang
5ce5399fbb
Merge pull request #20469 from swayambhu94/fix/ui/model-hub-table-crash
fix: Add array type checks for model, agent, and MCP hub data to prev…
2026-02-05 20:14:51 -08:00
Swayambhu
08a6fe2bfa refactor: migrate Ant Design notifications to use App.useApp() context via a new global provider.
1.
notifications_manager.tsx
 - Hybrid notification approach:

Added notificationInstance variable to store the context-based instance
Added
setNotificationInstance()
 function to inject the instance from context
Created
getNotification()
 helper that prefers context instance, falls back to static
Added COMMON_NOTIFICATION_PROPS (exported) with showProgress: true and pauseOnHover: true
All notification methods (
error
,
warning
,
info
,
success
,
fromBackend
) now spread COMMON_NOTIFICATION_PROPS
2.
AntdGlobalProvider.tsx
 - New context provider:

Wraps app with Antd's <App> component
Uses App.useApp() hook to get the context-based notification instance
Injects it into NotificationManager via
setNotificationInstance()
2026-02-06 09:44:02 +05:30
yuneng-jiang
26cdc4a47b
Merge pull request #20465 from BerriAI/litellm_ui_dep_tremor
[Refactor] UI - Admin Page: Migrate to AntD Tabs
2026-02-05 20:12:17 -08:00
Sameer Kankute
1bcd407af6 Add adaptive thiking for bedrock converse 2026-02-06 09:40:16 +05:30
Sameer Kankute
f15dd691b4 Fix anthropic.claude-opus-4-6-v1 for bedrock 2026-02-06 09:28:50 +05:30
Sameer Kankute
186fd2e64e Add adaptive thinking support for anthropic opus 4.6 2026-02-06 09:24:43 +05:30
Kelvin Tran
524970b8d2 feat: add opus 4.5 and 4.6 to use outout_format param 2026-02-05 19:41:15 -08:00
Cesar Garcia
95f8cbe5ca
[Feat] add ElevenLabs eleven_v3 and eleven_multilingual_v2 to model cost map (#20522)
* [Feat] add ElevenLabs `eleven_v3` and `eleven_multilingual_v2` to model cost map

Register ElevenLabs TTS models for cost tracking:
- elevenlabs/eleven_v3: most expressive model, 70+ languages, audio tags
- elevenlabs/eleven_multilingual_v2: default TTS model, 29 languages

Also update ElevenLabs docs with supported models table and eleven_v3 audio tags example.

* docs: remove model-agnostic tip from ElevenLabs docs
2026-02-05 19:37:42 -08:00
Cesar Garcia
8263c8ad15
feat(web_search): add gpt-5-search-api model and docs clarifications (#20512)
* docs(web_search): clarify OpenAI search model requirements

- Add gpt-5-search-api to supported OpenAI search models
- Add warning that regular models (gpt-5, gpt-4.1) do NOT support web_search_options
- Add tip that web_search_options is optional for search models

* feat(models): add gpt-5-search-api pricing for OpenAI and Azure
2026-02-05 19:36:43 -08:00
Swayambhu
926fb3525c refactor: Add error handling for network calls and apply consistent formatting across networking functions. 2026-02-06 08:33:18 +05:30
Sameer Kankute
3923ef2857
Merge pull request #20491 from BerriAI/litellm_gemini_files_gcs
fix: make sure gcs_bucket_name passes
2026-02-06 08:26:14 +05:30
Sameer Kankute
f12875bd42
Update litellm/integrations/websearch_interception/tools.py
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-06 08:21:09 +05:30
Sameer Kankute
a2e70a561d
Potential fix for code scanning alert no. 4046: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2026-02-06 08:20:50 +05:30
yuneng-jiang
3bececfa7a
Merge pull request #20539 from BerriAI/litellm_usage_failed_req
[Refactor] UI - Usage Page: Spend By Provider
2026-02-05 16:39:55 -08:00
yuneng-jiang
f64f949715 Spend by provider refactor 2026-02-05 16:22:07 -08:00
Shivam Rawat
93cf1ef517
Merge pull request #20535 from BerriAI/litellm_move_anthropic_test_script
[Chore] Move anthropic input/output test to right folder
2026-02-05 16:12:08 -08:00
yuneng-jiang
523a36ed53
Merge pull request #20530 from BerriAI/litellm_ui_team_soft_budget
[Feature] Add soft_budget to Team Table + Create/Update Endpoints
2026-02-05 15:52:17 -08:00
shivam
3dc70c3398 moved the test anthropic file 2026-02-05 15:44:24 -08:00
Ishaan Jaffer
bff5f8d7b0 doc fix 2026-02-05 15:31:41 -08:00
yuneng-jiang
45c6382667 cz bump + builds 2026-02-05 14:47:11 -08:00
yuneng-jiang
8b0d0b2610 bump: version 0.4.30 → 0.4.31 2026-02-05 14:46:38 -08:00
yuneng-jiang
a17efa1c8e Add soft_budget to team table and create update endpoints 2026-02-05 14:43:48 -08:00
Ishaan Jaff
887a907e42
[Fix] Guardrails API - Ensure OpenAI Moderations Guard works with OpenAI Embeddings (#20523)
* init OpenAIEmbeddingsHandler

* init apply_guardrail

* use apply guardrails for OpenAI moderations

* test_embeddings_handler_string_input

* test_openai_moderation_guardrail_apply_guardrail

* fix typing

* test_openai_moderation_responses_api_input_field

* test fixes
2026-02-05 14:40:15 -08:00
Ryan Crabbe
1ba10cc22c perf: eliminate duplicate dict(request.headers) calls
- Create _raw_headers once at start, reuse for SecretFields
- Reuse _headers from clean_headers() instead of creating new dict
  (clean_headers already removes authorization)
- Eliminates 2 of 3 dict(request.headers) calls per request
2026-02-05 14:26:26 -08:00
Ryan Crabbe
58291e5e65 perf: skip guardrails processing when not configured (16% faster add_litellm_data_to_request)
- Remove duplicate add_guardrails_from_policy_engine() call that was
  already being made inside move_guardrails_to_metadata()
- Add early-out guard in move_guardrails_to_metadata() to skip all
  guardrails processing when no guardrails/policies are configured
- Remove redundant data.update() wrapper around
  add_litellm_metadata_from_request_headers() which already modifies
  data in place

Benchmark (3 runs x 2000 req x 1000 concurrency):
- add_litellm_data_to_request: 8.87s → 7.45s (-16%)
- Guardrails overhead: 1.0s (11.2%) → 0.24s (3.2%) (-76%)
2026-02-05 14:09:11 -08:00
Ryan Crabbe
b4b27203fc perf: cache request.url.path in _get_metadata_variable_name (add_litellm_data_to_request)
Cache request.url.path once instead of accessing it 6 times (2 in
assistants check + 4 in LITELLM_METADATA_ROUTES loop). Reduces
per-call time from 47µs to 20µs (-58%).

Also inline the assistants API check to avoid function call overhead.

Adds 8 tests for _get_metadata_variable_name covering all return paths.
2026-02-05 14:09:11 -08:00
Chesars
1d0c2f47a7 docs: add Opus 4.6 to OpenRouter model map and update Anthropic docs
- Add openrouter/anthropic/claude-opus-4.6 to model cost map
- Update Bedrock docs to list Opus 4.6 and Sonnet 4.5 as 1M context compatible
- Add missing Opus 4.6, Opus 4.5, and Opus 4.1 to Anthropic supported models table
2026-02-05 18:45:40 -03:00