Ishaan Jaff
527c8f59fa
[Feat] Tag Management - Add support for setting tag based budgets ( #15433 )
...
* feat: add LiteLLM_TagTable
* fix: use new table for tag management
* fix - allow setting budgets for tags
* working tag creation
* fix schema.prisma
* add tag info
* ui fixes
* ui fix tag info
* TAG_CACHE_IN_MEMORY_TTL_SECONDS
* add Litellm_EntityType
* fix get_aggregated_db_spend_update_transactions
* fix: _update_entity_spend_in_db
* fix _tag_max_budget_check
* add tag budget check
* add tag_list_transactions
* test_get_tag_objects_batch
* test_update_tag_db_without_prisma_client
* fix get_tags_from_request_body
* get_tags_from_request_body
* fix get_tags_from_request_body
* fix spend tracking utils
* get_tags_from_request_body
* test_get_tags_from_request_body_with_metadata_tags
* feat: add _update_tag_cache spend tracking
* fix _PROXY_track_cost_callback
* test_tag_cache_update_multiple_tags
* fix tag info
* docs fix
* docs tag budgets
* doc fix
* docs fix
* fix tag budget
* docs tag budgets
* docs fix
* ruff fix
2025-10-10 19:24:50 -07:00
Achintya Rajan
6b66e12dea
Litellm UI API Reference page updates ( #15438 )
...
* added new CodeBlock for better visuals
* added doc link
2025-10-10 18:18:31 -07:00
Pablo Gomez
f27a823256
Deletion of unnecessary and error causing volume section comment ( #15425 )
2025-10-10 17:51:27 -07:00
Alexsander Hamir
9d7dea42d0
[Fix] - SensitiveDataMasker converts lists to string ( #15420 )
...
* fix: preserve lists in SensitiveDataMasker to prevent string conversion
Added 'list' to allowed primitive types in mask_dict() to prevent lists like
tags from being converted to string representations in API responses.
Before: {"tags": "['East US 2', 'production', 'test']"}
After: {"tags": ["East US 2", "production", "test"]}
* add: unit test
2025-10-10 17:50:51 -07:00
Copilot
b9eb05ea63
[Feature]: Include server_name in /v1/mcp/server/health endpoint response ( #15431 )
...
* Initial plan
* Add server_name to MCP health check response
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-10-10 17:37:53 -07:00
Krish Dholakia
bb8dfe46c0
Merge pull request #15435 from BerriAI/litellm_ui_models_and_endpoints_refactor
...
Models & Endpoints Initial Refactor
2025-10-10 16:48:45 -07:00
Achintya Rajan
44ded6c4b5
import fixes & cleanup
2025-10-10 16:39:42 -07:00
Achintya Rajan
5a32a336e6
renamed component
2025-10-10 16:32:35 -07:00
Achintya Rajan
6cf9cce38f
Update model_dashboard.tsx
2025-10-10 16:31:28 -07:00
Achintya Rajan
f8f94b71f0
extracted FilterByContent
2025-10-10 16:29:49 -07:00
Achintya Rajan
a7e897a671
Update model_dashboard.tsx
2025-10-10 16:20:24 -07:00
Achintya Rajan
f456dbecbd
moved updateModelMetrics down
2025-10-10 16:15:35 -07:00
Achintya Rajan
25252d06d1
moved FilterByContent down
2025-10-10 16:03:07 -07:00
Achintya Rajan
29002b4f3b
extracted ModelAnalyticsTab.tsx
2025-10-10 15:48:02 -07:00
Achintya Rajan
020cecfe33
ModelRetrySettingsTab and PriceDataManagementTab
2025-10-10 15:32:55 -07:00
Achintya Rajan
ae39196315
removed props, transferred management down
2025-10-10 15:11:22 -07:00
Achintya Rajan
ff06e6d4ea
extracted AllModelsTab, eliminating props
2025-10-10 15:02:38 -07:00
Ishaan Jaff
bf209415da
[Feat] VertexAI Gemma model family streaming support + Added MedGemma ( #15427 )
...
* test_acompletion_filters_stream_and_stream_options
* fix: stream_options
* docs medgemma
* lint fix
* docs
2025-10-10 14:22:27 -07:00
Brandon Cook
a0e81a7f1c
feat: add Bedrock AU Cross-Region Inference ( #15402 )
2025-10-10 14:18:51 -07:00
Sameer Kankute
a2123f7596
fix lint errors ( #15406 )
...
* fix lint errors
* fix mypy error
* Update docs error
2025-10-10 14:16:23 -07:00
Ishaan Jaff
ed62d6c943
[Fix] VertexAI - gemma model family support (custom endpoints) ( #15419 )
...
* TestVertexGemmaiCompletion
* test vertex Gemma
* fix file name
* fix file naming
* add VertexAIGemmaModels
* add cost_router for vertexai
* fix main.py
* fix VertexGemmaConfig
* fix Vertex AI Gemma-AI Models Handler
* docs gemma
* fix ids
* test fix
* ruff check fixes
* docs fix
* docs fix
* test_acompletion_basic_request
* Revert "test_acompletion_basic_request"
This reverts commit fdaa5bc49e
2025-10-10 13:30:43 -07:00
Krish Dholakia
c8b93c3940
Merge pull request #15389 from BerriAI/litellm_usage_spend_per_day_chart_fix
...
fix: usage page >> Model Activity >> spend per day graph: y-axis clipping on large spend values
2025-10-10 13:08:26 -07:00
Krish Dholakia
a83cf6d042
Merge pull request #15416 from BerriAI/litellm_ui_remove_unused_imports
...
Enforces removal of unused imports from UI
2025-10-10 13:07:34 -07:00
Krish Dholakia
192097813a
Merge pull request #15418 from BerriAI/litellm_ui_teams_refactor_2
...
LiteLLM Dashboard Teams UI refactor
2025-10-10 13:06:54 -07:00
Krish Dholakia
419a5e8a2d
Merge pull request #15421 from BerriAI/litellm_ui_guardrails_provider_logos_updates
...
Updates guardrail provider logos
2025-10-10 13:04:34 -07:00
Achintya Rajan
824517ee37
updates guardrail provider logos
2025-10-10 11:39:14 -07:00
Sameer Kankute
513925fd12
Add OCI Cohere support with tool calling and streaming capabilities ( #15365 )
...
* Add cohere models for OCI integration
* fix mypy error
2025-10-10 11:20:18 -07:00
Achintya Rajan
6d5c76d81b
Empty commit for file merge diff
2025-10-10 10:30:28 -07:00
Achintya Rajan
c4ed4916e9
Empty commit for CI/CD
2025-10-10 10:29:37 -07:00
Achintya Rajan
b4444ead0d
rebased, removed unused imports
2025-10-10 10:25:48 -07:00
Achintya Rajan
73eafed51c
removed unused imports
2025-10-10 10:25:00 -07:00
Achintya Rajan
5fca481ebb
removing unused imports
2025-10-10 10:24:57 -07:00
Krish Dholakia
d944717d4b
Merge pull request #15278 from xprilion/wandb-inference-docs
...
Add W&B Inference documentation
2025-10-09 22:35:16 -07:00
Krish Dholakia
9c3e29b9f0
Merge pull request #15330 from jlan-nl/litellm-fix-erroneous-gpt5-cooldown-trigger
...
Minimal fix: gpt5 models should not go on cooldown when called with temperature!=1
2025-10-09 22:34:30 -07:00
Krish Dholakia
ab2f866510
Merge pull request #15363 from vkolehmainen/fix-20250918083359_drop_spec_version_column_from_mcp_table
...
Remove hardcoded "public" schema in 20250918083359_drop_spec_version_column_from_mcp_table/migration.sql
2025-10-09 22:27:02 -07:00
Krish Dholakia
611a876889
Merge pull request #15380 from BerriAI/litellm_shared_heatlh_status
...
Implement Shared Health Check State Across Pods
2025-10-09 22:25:45 -07:00
Krish Dholakia
e1e1ea31dc
Merge pull request #15379 from PostHog/feat/posthog-per-request-api-key
...
feat: posthog per request api key
2025-10-09 22:24:51 -07:00
Krish Dholakia
9c50d0f057
Merge pull request #15383 from zainhas/patch-1
...
Add new together models
2025-10-09 22:20:45 -07:00
Krish Dholakia
039c7e0f11
Merge pull request #15384 from BerriAI/litellm_ui_teams_team_role_column
...
Teams page: new column "Your Role" on the teams table
2025-10-09 22:19:51 -07:00
Krish Dholakia
667339410f
Merge pull request #15391 from uc4w6c/fix/mcp-call-tool-context
...
fix: Ensure MCP client stays open during tool call
2025-10-09 22:18:23 -07:00
Krish Dholakia
f97b0e182a
Merge branch 'main' into fix/mcp-call-tool-context
2025-10-09 22:17:34 -07:00
Alexsander Hamir
1c7463f42f
[Perf]: optimize SSL/TLS handshake performance with prioritized cipher ( #15398 )
...
* perf: optimize SSL/TLS handshake performance with prioritized cipher suites
Add configurable SSL cipher suite list that strongly prefers fast modern
ciphers (TLS 1.3, ECDHE+GCM) while maintaining backward compatibility with
widely-supported fallback ciphers. Set minimum TLS version to 1.2 for
better performance.
Changes:
- Add DEFAULT_SSL_CIPHERS constant with prioritized cipher list
(configurable via LITELLM_SSL_CIPHERS env var)
- Update get_ssl_configuration() to apply optimized ciphers by default
- Set TLS minimum version to 1.2
- Preserve existing ssl_security_level parameter for custom configs
This balances handshake performance (~50-100ms with modern ciphers) with
broad provider compatibility.
* fix: missing documented constants
2025-10-09 19:21:37 -07:00
Ishaan Jaff
52bbabd788
[Feat] Support for Vertex AI Gemma Models on Custom Endpoints ( #15397 )
...
* TestVertexGemmaiCompletion
* test vertex Gemma
* fix file name
* fix file naming
* add VertexAIGemmaModels
* add cost_router for vertexai
* fix main.py
* fix VertexGemmaConfig
* fix Vertex AI Gemma-AI Models Handler
* docs gemma
* fix ids
* test fix
* ruff check fixes
* docs fix
* docs fix
2025-10-09 19:20:02 -07:00
Alexsander Hamir
76a614bc76
fix: remove panic from hot path ( #15396 )
2025-10-09 18:43:44 -07:00
Ishaan Jaff
4827e62a21
Fix - OpenRouter cache_control to only apply to last content block ( #15395 )
...
* fix: _move_cache_control_to_content
* test_openrouter_transform_request_with_cache_control_list_content
* fix code QA check
* fix: mypy lint
* fix handlers
* fix mypy
* fix - refactor code, fixes for QA checks
2025-10-09 18:01:33 -07:00
ashengstd
2686156c37
temporarily relax ResponsesAPIResponse parsing to support custom backends ( #15362 )
...
- Replace `ResponsesAPIResponse(**raw_response_json)` with
`ResponsesAPIResponse.model_construct(**raw_response_json)`
to bypass strict Pydantic validation.
- Allows Response API to work with self-hosted or non-strict models
(e.g., vLLM) without raising literal/type errors.
- This is a temporary, low-risk relaxation to improve compatibility
with more backend implementations.
2025-10-09 17:46:10 -07:00
Achintya Rajan
accc42ca2e
added back old teams for regression protection
2025-10-09 17:44:36 -07:00
Achintya Rajan
b4bcc7143c
Update README.md
2025-10-09 17:39:29 -07:00
Krish Dholakia
eb0b263532
Merge pull request #15340 from BerriAI/litellm_db_config_accidental_override_fix
...
fix: Prevents DB from accidentally overriding config file values if they are empty in DB
2025-10-09 17:31:59 -07:00
Achintya Rajan
93868eb92b
Create README.md
2025-10-09 17:28:28 -07:00
