Alexsander Hamir
ed32591a05
docs(prometheus): add comment warning about check_db_only latency impact
2026-02-06 09:31:07 -08:00
Alexsander Hamir
5735a2c2a2
fix(prometheus): use return_exceptions=True for budget metric lookups
...
Make asyncio.gather resilient to partial failures. If key, team, or
user lookup raises, log at debug level and allow the others to
complete. Prevents one failing lookup from blocking the rest.
2026-02-06 09:30:58 -08:00
Alexsander Hamir
bbe5465bc3
perf(prometheus): parallelize budget metric lookups with asyncio.gather
...
Replace sequential await of key, team, and user budget metric lookups
with asyncio.gather() so they run in parallel. Reduces latency from
T_key + T_team + T_user to max(T_key, T_team, T_user) when lookups
hit DB or cache.
2026-02-06 09:30:50 -08:00
Alexsander Hamir
4b6b1da517
fix(otel): fix thread leak in OpenTelemetry dynamic header path
...
Implemented TracerProvider caching in OpenTelemetry class to prevent linear thread growth when using dynamic headers (e.g., per-team Langfuse keys). Added formal unit test in tests/test_otel_thread_leak.py.
2026-01-28 16:15:56 -08:00
Alexsander Hamir
790a5ce0b3
Fix in-flight request termination on SIGTERM when health-check runs in a separate process ( #19427 )
2026-01-24 09:39:23 -08:00
Alexsander Hamir
9e893b7cda
Fix: Handle PostgreSQL cached plan errors during rolling deployments ( #19424 )
2026-01-24 09:34:35 -08:00
Ishaan Jaff
8c29ad4191
[Fix] VertexAI Pass through - Ensure only anthropic betas are forwarded down to LLM API ( #19542 )
...
* fix ALLOWED_VERTEX_AI_PASSTHROUGH_HEADERS
* test_vertex_passthrough_forwards_anthropic_beta_header
* fix test_vertex_passthrough_forwards_anthropic_beta_header
* test_vertex_passthrough_does_not_forward_litellm_auth_token
* fix utils
* Using Anthropic Beta Features on Vertex AI
* test_forward_headers_from_request_x_pass_prefix
2026-01-21 19:12:43 -08:00
Ishaan Jaff
ad1db9fc8b
[Fix] LiteLLM VertexAI Pass through - ensuring incoming headers are forwarded down to target ( #19524 )
...
* test_vertex_passthrough_forwards_anthropic_beta_header
* add_incoming_headers
2026-01-21 12:06:32 -08:00
Ishaan Jaffer
534fa9f4c0
docs fix
2026-01-17 17:26:58 -08:00
Ishaan Jaffer
26497b415b
docs fix
2026-01-17 17:21:31 -08:00
Ishaan Jaffer
c6998823c0
docs fix
2026-01-17 17:17:34 -08:00
Ishaan Jaffer
c158f83cff
docs fix
2026-01-17 17:17:13 -08:00
Ishaan Jaffer
4610d1d43c
docs fix
2026-01-17 17:16:22 -08:00
Ishaan Jaffer
7d24bbed42
qa fixes
2026-01-17 17:14:51 -08:00
Ishaan Jaffer
e15526a60e
fix
2026-01-17 17:13:22 -08:00
Ishaan Jaffer
60dd04ac95
test_aiohttp_openai
2026-01-17 17:05:00 -08:00
Ishaan Jaffer
c30b17aa9b
docs fix
2026-01-17 17:03:48 -08:00
Ishaan Jaffer
0a84120be5
v1.81.0
2026-01-17 16:43:00 -08:00
Ishaan Jaffer
db7de13818
test_deepseek_mock_completion
2026-01-17 16:36:42 -08:00
Ishaan Jaffer
5812654bdd
test_router_fallbacks_with_custom_model_costs
2026-01-17 16:34:46 -08:00
Ishaan Jaff
1417b002a3
[Feat] Claude Code x LiteLLM WebSearch - QA Fixes to work with Claude Code ( #19294 )
...
* fix websearch_interception_converted_stream
* test_websearch_interception_no_tool_call_streaming
* FakeAnthropicMessagesStreamIterator
* LITELLM_WEB_SEARCH_TOOL_NAME
* fixes tools def for litellm web search
* fixes FakeAnthropicMessagesStreamIterator
* test_litellm_standard_websearch_tool
* use new hook for modfying before any transfroms from litellm
* init WebSearchInterceptionLogger + ARCHITECTURE
* fix config.yaml
* init doc for claude code web search
* docs fix
* doc fix
* fix mypy linting
2026-01-17 16:30:31 -08:00
yuneng-jiang
42c0136bf4
Merge pull request #19293 from BerriAI/litellm_ui_build_fix_22
...
[Infra] Fix UI Build
2026-01-17 15:58:24 -08:00
yuneng-jiang
91eb047761
testing adding entire out
2026-01-17 15:49:20 -08:00
yuneng-jiang
c1f194cde9
fix build attempt
2026-01-17 15:36:53 -08:00
YutaSaito
d28bf983eb
Merge pull request #19272 from Harshit28j/feature/panw-custom-violation-msg
...
feat(panw_prisma_airs): add custom violation message support
2026-01-18 06:55:39 +09:00
yuneng-jiang
953e2736d4
Merge pull request #19291 from BerriAI/deleted_keys_docs_2
...
[Docs] Deleted Keys and Teams Docs
2026-01-17 13:20:48 -08:00
yuneng-jiang
19a69a89f0
deleted keys and teams docs
2026-01-17 13:19:48 -08:00
Ishaan Jaffer
e238cb2ca0
docs clean up
2026-01-17 12:30:26 -08:00
Ishaan Jaffer
58570e5b13
fix doc
2026-01-17 12:28:04 -08:00
Ishaan Jaffer
1115e6b8c7
docs fix
2026-01-17 12:20:09 -08:00
Ishaan Jaffer
eb26ebc926
docs ui usage
2026-01-17 12:15:37 -08:00
yuneng-jiang
052aa4f7ed
Merge pull request #19287 from BerriAI/ui_build_jan17_1
...
[Infra] Fixing UI Build
2026-01-17 12:09:41 -08:00
yuneng-jiang
715fa8fa5f
fixing ui build
2026-01-17 12:08:20 -08:00
yuneng-jiang
ff73d8f640
Merge pull request #19286 from BerriAI/8015_docs_1
...
[Docs] Updating Docs for v1.80.15-stable.1
2026-01-17 11:55:10 -08:00
yuneng-jiang
b964e2a1a0
updating docker pull cmd
2026-01-17 11:54:04 -08:00
yuneng-jiang
32626954c3
Merge pull request #19283 from BerriAI/ui_build_jan17
...
[Infra] Re-Building UI
2026-01-17 11:13:29 -08:00
yuneng-jiang
d160ac0319
rebuilding ui
2026-01-17 11:11:25 -08:00
yuneng-jiang
3619fdce31
Merge pull request #19282 from BerriAI/yj_ui_test_branch
...
[Fix] UI - Deleted Teams Endpoint Fix
2026-01-17 11:07:31 -08:00
yuneng-jiang
374662c60f
deleted teams endpoint fix
2026-01-17 11:00:32 -08:00
Ishaan Jaffer
e9e323bf32
png fixes
2026-01-17 10:28:41 -08:00
Ishaan Jaffer
f0569bc102
docs fix
2026-01-17 09:40:08 -08:00
yuneng-jiang
0d3a9b1c87
Merge pull request #19279 from BerriAI/ui_build_branch
...
[Infra] Building UI
2026-01-17 09:20:28 -08:00
yuneng-jiang
581ba2def3
building ui
2026-01-17 09:19:05 -08:00
yuneng-jiang
23a06a04a3
Merge pull request #19278 from BerriAI/litellm_ui_update_new_badges
...
[Refactor] UI - Adjusting New Badges
2026-01-17 09:17:15 -08:00
yuneng-jiang
1301896e03
Adjusting new badges
2026-01-17 09:08:41 -08:00
Harshit Jain
0683f29671
feat(panw_prisma_airs): add custom violation message support
2026-01-17 17:52:25 +05:30
yuneng-jiang
362081c2b9
Merge pull request #19258 from BerriAI/litellm_ui_model_hub_health_1
...
[Feature] UI - Public Model Hub: Health Checks
2026-01-16 22:28:45 -08:00
yuneng-jiang
480d9356af
Merge pull request #19268 from BerriAI/litellm_ui_deleted_keys_teams_table
...
[Feature] UI - Logs: Deleted Keys and Teams Table
2026-01-16 22:28:24 -08:00
yuneng-jiang
d48e41bd94
fixing tests
2026-01-16 22:20:10 -08:00
yuneng-jiang
883f83a9cb
Adding tests
2026-01-16 22:14:24 -08:00
