Alexsander Hamir
30534d7e82
perf(prometheus): parallelize budget metric lookups with asyncio.gather
...
Replace sequential await of key, team, and user budget metric lookups
with asyncio.gather() so they run in parallel. Reduces latency from
T_key + T_team + T_user to max(T_key, T_team, T_user) when lookups
hit DB or cache.
2026-02-05 15:33:44 -08:00
Alexsander Hamir
7cb549acf5
nineth round of measurements
2026-02-05 15:09:11 -08:00
Alexsander Hamir
9e1e0ad8d2
eighth round of measurements
2026-02-05 14:05:55 -08:00
Alexsander Hamir
f4094cefc9
Seventh round of measurements
2026-02-05 12:30:37 -08:00
Alexsander Hamir
2c5d3d98f9
Sixth round of measurements
2026-02-05 12:23:27 -08:00
Alexsander Hamir
19b0ebdea5
Fifth round of measurements
2026-02-05 12:04:23 -08:00
Alexsander Hamir
6fdf6e9f0b
Add random id generation to user_id
2026-02-05 11:52:13 -08:00
Alexsander Hamir
cfb13098e7
Fourth round of measurements
2026-02-05 11:40:39 -08:00
Alexsander Hamir
9cfe517d4f
Third round of measurements
2026-02-05 10:42:19 -08:00
Alexsander Hamir
75061dc985
Second round of measurements
2026-02-05 09:49:48 -08:00
Alexsander Hamir
956bf16460
LiteLLM configuration file
2026-02-04 17:53:59 -08:00
Alexsander Hamir
8fff99b9d8
Latency repro stats
2026-02-04 17:53:11 -08:00
Alexsander Hamir
12fff07f42
Latency repro file
2026-02-04 17:52:34 -08:00
yuneng-jiang
d2e113111f
Merge pull request #20436 from BerriAI/litellm_search_tools_config_ui
...
[Feature] UI - Search Tools: Show Config Defined Search Tools
2026-02-04 13:56:19 -08:00
yuneng-jiang
cd9466a50c
Adding tests
2026-02-04 12:35:58 -08:00
yuneng-jiang
609c423314
migrate to antd table
2026-02-04 12:22:57 -08:00
yuneng-jiang
208cf5e86d
refactor - rename search tools files
2026-02-04 11:53:03 -08:00
yuneng-jiang
a16faa9e0a
Merge pull request #20394 from BerriAI/litellm_spend_fix_2
...
[Fix] Unique Constraint on Daily Tables + Logging When Updates Fail
2026-02-04 09:42:46 -08:00
Sameer Kankute
8b563a7641
Merge pull request #20402 from BerriAI/litellm_responses_tools_file_ids
...
Add mapping for responses tools in file ids
2026-02-04 18:09:39 +05:30
Sameer Kankute
8a3b253e62
Merge pull request #20390 from BerriAI/litellm_fix_empty_message
...
Fix: empty assistant message for converse API
2026-02-04 18:05:37 +05:30
Sameer Kankute
18a524a1dc
Merge pull request #20408 from BerriAI/litellm_fix_model+map_streaming
...
Fix supports_native_streaming for gemini and vertex ai and claude models
2026-02-04 17:56:48 +05:30
Sameer Kankute
a86e501632
Merge pull request #20407 from BerriAI/litellm_key_mcp_permissions
...
Add Key info endpoint object permission data
2026-02-04 17:56:05 +05:30
Sameer Kankute
1a5f2a566f
Fix: test_bedrock_no_default_message
2026-02-04 17:52:28 +05:30
Sameer Kankute
b2feedc469
Merge pull request #20318 from BerriAI/litellm_oss_staging_02_03_2026
...
feat(guardrails): implement team-based isolation guardrails mgmnt (#1…
2026-02-04 17:49:30 +05:30
Sameer Kankute
54b5c7d2cd
Fix: litellm/tests/test_litellm/proxy/guardrails/guardrail_hooks/test_grayswan.py
2026-02-04 17:35:26 +05:30
Sameer Kankute
f8b6af5577
Fix test_transform_messages_disable_copilot_system_to_assistant
2026-02-04 17:29:55 +05:30
Sameer Kankute
674593e4d7
Merge pull request #20413 from BerriAI/revert-20145-fix/proxy_failure_cases
...
Revert "fix: proxy failure cases, now log ip and user agent, key hash, name"
2026-02-04 17:17:39 +05:30
Sameer Kankute
6b25e37309
Revert "fix: proxy failure cases, now log ip and user agent, key hash, name (…"
...
This reverts commit ec279eb426
2026-02-04 17:16:51 +05:30
Sameer Kankute
5cec5c3bef
fix model map json
2026-02-04 14:48:49 +05:30
Sameer Kankute
0ed5e51f9b
Fix supports_native_streaming for anthropic models
2026-02-04 14:44:31 +05:30
Sameer Kankute
20c21c63d9
Fix supports_native_streaming for gemini and vertex ai models
2026-02-04 14:41:32 +05:30
Sameer Kankute
fc873d8867
Fix mypy issues
2026-02-04 14:40:08 +05:30
Sameer Kankute
42561729ee
Add Key info endpoint object permission data
2026-02-04 14:21:19 +05:30
Sameer Kankute
bfc0c4b4ab
Merge pull request #20396 from BerriAI/litellm_copilot_kit_sdk
...
[DOCS]Add copilotkit sdk doc as supported agents sdk
2026-02-04 13:41:08 +05:30
Sameer Kankute
4d90767d82
Merge pull request #20406 from BerriAI/litellm_deepreasearch_agent_gemini
...
Add gemini deep research in model cost map
2026-02-04 13:39:55 +05:30
Sameer Kankute
216cf4cac5
Add gemini deep research in model cost map
2026-02-04 13:38:13 +05:30
Sameer Kankute
e4c1cfff9d
Fix mypy issues
2026-02-04 13:25:21 +05:30
Sameer Kankute
2698c9218c
Fix mypy issues
2026-02-04 13:24:00 +05:30
Sameer Kankute
5413f584f5
Fix code quality issues
2026-02-04 13:17:05 +05:30
Sameer Kankute
8b3213ce5c
Add mapping for responses tools in file ids
2026-02-04 13:12:45 +05:30
Sameer Kankute
cdd4569064
Apply suggestion from @greptile-apps[bot]
...
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-04 11:56:17 +05:30
Sameer Kankute
465bbf3514
Add copilotkit sdk doc as supported agents sdk
2026-02-04 11:53:49 +05:30
Sameer Kankute
8109413a54
Add copilotkit sdk doc as supported agents sdk
2026-02-04 11:52:17 +05:30
Krish Dholakia
58cc6248ab
Skip test_e2e_semantic_filter when OPENAI_API_KEY is not set ( #20387 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-02-03 22:09:47 -08:00
Krish Dholakia
ca34b4ee13
Revert "feat(guardrails): implement team-based isolation guardrails mgmnt (#1…" ( #20393 )
...
This reverts commit 76a399ba69
2026-02-03 20:55:46 -08:00
yuneng-jiang
9ce55057ab
Adding logging for when batching fails
2026-02-03 20:54:40 -08:00
Krrish Dholakia
49c678589e
fix: fix schema.prisma on litellm proxy extras
2026-02-03 20:36:10 -08:00
yuneng-jiang
30027d2928
save empty endpoint as string
2026-02-03 20:26:57 -08:00
Sameer Kankute
15351a93dc
Fix: empty assistant message for converse API
2026-02-04 09:50:58 +05:30
Ishaan Jaffer
7b8e3c7736
docs fix
2026-02-03 20:11:48 -08:00
