michelligabriele
558f01e848
fix(proxy): use return value from CustomLogger.async_post_call_success_hook ( #19670 )
...
* fix(proxy): use return value from CustomLogger.async_post_call_success_hook
Previously the return value was ignored for CustomLogger callbacks,
preventing users from modifying responses. Now the return value is
captured and used to replace the response (if not None), consistent
with CustomGuardrail and streaming iterator hook behavior.
Fixes issue with custom_callbacks not being able to inject data into
LLM responses.
* fix(proxy): also fix async_post_call_streaming_hook to use return value
Previously the streaming hook only used return values that started with
"data: " (SSE format). Now any non-None return value is used, consistent
with async_post_call_success_hook and streaming iterator hook behavior.
Added tests for streaming hook transformation.
---------
Co-authored-by: Gabriele Michelli <michelligabriele0@gmail.com>
2026-01-26 08:48:22 -08:00
Harshit Jain
6df0406cf6
fix: args issue & refactor into helper function to reduce bloat for both( #19441 )
2026-01-25 10:21:20 +05:30
Ishaan Jaffer
f148207b11
fix patch reliability mock tests
2026-01-24 17:37:17 -08:00
Ishaan Jaffer
73dd1bd97a
test_stream_transformation_error_sync
2026-01-24 17:19:21 -08:00
Harshit Jain
05fdd099ba
fix(presidio): resolve runtime error by handling asyncio loops in bac… ( #19714 )
...
* fix(presidio): resolve runtime error by handling asyncio loops in background threads
* add test case for thread safety
2026-01-24 15:36:49 -08:00
Ishaan Jaffer
53d3868ff2
TestBedrockInvokeToolSearch
2026-01-24 15:36:30 -08:00
yuneng-jiang
99e9462ec9
Merge pull request #19713 from BerriAI/litellm_model_search_id_team
...
[Feature] UI - Model Page: Filter by Model ID and Team ID
2026-01-24 15:04:20 -08:00
yuneng-jiang
47810f1523
Model and Team filtering
2026-01-24 14:45:14 -08:00
Ishaan Jaffer
9f99e8231c
test_retrieve_container_basic
2026-01-24 14:31:54 -08:00
Ishaan Jaffer
f2fd54ffcf
test fixes
2026-01-24 14:27:56 -08:00
Ishaan Jaffer
d8e0c43a21
test fixes
2026-01-24 14:08:48 -08:00
Ishaan Jaffer
e4e76a4963
test_team_update_sc_2
2026-01-24 13:17:32 -08:00
Ishaan Jaffer
489c986cac
test_hanging_request_azure
2026-01-24 13:14:48 -08:00
Ishaan Jaffer
a62ccd582d
fix flaky tests
2026-01-24 13:04:20 -08:00
Ishaan Jaffer
31a4cb65bf
test_get_default_unvicorn_init_args
2026-01-24 12:59:51 -08:00
Ishaan Jaffer
a7e26460d0
fix unstable tests
2026-01-24 11:15:16 -08:00
Ishaan Jaffer
bd38374a45
fix: FLAKY tests
2026-01-24 11:13:44 -08:00
Ishaan Jaffer
6710abd1fa
test_web_search
2026-01-24 11:06:23 -08:00
Ishaan Jaffer
6587cd228b
test_partner_models_httpx_streaming
2026-01-24 10:58:35 -08:00
yuneng-jiang
5e395db1dc
Merge pull request #19604 from BerriAI/litellm_team_update_org
...
[Fix] Team Update with Organization having All Proxy Models
2026-01-24 09:09:55 -08:00
yuneng-jiang
f88a32de05
Merge pull request #19622 from BerriAI/litellm_ui_model_backend
...
[Feature] UI - Models Page: Model Search
2026-01-24 09:09:03 -08:00
yuneng-jiang
b44ac6c682
Fixing ruff check
2026-01-24 09:08:29 -08:00
yuneng-jiang
63166c3acc
fixing arize tests
2026-01-23 23:13:21 -08:00
yuneng-jiang
e1bb4ae280
deactivating non root tests
2026-01-23 22:55:36 -08:00
yuneng-jiang
86676142c9
Fixing failing tests
2026-01-23 22:33:00 -08:00
Ishaan Jaff
a870722f65
[Feat] UI + Backend - Allow adding policies on Keys/Teams + Viewing on Info panels ( #19688 )
...
* ui for policy mgmt
* test_add_guardrails_from_policy_engine_accepts_dynamic_policies_and_pops_from_data
2026-01-23 19:03:44 -08:00
ryan-crabbe
d67d12fc54
perf: Add LRU caching to get_model_info for faster cost lookups ( #19606 )
...
- Add @lru_cache decorator to get_model_info() and _cached_get_model_info_helper()
- Update _invalidate_model_cost_lowercase_map() to clear these caches when model_cost changes
- Update test to call cache invalidation after modifying litellm.model_cost
Reduces get_model_cost_information from 46% to <1% of request handling time.
2026-01-23 17:26:45 -08:00
mubashir1osmani
c41963c949
fix: add openinference span kinds to arize phoenix
...
fix: add openinference span kinds to arize phoenix
2026-01-23 16:32:49 -05:00
yuneng-jiang
fbe5ae9e17
fixing flaky tests
2026-01-23 12:20:27 -08:00
yuneng-jiang
8b5b343841
attempt fix flaky tests
2026-01-23 12:10:08 -08:00
yuneng-jiang
647a6898a9
skipping non root tests entirely
2026-01-23 11:51:38 -08:00
yuneng-jiang
89bf7e50c4
skipping flaky tests
2026-01-23 11:43:39 -08:00
xqe2011
ca8c2c3938
fix #19620 : SSO user roles are not updated for existing users ( #19621 )
...
* Fix: SSO user roles are not updated for existing users
Fixes #19620
* Refactor: Remove redundant user_info retrieval in SSOAuthenticationHandler
* Test: add new tests for user creation and updates in get_user_info_from_db
2026-01-23 09:05:29 -08:00
Sameer Kankute
9894721285
Merge pull request #19548 from BerriAI/litellm_staging_01_22_2026
...
Litellm staging 01 22 2026
2026-01-23 20:03:11 +05:30
Sameer Kankute
23f7d4f0b0
Merge pull request #19645 from BerriAI/litellm_gigachat_big_fix
...
Add tool choice mapping for giga chat
2026-01-23 19:52:35 +05:30
Sameer Kankute
a240eb7630
Merge pull request #19649 from BerriAI/litellm_fix_responses_api_logging_eror
...
Fix: Responses API logging error for StopIteration
2026-01-23 19:51:45 +05:30
Sameer Kankute
a4bf14f6e7
Fix: test_nova_invoke_streaming_chunk_parsing
2026-01-23 19:49:42 +05:30
Sameer Kankute
8357d05615
Fix: Responses API logging error for StopIteration
2026-01-23 18:42:33 +05:30
YutaSaito
8ac1d96d90
Merge pull request #19634 from BerriAI/litellm_feat_hashicorp_rotate
...
[feat] hashicorp vault rotate support
2026-01-23 21:08:55 +09:00
Sameer Kankute
acf5ad1155
Add tool choice mapping for giga chat
2026-01-23 16:29:19 +05:30
Sameer Kankute
12463809bd
Merge pull request #19638 from BerriAI/main
...
merge main in stagin 1 22 26
2026-01-23 14:54:17 +05:30
Yuta Saito
695fbf4ec5
feat: hashicorp vault rotate support
2026-01-23 17:32:55 +09:00
Yuta Saito
919033a6d0
fix: include tool arguments in proxy_server_request for spend logs callbacks
2026-01-23 16:36:37 +09:00
YutaSaito
4381e7f98f
Merge pull request #19624 from BerriAI/litellm_test_responses_api_with_mcp_tools
...
[test] Skip anthropic model test when ANTHROPIC_API_KEY is not set
2026-01-23 15:58:19 +09:00
YutaSaito
12bc66aa5b
Merge pull request #19623 from BerriAI/litellm_fix_completions_mcp_output_ordering
...
[fix] completions mcp output ordering
2026-01-23 15:56:02 +09:00
Yuta Saito
1ae9189ff8
test: Skip anthropic model test when ANTHROPIC_API_KEY is not set
2026-01-23 15:50:56 +09:00
Yuta Saito
6a60b3d848
test: completions mcp output test
2026-01-23 15:17:14 +09:00
yuneng-jiang
3ee7aab5f2
All Models Backend Search
2026-01-22 22:00:22 -08:00
John Greek
26a2c90818
[Fix] Anthropic models on Azure AI cache pricing ( #19532 ) ( #19614 )
2026-01-22 20:00:40 -08:00
Harshit Jain
69c8698e62
fix: pass through endpoints update registry ( #19420 )
...
* fix: pass through endpoints update registry
* add test case, fix lint error and comment to avoid confusion
* fix pass through endpoints test case
2026-01-22 19:57:48 -08:00
