Sameer Kankute
521f804350
Fix encrypted content streaming affinity issue
2026-03-03 18:37:22 +05:30
Sameer Kankute
2bc4da76ce
Update the tests
2026-03-03 18:36:07 +05:30
Sameer Kankute
18bf3f2df6
Fix mock github test
2026-03-03 18:36:07 +05:30
Sameer Kankute
a88a17796b
Fix logging and encrypted content extraction
2026-03-03 18:36:07 +05:30
Sameer Kankute
9f627c67d8
Add tests for encrypted_content_affinity
2026-03-03 18:36:07 +05:30
Sameer Kankute
394c49d303
Add tests for encrypted_content_affinity
2026-03-03 18:36:07 +05:30
Sameer Kankute
7cda0e4edd
Fix code qa
2026-02-26 12:43:06 +05:30
Harshit Jain
456d8f5524
feat: add session_id to have better routing
2026-02-21 18:45:50 +05:30
Emerson Gomes
3dd55a7b61
Merge main into affinity_callback and address deployment affinity review feedback
2026-02-18 10:01:11 -06:00
Emerson Gomes
f7726c8950
Fix wrong keys being used for model sticky entry
2026-01-15 17:42:29 -06:00
Emerson Gomes
059e75ad88
fix(router): scope deployment affinity by model_map_key
...
- Key affinity by (user_api_key_hash, model_map_key) -> model_id
- Ignore OpenAI 'user' param for affinity
- Avoid double hashing user_api_key_hash
- Add unit tests + docs clarifications
2026-01-15 16:28:36 -06:00
Emerson Gomes
e23bd21a28
Add deployment affinity routing
2026-01-15 08:53:31 -06:00
Ishaan Jaff
539f629eff
[Feat] New Logging Integration - Azure Sentinel Logger ( #18146 )
...
* add AzureSentinelLogger
* logging: AzureSentinelLogger
* test_azure_sentinel_signature_and_send_batch
* docs azure sentinel
* fix AzureSentinelLogger
* test fix
* docs fix
* fix: AzureSentinelLogger
* docs sentintel
* feat: add example SLP
* docs sentinel
* docs fix
* docs fix
* docs fix
* fix code qa
* QA fix
* fix test
* TestInitializeInteractionsEndpoints
2025-12-18 02:04:49 +05:30
Cesar Garcia
7c2e2111c0
fix(router): handle tools=None in filter_web_search_deployments ( #17684 )
...
Fixes #17672
Changed `request_kwargs.get("tools", [])` to `request_kwargs.get("tools") or []`
to handle the case where tools is explicitly set to None.
2025-12-08 18:36:46 -08:00
Raghav Jhavar
72eb4c3a1c
🆕 feat: support routing to only websearch supported deployments ( #17500 )
...
* support routing to only websearch supported deployments
* add docs
2025-12-04 14:18:20 -08:00
Sameer Kankute
f804ab6de5
Add LLM provider response headers to Responses API ( #16091 )
...
* Add llm headers to responses api
* fix mock test
2025-11-01 13:25:56 -07:00
Ishaan Jaff
d89a2a0797
test
2025-09-06 16:38:43 -07:00
Ishaan Jaff
c168fff38a
test_cooldown_badrequest_error
2025-09-06 16:28:00 -07:00
Ishaan Jaff
7054067238
test_cooldown_handlers.py
2025-09-06 16:13:30 -07:00
Krish Dholakia
3b52545db3
Merge pull request #13529 from BerriAI/litellm_dev_08_11_2025_p1
...
[Fix] Cooldowns - don't return raw Azure Exceptions to client
2025-08-18 18:54:19 -07:00
Ishaan Jaff
76f1064229
[Bug Fix] litellm incompatible with newest release of openAI v1.100.0 ( #13728 )
...
* fix imports OpenAI SDK
* ResponseText fixes
* fixes ResponseText
* fix imports
* catch AttributeError
* fix import
* use openai==1.100.1
* fix build from PIP
* fix lint test
* Print OpenAI version
* fix Install dependencies
2025-08-18 18:26:17 -07:00
Krrish Dholakia
bc9d0484e4
fix(cooldown_cache.py): mask error string to avoid leaking sensitive prompt data
...
Fixes https://github.com/BerriAI/litellm/issues/13329
2025-08-11 18:37:57 -07:00
Ishaan Jaff
39955129f5
fix mapped tests ( #12320 )
...
* fix - use flush llm client cache
* faster mapped tests
* test_async_multiple_response_ids_routing
* fix tests
* test_ateam_member_update_admin_requires_premium
* regular mapped tests
* Revert "Fix: Initialize JSON logging for all loggers when JSON_LOGS=True (#12206 )"
This reverts commit 2c60c316ec
2025-07-04 10:04:43 -07:00
Krish Dholakia
1a7fd1d1c7
Litellm dev 06 25 2025 p2 ( #12049 )
...
* test(test_router.py): initial unit test confirming router.afile_content uses dynamic api key / api base
* fix(managed_files.py): filter deployments for only those within file id mapping
ensure call works - only route to models where the file was written
* fix(proxy_server.py): fix loading in model ids from config, if config id is int
* fix(router.py): return all model file id mappings on create_file
if multiple deployments - this ensures all the file id mappings are bubbled up
Fixes issue when trying to use loadbalanced deployments - only 1 file id mapping was being stored
* feat(router_utils/common_utils.py): filter models by team id when selecting for routing
Prevents team only models from being used by other teams
* fix(common_utils.py): additional fixes around filtering team-based models
* fix(batches_endpoints/endpoints): support list batches with target model names specified
* fix(common_utils.py): more testing for team deployment filters
2025-06-25 21:54:13 -07:00
Krish Dholakia
ef42461c1e
Litellm fix GitHub action testing ( #11163 )
...
* test: add __init__.py files
* refactor: rename test folder to avoid naming conflict
* test: update workflows
* test: update tests
* test: update imports
* test: update tests
* test: remove unused import
* ci(test-litellm.yml): add pytest retry to github workflow
* test: fix test
2025-05-26 14:41:42 -07:00
