scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 178
litellm/tests/test_litellm/router_utils
History
Exact
Sameer Kankute 528daa8cf4 feat(router): add per-model-group deployment affinity configuration 
Enable deployment_affinity, responses_api_deployment_check, and session_affinity to be configured per model group via router_settings.model_group_affinity_config, falling back to global settings for unconfigured groups.

- Add model_group_affinity_config parameter to Router and DeploymentAffinityCheck
- Add _get_effective_flags helper to resolve flags per model group
- Update async_filter_deployments and async_pre_call_deployment_hook to use per-group config
- Add 4 comprehensive tests covering per-group config, fallback, and override scenarios

This allows fine-grained control of affinity behavior across model groups, e.g., enabling stickiness only for cross-provider deployments while leaving other groups free to load-balance.

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-03-19 14:44:01 +05:30
..
pre_call_checks feat(router): add per-model-group deployment affinity configuration 2026-03-19 14:44:01 +05:30
test_cooldown_cache.py fix(cooldown_cache.py): mask error string to avoid leaking sensitive prompt data 2025-08-11 18:37:57 -07:00
test_router_interactions_endpoints.py [Feat] New Logging Integration - Azure Sentinel Logger (#18146) 2025-12-18 02:04:49 +05:30
test_router_utils_common_utils.py Fix code qa 2026-02-26 12:43:06 +05:30