litellm/litellm/router_utils
nuernber 55a89f279f
feat: add support for anthropic_messages call type in prompt caching (#19233)
* feat: add support for anthropic_messages call type in prompt caching

* test: move anthropic_messages prompt caching test to main router test file

* add tutorial on using claude code with prompt cache routing
2026-02-07 22:51:06 -08:00
..
pre_call_checks feat: add support for anthropic_messages call type in prompt caching (#19233) 2026-02-07 22:51:06 -08:00
router_callbacks (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
add_retry_fallback_headers.py Codestral - return litellm latency overhead on /v1/completions + Add '__contains__' support for ChatCompletionDeltaToolCall (#10879) 2025-05-27 16:13:44 -07:00
batch_utils.py parse_jsonl_with_embedded_newlines 2025-11-06 16:05:12 -08:00
client_initalization_utils.py fix: fix linting errors 2025-03-11 18:49:55 -07:00
clientside_credential_handler.py fix(route_llm_request.py): move to using common router, even for clie… (#8966) 2025-03-03 22:57:08 -08:00
common_utils.py Revert "fix: models loadbalancing billing issue by filter (#18891) (#19220)" 2026-02-03 15:00:57 +05:30
cooldown_cache.py fix: cache cooldown key (#16954) 2025-11-21 19:11:17 -08:00
cooldown_callbacks.py Prometheus - make OSS (#16689) 2025-11-15 11:06:34 -08:00
cooldown_handlers.py fix(router): add minimum request threshold for error rate cooldown (#17464) 2025-12-12 04:36:10 -08:00
fallback_event_handlers.py Revert "fix: prevent error when max_fallbacks exceeds available models (#20071)" 2026-02-03 15:15:30 +05:30
get_retry_from_policy.py inspect BadRequestError after all other policy types (#19878) 2026-01-27 18:15:04 -08:00
handle_error.py fix(handle_error.py): add unit tests 2025-08-11 18:25:30 -07:00
pattern_match_deployments.py refactor: Add lazy loading for get_llm_provider (#18591) 2026-01-02 13:18:57 -08:00
prompt_caching_cache.py Fix extract_cacheable_prefix to handle string content with message-level cache_control (fixes #19228) 2026-01-17 10:35:40 +05:30
response_headers.py LiteLLM Minor Fixes & Improvements (11/26/2024) (#6913) 2024-11-28 00:01:38 +05:30
search_api_router.py [Feat] - Search API add /list endpoint to list what search tools exist in router (#19969) 2026-01-28 17:58:17 -08:00