mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-17 09:34:48 +00:00
* fix(bedrock): split the OpenAI breakpoint and Bedrock cachePoint model flags supports_prompt_cache_breakpoint meant both "uses the OpenAI prompt_cache_breakpoint format" and "Bedrock Converse takes cachePoint blocks", so an OpenAI-format opt-out on a Bedrock Claude deployment silently turned off its prompt caching. Bedrock now reads only supports_bedrock_converse_cache_point, then supports_prompt_caching as before. The OpenAI path reads supports_openai_prompt_cache_breakpoint and keeps the old key as a deprecated alias. The Kimi K3 catalog rows move to the new Bedrock key, and a Bedrock deployment still on the old key logs a one-time migration warning. Fixes #52140 * fix(bedrock): expose the split prompt cache flags in get_model_info and word the migration warning for unlisted models * test(bedrock): mark the system prompt directly in the routed cache point regression * fix(bedrock): warn about the old breakpoint flag even when a catalog cache point flag decides * fix(cost-map): keep the old Kimi K3 breakpoint flag for clients that read the remote catalog * test(bedrock): keep the old breakpoint flag on catalog cache point opt-outs for older clients --------- Co-authored-by: Joshua Valluru <326636767+joshua-berri@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| litellm_completion_transformation | ||
| mcp | ||
| __init__.py | ||
| test_additional_tools.py | ||
| test_custom_tool_call.py | ||
| test_metadata_codex_callback.py | ||
| test_no_duplicate_spend_logs.py | ||
| test_null_test_fix.py | ||
| test_responses_api_bridge_flag.py | ||
| test_responses_api_lifecycle.py | ||
| test_responses_api_request_body.py | ||
| test_responses_prompt_management.py | ||
| test_responses_router_cooldown.py | ||
| test_responses_streaming_iterator.py | ||
| test_responses_supported_endpoints_passthrough.py | ||
| test_responses_utils.py | ||
| test_responses_websocket_all_providers.py | ||
| test_rust_bridge_websocket.py | ||
| test_sse_output_recovery.py | ||
| test_streaming_iterator.py | ||
| test_streaming_iterator_error_events.py | ||
| test_text_format_conversion.py | ||