devin-ai-integration[bot] 3242bdfed2 fix(responses): honor request cache controls on chat completions bridged to the Responses API (#44676) ... * fix(responses): honor request cache controls on chat completions bridged to the Responses API Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(responses): assert spend and cache-hit status on bridged no-cache rows Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): unskip LIT-9196 openai_responses basic translation cases Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(responses): restore azure attribution check on bridged no-cache rows Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(responses): exercise bridged cache controls through a real local cache instead of patched responses Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: kerry <kerry@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-10-05 17:52:44 -07:00
..
_v2	feat(cache): select Rust caching through explicit cache objects (#43601)	2026-09-29 00:01:44 +00:00
a2a_protocol	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
anthropic_interface	fix(proxy): send a real error event when a /v1/messages stream fails (#41826)	2026-09-25 15:36:35 -07:00
assistants	refactor(types): replace Any with proven types in 5 files (#43304)	2026-09-27 01:28:02 -07:00
batch_completion
batches	feat(anthropic): workload identity federation and pluggable identity sources (#44448)	2026-10-03 17:08:30 -07:00
caching	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
chat_completions	refactor(rust): remove delivery routing abstraction (#43514)	2026-09-28 03:31:22 +00:00
completion_extras	fix(responses): honor request cache controls on chat completions bridged to the Responses API (#44676)	2026-10-05 17:52:44 -07:00
compression
containers	test: finish the non-proxy half of tests/test_litellm (#43281)	2026-09-25 22:43:41 -07:00
decisions	refactor: clean up fresh tech debt from 2026-10-03 (#44484)	2026-10-04 01:31:23 -07:00
embeddings	feat(embeddings): add native dispatch foundation (#42799)	2026-09-23 21:11:09 +00:00
endpoints/speech/speech_to_completion_bridge
evals
experimental_mcp_client	fix(mcp): preserve upstream tool schemas and parameter headers (#44425)	2026-10-03 15:00:43 -07:00
files	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
fine_tuning
google_genai	fix(google_genai): preserve proxy_server_request in completion adapter (#43536)	2026-09-28 21:29:55 -07:00
harness	chore(harness): drop the unused Any import left in harness options (#44625)	2026-10-05 12:01:59 -07:00
images	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
integrations	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
interactions	feat(interactions): durable cross-pod settlement for background interaction billing (#41955)	2026-10-02 21:08:38 -07:00
litellm_core_utils	feat(proxy): limit which models an end user can call (#43904)	2026-10-05 21:58:03 +00:00
llms	feat: add Reka as an OpenAI-compatible provider (#44278)	2026-10-05 17:47:23 -07:00
messages	refactor(rust): remove delivery routing abstraction (#43514)	2026-09-28 03:31:22 +00:00
models	feat(proxy): limit which models an end user can call (#43904)	2026-10-05 21:58:03 +00:00
ocr	refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081)	2026-09-24 18:18:50 -07:00
passthrough	fix(responses): fall back on pre-output stream drops, fail truncated streams, honor request_timeout (#43133)	2026-09-25 14:32:41 -07:00
proxy	fix(lens): reconstruct native coding agent conversations (#44711)	2026-10-05 17:51:05 -07:00
proxy_auth
rag	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
realtime_api	refactor(types): replace Any with proven types in 13 files (#42937)	2026-09-24 09:02:02 -07:00
repositories	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
rerank_api	feat(lint): add LIT013 flagging *-ok suppressions that suppress nothing and remove the 240 stale ones (#42793)	2026-09-23 17:50:09 -07:00
responses	fix(responses): report truncated bridged output as incomplete and echo request params (#44460)	2026-10-05 11:27:12 -07:00
router_strategy	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
router_utils	fix(router): retry a /v1/messages stream the provider drops before the first content chunk (#44276)	2026-10-05 22:53:39 +00:00
rust_bridge	fix(lens): reconstruct native coding agent conversations (#44711)	2026-10-05 17:51:05 -07:00
sandbox	feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885)	2026-10-01 22:27:49 +00:00
search
secret_managers	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
skills
tracing	fix(lens): reconstruct native coding agent conversations (#44711)	2026-10-05 17:51:05 -07:00
types	feat: add Reka as an OpenAI-compatible provider (#44278)	2026-10-05 17:47:23 -07:00
vector_store_files
vector_stores	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
videos
__init__.py	feat(sdk): add run_tool_loop and arun_tool_loop helpers (#44381)	2026-10-03 20:10:30 -07:00
_internal_context.py	fix(otel): nest cache spans under their operation and name service spans by purpose (#44150)	2026-10-03 09:20:27 -07:00
_lazy_imports.py	perf(proxy): stop prompt-cache eligibility from tokenizing the whole conversation (#44221)	2026-10-03 09:20:28 -07:00
_lazy_imports_registry.py	feat(scaleway): add rerank support (#44160)	2026-10-02 21:20:05 -07:00
_logging.py	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
_redis.py	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
_redis_credential_provider.py
_service_logger.py	fix(otel): nest cache spans under their operation and name service spans by purpose (#44150)	2026-10-03 09:20:27 -07:00
_uuid.py
_version.py
anthropic_beta_headers_config.json	fix(providers): keep thinking display updates beta (#43969)	2026-10-01 17:42:02 -07:00
anthropic_beta_headers_manager.py	fix: drop a blank anthropic-beta header before it reaches the provider	2026-09-19 20:13:59 -07:00
blog_posts.json
budget_manager.py
constants.py	feat: add Reka as an OpenAI-compatible provider (#44278)	2026-10-05 17:47:23 -07:00
cost.json
cost_calculator.py	fix(cost): bill per-second transcription models outside chat modes (#44458)	2026-10-05 13:36:29 -07:00
exceptions.py	fix(spend): return 400 from /spend/calculate for a model with no pricing row (#42497)	2026-09-22 15:44:00 -07:00
main.py	fix(responses): honor request cache controls on chat completions bridged to the Responses API (#44676)	2026-10-05 17:52:44 -07:00
model_prices_and_context_window_backup.json	fix(bedrock): add priority and flex prices for Grok 4.3, 4.6, 4.7 and Kimi K3 (#44670)	2026-10-05 15:12:37 -07:00
policy_templates_backup.json	fix(packaging): keep wheel paths under Windows MAX_PATH for Store Python (#43903)	2026-09-30 22:20:36 +00:00
provider_endpoints_support_backup.json	feat: add Reka as an OpenAI-compatible provider (#44278)	2026-10-05 17:47:23 -07:00
py.typed
router.py	fix(router): retry a /v1/messages stream the provider drops before the first content chunk (#44276)	2026-10-05 22:53:39 +00:00
scheduler.py	fix(otel): nest cache spans under their operation and name service spans by purpose (#44150)	2026-10-03 09:20:27 -07:00
setup_wizard.py	fix(model_prices): correct Claude Sonnet 5.5 capabilities and provider keys (#43587)	2026-09-28 19:12:31 +00:00
timeout.py
tool_loop.py	feat(sdk): add run_tool_loop and arun_tool_loop helpers (#44381)	2026-10-03 20:10:30 -07:00
utils.py	feat(anthropic): workload identity federation and pluggable identity sources (#44448)	2026-10-03 17:08:30 -07:00