devin-ai-integration[bot] 549e6d4f46 fix(router): keep DB-only deployments priced across price data reloads (#48486) ... * fix(router): track every router for price data reloads so DB-only deployments keep custom pricing Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(router): register the router for reload replay only once model_list exists, and type the regression test Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: joshua <joshua@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-10-26 17:17:52 -07:00
..
_v2	feat(cache): select Rust caching through explicit cache objects (#43601)	2026-09-29 00:01:44 +00:00
a2a_protocol	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
anthropic_interface	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
assistants	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
batch_completion
batches	fix(batches): apply the Vertex regional endpoint uplift to batch cost (#47466)	2026-10-20 01:51:51 +00:00
caching	feat(router): add opt-in session repinning after successful failover (#48206)	2026-10-24 13:00:58 -07:00
chat_completions	refactor(rust-bridge): detect Python-only features in the catalog instead of Rust declines (#46714)	2026-10-20 15:06:25 -07:00
completion_extras	fix(router)!: stop a chat-mode Mantle deployment from rewriting the shared Responses routing row (#46263)	2026-10-17 21:39:14 +00:00
compression	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
containers	feat(openai)!: honor per-deployment workload identity on non-chat routes (#39966)	2026-10-16 22:25:15 +00:00
decisions	fix(decisions): bill unpriced returned TypeSafe versions at the requested model and name a missing answers field (#47508)	2026-10-20 11:46:17 -07:00
embeddings	refactor(rust-bridge): decide native routing in the catalog, drop the bypass predicates (#46750)	2026-10-20 15:06:24 -07:00
endpoints/speech/speech_to_completion_bridge	feat(vertex-ai)!: support gemini 3.1 flash tts (#31915)	2026-10-21 04:18:42 +00:00
evals
experimental_mcp_client	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
extraction	feat(extraction): add /v1/extraction with Cloudflare Clairic support (#47473)	2026-10-20 15:51:45 -07:00
files	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
fine_tuning	fix(managed_files): send provider file ids when creating a fine-tuning job from managed files (#46552)	2026-10-19 14:40:15 -07:00
google_genai	fix(langfuse_otel)!: send the completion start time (#45597)	2026-10-20 13:52:26 +00:00
harness	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
images	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
integrations	fix(otel): decide per-team Arize sampling from the trace id so every pod agrees (#47468)	2026-10-26 11:44:30 -07:00
interactions	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
litellm_core_utils	fix(proxy)!: gate key budget_duration and budget_id updates like max_budget (#47681)	2026-10-26 16:45:35 -07:00
llms	fix(http_handler): name the timeout phase and limit that fired instead of "after None seconds" (#48250)	2026-10-26 16:04:33 -07:00
messages	fix(opencode): forward stable sessions automatically across inference routes (#48121)	2026-10-23 17:38:47 -07:00
models	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
ocr	refactor(rust-bridge): decide native routing in the catalog, drop the bypass predicates (#46750)	2026-10-20 15:06:24 -07:00
passthrough	fix(bedrock)!: apply the deployment guardrailConfig on /bedrock pass-through routes (#47429)	2026-10-20 14:48:19 -07:00
proxy	fix(mcp): reject revoked browser sessions during gateway authorization (#48494)	2026-10-26 17:14:57 -07:00
proxy_auth	refactor(types): replace Any with real types across 29 more backend files	2026-09-08 10:14:07 +00:00
rag	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
realtime_api	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
repositories	fix(proxy): reconcile team member total_spend with current cycle spend (#48260)	2026-10-24 17:57:09 -07:00
rerank_api	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
responses	feat(chatgpt): forward client subscriptions through the gateway (#41522)	2026-10-26 15:44:05 -07:00
router_strategy	fix(router): stop concurrent deployment deletes from crashing deployment lookups (#47680)	2026-10-26 15:40:19 -07:00
router_utils	refactor(cost-map): drop the legacy max_tokens field in favor of max_input_tokens and max_output_tokens (#48471)	2026-10-26 17:03:05 -07:00
rust_bridge	fix(opencode): forward stable sessions automatically across inference routes (#48121)	2026-10-23 17:38:47 -07:00
sandbox	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
search	fix(search): price Tavily advanced and Linkup deep searches at their own cost map entries (#47411)	2026-10-19 23:32:31 -07:00
secret_managers	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
skills	refactor(typing): clear 1143 basedpyright Any errors across 273 files (#46574)	2026-10-15 21:08:47 +00:00
systemone	fix(decisions): log every request field the caller sent on /v1/systemone and /v1/decisions (#47183)	2026-10-19 14:19:14 -07:00
telemetry	refactor: clean up fresh tech debt in per-user Copilot auth, Ternary FOCUS export and telemetry (#45769)	2026-10-15 04:29:27 +00:00
text_completions	fix(completions): omit stream usage unless requested (#47953) (#48052)	2026-10-23 19:36:20 +00:00
tracing	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
types	feat(chatgpt): forward client subscriptions through the gateway (#41522)	2026-10-26 15:44:05 -07:00
vector_store_files	fix(secret_managers)!: resolve oidc/file and oidc/env refs in admin-configured api_key per request (#47341)	2026-10-20 01:43:59 +00:00
vector_stores	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
videos	feat(dashscope): add Wan 3.0, Wan 2.7 and HappyHorse video generation via /v1/videos (#43706)	2026-10-14 10:10:07 -07:00
__init__.py	feat(providers): add OpenCode Go routing and pricing (#48140)	2026-10-24 12:24:11 -07:00
_internal_context.py	fix(responses): log and bill every round of non-stream MCP auto-execute (#43667)	2026-10-16 17:37:33 +00:00
_lazy_imports.py	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
_lazy_imports_registry.py	feat(extraction): add /v1/extraction with Cloudflare Clairic support (#47473)	2026-10-20 15:51:45 -07:00
_logging.py	fix(logging): keep root logger INFO lines when json_logs is on and LITELLM_LOG is set (#47175)	2026-10-17 21:33:26 +00:00
_process_defaults.py	perf(cli): start lite without initializing the litellm SDK (#46803)	2026-10-17 04:53:32 +00:00
_redis.py	refactor(typing): clear 1143 basedpyright Any errors across 273 files (#46574)	2026-10-15 21:08:47 +00:00
_redis_credential_provider.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
_service_logger.py	fix(caching): report Redis circuit-breaker metrics through the Prometheus services logger (#46484)	2026-10-14 14:29:54 -07:00
_uuid.py	fix: support Python 3.15 (#48359)	2026-10-26 16:00:11 +00:00
_version.py	feat(sdk): build core from an independent packaging manifest (#44340)	2026-10-08 18:40:14 -07:00
anthropic_beta_headers_config.json	fix(azure_ai): forward the thinking-binding-controls beta header to Foundry (#48033)	2026-10-23 16:34:55 -07:00
anthropic_beta_headers_manager.py	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
blog_posts.json
budget_manager.py	refactor(typing): clear 1143 basedpyright Any errors across 273 files (#46574)	2026-10-15 21:08:47 +00:00
constants.py	fix(proxy): buffer tool discoveries in Redis and write LiteLLM_ToolTable in one statement per drain, on its own lock (#48089)	2026-10-24 12:34:13 -07:00
cost.json
cost_calculator.py	fix(decisions): preserve missing native usage (#48147) (#48261)	2026-10-24 17:37:38 -07:00
exceptions.py	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
main.py	feat(chatgpt): forward client subscriptions through the gateway (#41522)	2026-10-26 15:44:05 -07:00
model_prices_and_context_window_backup.json	refactor(cost-map): drop the legacy max_tokens field in favor of max_input_tokens and max_output_tokens (#48471)	2026-10-26 17:03:05 -07:00
policy_templates_backup.json	fix(packaging): keep wheel paths under Windows MAX_PATH for Store Python (#43903)	2026-09-30 22:20:36 +00:00
provider_endpoints_support_backup.json	feat(openinfer): add OpenInfer as an OpenAI-compatible provider (#41034)	2026-10-17 23:22:19 +00:00
py.typed
router.py	fix(router): keep DB-only deployments priced across price data reloads (#48486)	2026-10-26 17:17:52 -07:00
scheduler.py	fix(scheduler): remove a request's queue entry once it stops waiting (#43061)	2026-10-07 17:34:38 -07:00
setup_wizard.py	fix(model_prices): correct Claude Sonnet 5.5 capabilities and provider keys (#43587)	2026-09-28 19:12:31 +00:00
timeout.py
tool_loop.py	fix(responses bridge): round-trip tool_search_call and tool_search_output items between turns (#46444)	2026-10-14 21:40:14 -07:00
utils.py	refactor(cost-map): drop the legacy max_tokens field in favor of max_input_tokens and max_output_tokens (#48471)	2026-10-26 17:03:05 -07:00