mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-11 03:38:38 +00:00
8b1990b4bc
* feat(decisions): add unified /v1/decisions endpoint for Jev-compatible providers Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(decisions): register typesafe as a provider so Jev deployments load Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(decisions): move provider endpoints under llms and validate proxy bodies Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * feat(decisions): add Cloudflare Clef and Strands Decider backends Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(decisions): register decisions routes for managed agents and gateway Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(decisions): use raw regex for cloudflare missing account match Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(decisions): avoid cast in Cloudflare response unwrapping Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(decisions): default model, evaluation health probe, short Cloudflare names The proxy validates only state and questions, so a request without a model falls through to the configured default model like every other route. Health checks probe evaluation-mode deployments through the Decisions API instead of failing with an unsupported mode, and cloudflare/clef and cloudflare/clef-flash get cost-map rows so the short names resolve a mode and a price. The registry no longer claims typed decisions for a provider with no backend. * fix(decisions): let health_check_params override the evaluation probe Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): audit the decisions endpoint across providers, limits, health and chaos Adds the /v1/decisions audit cells: one wire contract per provider (path, key, body and cost-map billing), the gateway-only fields and tags, the sad paths (invalid bodies, unknown model, key checks, api_base in the body, upstream 401/429/500, a 200 without answers, an unreachable upstream), the two evaluation-mode health probes, and three chaos cells (a mixed-failure burst over both routes, a worker SIGKILL mid-burst, an upstream outage and restart on the same port). The PR's cost case read the upstream observations through the gateway, which answers 404 for that path; it now reads them from the upstream URL. The owned proxy harness takes extra CLI arguments, and its graceful stop waits as long as a worker boot may take, since a worker still starting honors SIGTERM only once it is up and the 30 second wait forced a cleanup under load. * fix(decisions): send env API keys to a configured api_base Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * feat(decisions): add zero-cost evaluation cost-map entry for Strands Decider Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(decisions): register the routes through the lazy feature registry The Decisions router was included at import, ahead of the config and DB pass-through endpoints, so a pass-through configured at /v1/decisions was skipped and answered 400 as an unknown Decisions provider. The routes now register through LAZY_FEATURES, which splices them in after every eager route, so a pass-through at /v1/decisions keeps its route while /decisions still serves natively. The lazy OpenAPI snapshot carries the two paths so the schema shows them before the first call. The audit cells add the env-key egress to a configured api_base, the client api_base opt-in shared with chat, the pass-through precedence on an owned proxy, and the Strands evaluation health check resolved from the cost map. The integration config exports the Perplexity env key the first cell needs. * fix(decisions): keep the Cloudflare api_base message in its transformation and read the audit upstream once per cell * fix(proxy): let a config pass-through beat a lazily registered route in eager mode With LITELLM_DISABLE_LAZY_ROUTES set the decisions routes are registered at startup, so SafeRouteAdder treated a config pass-through at exactly /v1/decisions as already registered and dropped it. In lazy mode a pass-through created through the API after the first native call was skipped the same way. Routes a lazy feature owns no longer count as registered, and a route added at one of their paths is placed ahead of them, the precedence lazy mode gives a config pass-through when the feature has not loaded yet. --------- Co-authored-by: mateo <mateo@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| test_anthropic_system_cache_control_wire.py | ||
| test_anthropic_thinking_signature_logging_wire.py | ||
| test_anthropic_thinking_signature_stream_wire.py | ||
| test_azure_ai_chat_wire.py | ||
| test_azure_ai_flux2_image_wire.py | ||
| test_azure_ai_rerank_auth_wire.py | ||
| test_bedrock_auth_wire.py | ||
| test_bedrock_batch_blank_s3_env_wire.py | ||
| test_bedrock_batch_files_wire.py | ||
| test_bedrock_claude_thinking_wire.py | ||
| test_bedrock_converse_client_metadata_wire.py | ||
| test_bedrock_converse_config_blocks_wire.py | ||
| test_bedrock_converse_lookaround_regex_chaos.py | ||
| test_bedrock_converse_lookaround_regex_wire.py | ||
| test_bedrock_converse_missing_content_wire.py | ||
| test_bedrock_converse_stream_event_frames_wire.py | ||
| test_bedrock_deepseek_reasoning_wire.py | ||
| test_bedrock_embedding_wire.py | ||
| test_bedrock_gpt5_reasoning_wire.py | ||
| test_bedrock_gpt_responses_native_wire.py | ||
| test_bedrock_invoke_cache_usage_wire.py | ||
| test_bedrock_knowledge_base_user_context_wire.py | ||
| test_bedrock_mantle_codex_input_wire.py | ||
| test_bedrock_mantle_responses_wire.py | ||
| test_bedrock_mantle_wire.py | ||
| test_bedrock_marengo_embed_3_wire.py | ||
| test_bedrock_passthrough_stream_wire.py | ||
| test_bedrock_rerank_wire.py | ||
| test_bedrock_role_configuration.py | ||
| test_bedrock_runtime_chat_completions_chaos.py | ||
| test_bedrock_runtime_chat_completions_sad_wire.py | ||
| test_bedrock_runtime_chat_completions_wire.py | ||
| test_bedrock_thinking_tokens_wire.py | ||
| test_dashscope_chat_wire.py | ||
| test_databricks_chat_wire.py | ||
| test_databricks_oauth_wire.py | ||
| test_decisions_chaos.py | ||
| test_decisions_wire.py | ||
| test_deepseek_vision_wire.py | ||
| test_fal_ai_chat_wire.py | ||
| test_fal_ai_image_wire.py | ||
| test_fal_ai_passthrough_wire.py | ||
| test_fal_ai_video_wire.py | ||
| test_fireworks_ai_router_slug_wire.py | ||
| test_fireworks_ai_session_affinity_wire.py | ||
| test_hosted_vllm_reasoning_content_chaos.py | ||
| test_hosted_vllm_reasoning_content_wire.py | ||
| test_image_gen_drop_params_wire.py | ||
| test_internal_params_wire.py | ||
| test_nvidia_nim_ranking_wire.py | ||
| test_openai_chat_wire.py | ||
| test_openai_image_edit_wire.py | ||
| test_openai_responses_websocket_wire.py | ||
| test_openai_stream_text_usage_wire.py | ||
| test_provider_lookup_status.py | ||
| test_request_boundary.py | ||
| test_rerank_latency_headers_wire.py | ||
| test_responses_bridge_incomplete.py | ||
| test_responses_bridge_namespace_tools.py | ||
| test_responses_client_header_forwarding_wire.py | ||
| test_responses_minted_reasoning_replay_chaos.py | ||
| test_responses_minted_reasoning_replay_wire.py | ||
| test_s3_wire.py | ||
| test_sagemaker_chat_wire.py | ||
| test_tencent_chat_wire.py | ||
| test_vertex_batch_output_info_wire.py | ||
| test_vertex_gemini_fragmented_stream_wire.py | ||
| test_vertex_gemini_function_call_wire.py | ||
| test_xai_web_search_wire.py | ||
| test_xiaomi_mimo_wire.py | ||