mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-13 03:59:12 +00:00
* feat(decisions): add hosted_vllm provider
Adds HostedVLLMDecisionsConfig so hosted_vllm/<served model> works on
POST /v1/systemone and POST /v1/decisions against a vLLM server that
serves the System One body (vllm-project/vllm#59299, after v0.31.0).
vLLM only supports choice questions and rejects others, so the base
decisions config gains a per-provider health_check_questions attribute
and the evaluation-mode health probe sends a choice question for
hosted_vllm while every other provider keeps the noul probe.
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
* refactor(decisions): move the hosted_vllm placeholder key to constants
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
---------
Co-authored-by: kerry <kerry@berri.ai>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
(cherry picked from commit
|
||
|---|---|---|
| .. | ||
| test_budget_updates.py | ||
| test_guardrail_usage_config_guardrail.py | ||
| test_key_updates.py | ||
| test_model_credential_name_updates.py | ||
| test_model_health_check.py | ||
| test_organization_budget_clear.py | ||
| test_organization_lifecycle.py | ||
| test_partial_update_sequences.py | ||
| test_project_lifecycle.py | ||
| test_scim_group_member_not_yet_provisioned.py | ||
| test_team_budget_duration_defaults.py | ||
| test_team_delete_chaos.py | ||
| test_team_delete_inputs.py | ||
| test_team_delete_large_membership.py | ||
| test_team_delete_member_cache_eviction.py | ||
| test_team_delete_prometheus.py | ||
| test_team_member_budget_cache.py | ||
| test_tool_policy_user.py | ||
| test_user_updates_wedged_coordination_redis.py | ||
| test_vector_store_config_ownership.py | ||