litellm/tests/test_litellm/llms
devin-ai-integration[bot] d0d3b6a67e
fix(vertex_ai): stop advertising OpenAI platform-only params on Gemma and Llama routes (#43079)
* fix(vertex_ai): stop advertising OpenAI platform-only params on Gemma and Llama routes

The Anthropic /v1/messages bridge derives prompt_cache_key from Claude Code's
session id whenever the provider config advertises it, and every Vertex
OpenAI-compatible route (gemma/, openai/<endpoint>, meta/) inherited the full
OpenAI list, so the Model Garden vLLM container rejected each turn with a
pydantic extra_forbidden 400. Vertex's Llama and Gemma configs now filter one
shared list of platform-only params (prompt_cache_key, prompt_cache_retention,
safety_identifier, service_tier, store, web_search_options, modalities,
prediction, audio, max_retries) out of their supported params, so the bridge
no longer derives the key and drop_params drops an explicit one.

* fix(vertex_ai): scope the platform-param filter to self-deployed Model Garden endpoints

---------

Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>
2026-09-24 20:04:33 -07:00
..
aiml/image_generation test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
anthropic fix(vertex_ai): stop advertising OpenAI platform-only params on Gemma and Llama routes (#43079) 2026-09-24 20:04:33 -07:00
azure test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports (#42624) 2026-09-22 17:42:12 -07:00
azure_ai refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081) 2026-09-24 18:18:50 -07:00
base_llm feat(bedrock): serve the OpenAI models on bedrock-runtime's native Responses API (internal copy of #38489) (#42767) 2026-09-23 15:12:39 -07:00
bedrock fix(bedrock): route unmapped openai family model ids to converse (#42713) 2026-09-24 13:08:27 -07:00
bedrock_mantle fix(anthropic): map the dangerous-tool-use beta for Bedrock Mantle so safeguards never reach it without the beta 2026-09-21 13:24:52 -07:00
black_forest_labs test(llms): migrate phase 5 provider unit tests to tests/unit 2026-09-20 07:50:38 +00:00
cerebras test(llms): migrate phase 5 provider unit tests to tests/unit 2026-09-20 07:50:38 +00:00
chatgpt Merge pull request #42109 from BerriAI/litellm_migrate_tests_p5 2026-09-20 04:00:48 -07:00
cometapi/chat test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
compactifai fix(exceptions): map upstream status codes for providers with no exception_type branch 2026-08-26 00:47:28 -07:00
crusoe test(llms): migrate phase 6 provider unit tests to tests/unit 2026-09-20 07:50:30 +00:00
custom_httpx refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081) 2026-09-24 18:18:50 -07:00
dashscope test: keep the Qwen brand missing-key tests off the network and split the ChatGPT fields test back out 2026-09-21 12:54:23 -07:00
databricks chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
deepgram fix(deepgram): forward only the first model and language values to /listen 2026-09-18 21:29:29 +00:00
deepinfra test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
deepseek test(llms): migrate phase 6 provider unit tests to tests/unit 2026-09-20 07:50:30 +00:00
edenai fix(edenai): advertise reasoning_effort only for models the price map flags as reasoning 2026-09-21 19:58:58 +00:00
fal_ai fix(fal_ai): price nano-banana-2 and nano-banana-pro image generations by resolution (#43101) 2026-09-24 19:17:46 -07:00
featherless_ai/chat test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
fireworks_ai/completion test(llms): migrate phase 7 provider unit tests to tests/unit 2026-09-20 08:08:12 +00:00
gdc/chat Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
gemini chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
gigachat test(llms): migrate phase 7 provider unit tests to tests/unit 2026-09-20 08:08:12 +00:00
github_copilot chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
gradient_ai test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
groq test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
heroku
huggingface test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
inception test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
langflow test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
lemonade test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
lm_studio
manus test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
minimax test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
mistral refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081) 2026-09-24 18:18:50 -07:00
modelscope/chat test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
nebius test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
nvidia_riva test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
oci test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
ocr test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
ollama fix(ollama): read the JSON thinking field on non-streaming completions (#42838) 2026-09-23 18:26:02 -07:00
openai feat(spend): capture-rate check of LiteLLM spend against the OpenAI bill (#43044) 2026-09-24 17:09:28 -07:00
openai_like feat: add configurable provider affinity header mapping (#41033) 2026-09-22 13:31:33 -07:00
ovhcloud test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
parallel_ai test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
pass_through
perplexity test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
pg_vector/vector_stores
reducto refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081) 2026-09-24 18:18:50 -07:00
s3_vectors test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
sagemaker feat(bedrock): thread aws_session_tags into STS AssumeRole 2026-09-09 12:37:36 -07:00
sambanova
sap test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
snowflake test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
soniox test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
stability test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
tencent Merge pull request #42145 from BerriAI/litellm_migrate_tests_p13 2026-09-20 10:50:18 -07:00
tinyfish
vercel_ai_gateway test: migrate legacy provider tests to tests/unit (wave 2, phase 13) 2026-09-20 14:18:49 +00:00
vertex_ai fix(vertex_ai): stop advertising OpenAI platform-only params on Gemma and Llama routes (#43079) 2026-09-24 20:04:33 -07:00
volcengine test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
voyage/rerank test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
wandb chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
watsonx test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
xai chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
you_com test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
test_cache_control_and_reasoning.py test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
test_file_content_block.py
test_file_search_responses.py fix(file_search): escape the dropped vector_store_id in the warning 2026-09-05 16:44:54 -07:00
test_lifecycle_fix.py
test_polling_url_origin_match.py refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081) 2026-09-24 18:18:50 -07:00
test_predibase_transformation.py