litellm/tests/test_litellm/llms
ryan-crabbe-berri ebbc5cc787
feat(vector-stores): forward per-request params to Vertex AI Search (#29459)
* feat(vector-stores): forward per-request params to Vertex AI Search

The vertex_ai/search_api search transform hardcoded the request body to
query plus pageSize 10, dropping max_num_results and extra_body. Map
max_num_results to pageSize and merge extra_body through with precedence,
so callers can send native Discovery Engine fields such as dataStoreSpecs.

Resolves LIT-3506

* fix(vector-stores): log effective query when extra_body overrides it

When a caller passes a query inside extra_body, the outbound Vertex Search
request used that value but model_call_details recorded the original, so the
echoed search_query was stale. Log the effective query from the request body.

* fix(vector-stores): allowlist Vertex AI Search extra_body fields

Raw-merging extra_body let callers set dataStoreSpecs/branch to search a
different Discovery Engine data store with the proxy's Vertex credentials,
bypassing the vector_store_id path authorization. Reject target-selecting
fields and forward only allowlisted per-request tuning fields.

Resolves LIT-3506

* refactor(vector-stores): split Vertex AI Search extra_body allowlists by mode

Data-store and engine/app serving configs accept different SearchRequest
fields, so derive two TypedDicts (VertexSearchDataStoreExtraBody and
VertexSearchEngineExtraBody) in types/vector_stores.py and make
_filter_extra_body mode-aware via vertex_engine_id.

dataStoreSpecs and numResultsPerDataStore now pass through in engine/app
mode (where an app fans out across stores) and are rejected in data-store
mode. branch/servingConfig/entity remain rejected in both modes.

* fix(vector-stores): raise BadRequestError (400) for invalid Vertex Search extra_body

Rejecting unsupported or target-selecting extra_body fields previously
raised a bare ValueError, which the vector store error path mapped to a
generic APIConnectionError (HTTP 500). Raise litellm.BadRequestError so
invalid per-request input surfaces as HTTP 400 with a clear message.
2026-06-02 12:51:20 -07:00
..
amazon_nova/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
anthropic Litellm oss staging (#29492) 2026-06-02 08:48:10 -07:00
apiserpent Litellm oss staging (#29492) 2026-06-02 08:48:10 -07:00
azure fix(azure): preserve AD token refresh in v1 OpenAI client path (#28627) 2026-05-25 21:08:52 -07:00
azure_ai fix(azure_ai): strip tool-level extra fields on 400 and retry (#29479) 2026-06-02 06:21:25 -07:00
base_llm fix(team): keep team_alias cache in sync on _cache_team_object writes (#28737) 2026-05-25 19:16:36 -07:00
baseten/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
bedrock Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
bedrock_mantle style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
black_forest_labs Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
bytez/chat fix: preserve safe provider model path segments 2026-04-29 22:09:54 -07:00
chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
chatgpt Litellm oss staging 04 21 2026 2 (#26569) 2026-05-20 21:25:19 -07:00
cloudflare fix: preserve safe provider model path segments 2026-04-29 22:09:54 -07:00
cohere style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
cometapi/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
compactifai style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
crusoe fix(crusoe): remove trailing slashes from API base URLs and fix list indentation 2026-05-01 17:27:52 +05:30
custom_httpx Litellm oss staging (#29492) 2026-06-02 08:48:10 -07:00
dashscope Litellm oss staging (#28161) 2026-05-18 16:27:44 -07:00
databricks style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
datarobot style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
deepgram style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
deepinfra style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
deepseek fix(deepseek): use native /anthropic/v1/messages endpoint and sanitize tools (#28200) 2026-05-18 18:14:13 -07:00
docker_model_runner style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
elevenlabs test: avoid provider test module name collision 2026-04-29 22:36:57 -07:00
featherless_ai/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
fireworks_ai fix(anthropic, fireworks): inline legacy $ref defs in tool schemas (#28646) 2026-06-01 14:28:31 -07:00
gemini [Feat] Add tool calling support for gemini and vertex ai live api (#26590) 2026-05-26 14:40:42 -07:00
github_copilot Litellm oss staging (#29492) 2026-06-02 08:48:10 -07:00
heroku style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
hosted_vllm fix(hosted_vllm): normalize custom tools for chat completions (#25763) 2026-05-05 17:27:02 -07:00
huggingface style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
jina_ai/embedding feat(JinaAI): support multimodal embedding models (#13181) 2025-08-05 19:21:56 -07:00
lemonade Litellm OSS Staging (#29161) 2026-06-01 21:22:35 -07:00
litellm_proxy chore: simplify ownership tracking — drop thin stores, in-memory fallback, hand-rolled cache 2026-05-05 00:23:32 +00:00
llamafile/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
lm_studio style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
manus fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
meta_llama Fixing mapped tests 2026-02-16 20:13:37 -08:00
minimax style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
mistral Merge pull request #25256 from BerriAI/litellm_ishaan_april6 2026-04-17 16:26:45 -07:00
moonshot add moonshot/kimi-k2.6 to model registry (#26203) 2026-04-21 19:58:43 -07:00
nebius test: fixes 2025-05-31 12:42:56 -07:00
novita/chat Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
nscale/chat Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
nvidia_riva feat(audio_transcription): add NVIDIA Riva STT provider (#27185) 2026-05-05 17:17:51 -07:00
oci CI: copy of #25177 (OCI GenAI: embeddings, streaming/reasoning fixes, model catalog) (#28223) 2026-05-23 12:15:41 -07:00
ocr Add OCR guardrail_translation handler and support (#22145) 2026-02-28 17:39:36 -08:00
ollama Litellm OSS Staging (#29161) 2026-06-01 21:22:35 -07:00
openai Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
openai_like Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
openrouter style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
ovhcloud fix(ovhcloud): remove dead transform_response override 2026-04-28 23:09:17 +05:30
perplexity style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
pg_vector/vector_stores fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
publicai style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
ragflow/chat fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
recraft style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
reducto Litellm oss staging 04 21 2026 2 (#26569) 2026-05-20 21:25:19 -07:00
runwayml fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
s3_vectors Fix extra body error 2026-04-29 08:34:31 +05:30
sagemaker fix(sagemaker): send native Cohere embed payload to Cohere SageMaker endpoints (#28613) 2026-05-22 12:00:42 -07:00
sambanova Feat/sambanova embeddings (#13308) 2025-08-12 17:15:26 -07:00
sap style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
scaleway Feature/add audio support for scaleway (#26110) 2026-04-20 14:49:41 -07:00
snowflake style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
stability style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
vercel_ai_gateway style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
vertex_ai feat(vector-stores): forward per-request params to Vertex AI Search (#29459) 2026-06-02 12:51:20 -07:00
volcengine fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
voyage/rerank style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
wandb (feat): Add W&B Inference to LiteLLM 2025-09-11 00:07:30 +05:30
watsonx Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
xai Litellm oss staging (#29492) 2026-06-02 08:48:10 -07:00
zai style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_cache_control_and_reasoning.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_file_content_block.py Litellm oss staging (#28161) 2026-05-18 16:27:44 -07:00
test_file_search_responses.py fix(tests): use canonical litellm_enterprise import path (#27699) 2026-05-12 12:32:57 -07:00
test_lifecycle_fix.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_oom_fixes.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_polling_url_origin_match.py chore(security): close two unaddressed SSRF cases 2026-05-01 18:43:47 +00:00
test_predibase_transformation.py refactor(predibase): migrate transform_request and transform_response… (#25249) 2026-04-27 08:58:22 +05:30