litellm/tests/test_litellm/llms/hosted_vllm
Christopher Chase 87bdfb0253
fix(hosted_vllm): route through base_llm_http_handler to support ssl_verify (#19893)
* fix(hosted_vllm): route through base_llm_http_handler to support ssl_verify

The hosted_vllm provider was falling through to the OpenAI catch-all path
which doesn't pass ssl_verify to the HTTP client. This adds an explicit
elif branch that routes hosted_vllm through base_llm_http_handler.completion()
which properly passes ssl_verify to the httpx client.

- Add explicit hosted_vllm branch in main.py completion()
- Add ssl_verify tests for sync and async completion
- Update existing audio_url test to mock httpx instead of OpenAI client

* feat(hosted_vllm): add embedding support with ssl_verify

- Add HostedVLLMEmbeddingConfig for embedding transformations
- Register hosted_vllm embedding config in utils.py
- Add lazy import for embedding transformation module
- Add unit test for ssl_verify parameter handling
2026-01-28 22:33:07 -08:00
..
chat fix(hosted_vllm): route through base_llm_http_handler to support ssl_verify (#19893) 2026-01-28 22:33:07 -08:00
embedding fix(hosted_vllm): route through base_llm_http_handler to support ssl_verify (#19893) 2026-01-28 22:33:07 -08:00
test_hosted_vllm_rerank_transformation.py fix: fix vllm test 2025-09-27 10:01:48 -07:00