litellm/tests/test_litellm/llms
devin-ai-integration[bot] fb0f3b693a
test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports (#42624)
The two redaction tests raised the deprecated InvalidStatusCode, which the
websockets 15 asyncio client never raises, and asserted the raw 403 close
code that the handshake refusal path replaced with 1008. The refusal path
builds its close reason from the status code alone, so there is no secret
to redact there, and the handshake refusal tests already cover the error
event and the 1008 close.

Those refusal tests only passed when run after a sibling test had imported
websockets.asyncio.client, since websockets lazy-loads its exceptions
submodule. Importing InvalidStatus, Response, and Headers from their own
submodules makes them pass in any order.

Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>
(cherry picked from commit 38f0eb876b)
2026-10-20 01:06:21 -07:00
..
a2a refactor(a2a): resolve the relay's Entra hop bearer inside the a2a provider helper 2026-09-16 17:56:42 -07:00
aiml/image_generation test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
amazon_nova/chat
anthropic fix(azure_ai): add the dangerous-tool-use beta when Foundry gets safeguards 2026-09-28 22:48:03 -07:00
apiserpent
azure test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports (#42624) 2026-10-20 01:06:21 -07:00
azure_ai Merge pull request #39424 from emerzon/litellm_azure_ai_flux_2_flex 2026-09-18 14:30:25 -07:00
base_llm fix(batches): authorize executed upload targets before the files api probe 2026-09-19 12:26:11 -07:00
baseten/chat
bedrock fix(anthropic): forward Claude Code safeguards and dangerous-tool-use beta to Bedrock Invoke and Vertex on /v1/messages (#42288) 2026-09-28 20:07:52 -07:00
bedrock_mantle test(bedrock_mantle): document mantle in-region pricing invariant 2026-09-18 19:18:45 +00:00
black_forest_labs fix(image_edit): await an async transform hook and hide the URL policy verdict from callers 2026-09-04 23:20:21 -07:00
bytez/chat
cerebras test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
chat fix(bedrock): keep x-amzn-RequestId on chat error responses (#40089) 2026-09-07 17:16:47 -07:00
chatgpt test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
cloudflare
cohere test: drop tests that pin provider-owned cost map values 2026-09-18 03:55:51 +00:00
cometapi/chat
compactifai
crusoe test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
custom_httpx fix(proxy): estimate auto-router baseline costs from durable cache history 2026-09-19 12:44:47 -07:00
dashscope test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
databricks test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
datarobot
deepgram fix(deepgram): forward only the first model and language values to /listen 2026-09-18 21:29:29 +00:00
deepinfra
deepseek fix(cost): bill DeepSeek V4.1 Flash and V4 Pro at their off-peak rates outside peak hours 2026-09-19 04:31:55 -07:00
docker_model_runner
elevenlabs
fal_ai test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
fastcrw/search
featherless_ai/chat
fireworks_ai fix(cost_calc): coerce string fireworks rates and drop the match fall-through 2026-09-19 01:33:41 +00:00
gdc/chat
gemini test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
gigachat fix(gigachat): fold cached tokens back into prompt and total token counts 2026-08-31 15:16:44 -07:00
github_copilot
gradient_ai
groq test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
heroku
hosted_vllm fix(hosted_vllm): reject image edit params vLLM-Omni ignores 2026-09-08 20:11:01 -07:00
huggingface
inception test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
jina_ai/embedding
langflow
lemonade
litellm_proxy fix(spend): attribute CLI session spend to the per-user cli-session alias instead of the hashed session token (#40541) 2026-09-30 11:43:02 -07:00
llamafile/chat
lm_studio
manus
meta/realtime fix(vertex_ai): carry turns across stream rotation and route by model info 2026-09-18 15:35:59 -07:00
meta_llama
minimax
mistral fix(mistral): read back files whose purpose Mistral never lets us upload as user_data 2026-09-19 03:04:45 -07:00
modelscope
mongodb/vector_stores fix: preserve MongoDB deadlines and secure remote sidecar transport 2026-09-07 23:43:21 -07:00
moonshot test: drop tests that pin provider-owned cost map values 2026-09-18 03:55:51 +00:00
nebius
neosantara
nimble/search
novita/chat
nscale/chat
nvidia_nim fix(proxy): reject mixed NIM model groups and strip the deployment model before the group in /nvidia_nim URLs 2026-09-15 23:34:22 +00:00
nvidia_riva
oci test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
ocr
ollama perf: move Anthropic, Vertex Anthropic, Ollama and HF template fetches off the event loop (#40311) 2026-09-08 15:53:43 -07:00
oobabooga/chat
openai test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports (#42624) 2026-10-20 01:06:21 -07:00
openai_like test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
openrouter
ovhcloud
parallel_ai test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
parasail
pass_through
perplexity test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
pg_vector/vector_stores
publicai
ragflow/chat
recraft
reducto test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
runwayml
s3_vectors fix(s3_vectors): reject a store id with an empty bucket or index part 2026-09-19 03:52:48 -07:00
sagemaker feat(bedrock): thread aws_session_tags into STS AssumeRole 2026-09-09 12:37:36 -07:00
sambanova
sap
scaleway
snowflake fix(async): move remote image fetches off the event loop for Snowflake, Bedrock invoke Claude, Mantle and Gemini 2026-09-04 17:48:56 -07:00
soniox test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
stability
tencent test: drop tests that pin provider-owned cost map values 2026-09-18 03:55:51 +00:00
tinyfish
together_ai/chat test(together_ai): drop the prefix-strip assertion, e2e covers it live 2026-09-16 13:58:38 -07:00
valkey/vector_stores fix(vector-store): route embeddings through router 2026-09-01 15:33:18 -07:00
vercel_ai_gateway
vertex_ai fix(anthropic): forward Claude Code safeguards and dangerous-tool-use beta to Bedrock Invoke and Vertex on /v1/messages (#42288) 2026-09-28 20:07:52 -07:00
volcengine
voyage fix(rerank): stamp a fresh response id when Voyage, watsonx, or Fireworks omit one 2026-09-13 01:34:22 -07:00
wandb test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
watsonx fix(rerank): stamp a fresh response id when Voyage, watsonx, or Fireworks omit one 2026-09-13 01:34:22 -07:00
xai fix(xai): reject non-success stt responses before parsing 2026-09-19 01:22:25 +00:00
you_com
zai test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
test_cache_control_and_reasoning.py
test_file_content_block.py
test_file_search_responses.py fix(file_search): escape the dropped vector_store_id in the warning 2026-09-05 16:44:54 -07:00
test_lifecycle_fix.py
test_polling_url_origin_match.py
test_predibase_transformation.py