litellm/tests/test_litellm/llms
mateo-berri 54dbe8eb9a test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports
The two redaction tests raised the deprecated InvalidStatusCode, which the
websockets 15 asyncio client never raises, and asserted the raw 403 close
code that the handshake refusal path replaced with 1008. The refusal path
builds its close reason from the status code alone, so there is no secret
to redact there, and the handshake refusal tests already cover the error
event and the 1008 close.

Those refusal tests only passed when run after a sibling test had imported
websockets.asyncio.client, since websockets lazy-loads its exceptions
submodule. Importing InvalidStatus, Response, and Headers from their own
submodules makes them pass in any order.
2026-09-22 16:39:13 -07:00
..
aiml/image_generation test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
anthropic fix(anthropic): return 400 instead of 500 when a content list holds a bare string (#42420) 2026-09-22 15:44:30 -07:00
azure test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports 2026-09-22 16:39:13 -07:00
azure_ai fix(cost): honor deployment pricing for image generation (#39311) 2026-09-22 11:40:39 -07:00
base_llm test(llms): migrate bedrock, baseten and base_llm batch tests to tests/unit 2026-09-20 07:51:50 +00:00
bedrock chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
bedrock_mantle fix(anthropic): map the dangerous-tool-use beta for Bedrock Mantle so safeguards never reach it without the beta 2026-09-21 13:24:52 -07:00
black_forest_labs test(llms): migrate phase 5 provider unit tests to tests/unit 2026-09-20 07:50:38 +00:00
cerebras test(llms): migrate phase 5 provider unit tests to tests/unit 2026-09-20 07:50:38 +00:00
chatgpt Merge pull request #42109 from BerriAI/litellm_migrate_tests_p5 2026-09-20 04:00:48 -07:00
cometapi/chat test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
compactifai fix(exceptions): map upstream status codes for providers with no exception_type branch 2026-08-26 00:47:28 -07:00
crusoe test(llms): migrate phase 6 provider unit tests to tests/unit 2026-09-20 07:50:30 +00:00
custom_httpx fix(langsmith): json.dumps with default=str so non-serializable metadata does not crash batch flush (#42424) 2026-09-22 12:21:11 -07:00
dashscope test: keep the Qwen brand missing-key tests off the network and split the ChatGPT fields test back out 2026-09-21 12:54:23 -07:00
databricks chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
deepgram fix(deepgram): forward only the first model and language values to /listen 2026-09-18 21:29:29 +00:00
deepinfra test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
deepseek test(llms): migrate phase 6 provider unit tests to tests/unit 2026-09-20 07:50:30 +00:00
edenai fix(edenai): advertise reasoning_effort only for models the price map flags as reasoning 2026-09-21 19:58:58 +00:00
fal_ai fix(fal_ai): honour global api_base for image generation and reject non-string reasoning_effort with 400 (#42512) 2026-09-22 13:13:54 -07:00
featherless_ai/chat test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
fireworks_ai/completion test(llms): migrate phase 7 provider unit tests to tests/unit 2026-09-20 08:08:12 +00:00
gdc/chat Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
gemini chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
gigachat test(llms): migrate phase 7 provider unit tests to tests/unit 2026-09-20 08:08:12 +00:00
github_copilot chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
gradient_ai test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
groq test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
heroku
huggingface test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
inception test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
langflow test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
lemonade test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
lm_studio
manus test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
minimax test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
mistral test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
modelscope/chat test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
nebius test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
nvidia_riva test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
oci test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
ocr test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
ollama fix(streaming): keep an explicit provider prompt_tokens=0 or completion_tokens=0 in streamed usage 2026-09-21 14:01:08 -07:00
openai test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports 2026-09-22 16:39:13 -07:00
openai_like feat: add configurable provider affinity header mapping (#41033) 2026-09-22 13:31:33 -07:00
ovhcloud test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
parallel_ai test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
pass_through
perplexity test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
pg_vector/vector_stores test: require a match= on broad pytest.raises, and drop duplicate parametrize cases (#37769) 2026-08-20 20:24:49 -07:00
reducto test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
s3_vectors test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
sagemaker feat(bedrock): thread aws_session_tags into STS AssumeRole 2026-09-09 12:37:36 -07:00
sambanova
sap test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
snowflake test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
soniox test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
stability test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
tencent Merge pull request #42145 from BerriAI/litellm_migrate_tests_p13 2026-09-20 10:50:18 -07:00
tinyfish test: require a match= on broad pytest.raises, and drop duplicate parametrize cases (#37769) 2026-08-20 20:24:49 -07:00
vercel_ai_gateway test: migrate legacy provider tests to tests/unit (wave 2, phase 13) 2026-09-20 14:18:49 +00:00
vertex_ai chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
volcengine test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
voyage/rerank test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
wandb chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
watsonx test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
xai chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
you_com test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
test_cache_control_and_reasoning.py test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
test_file_content_block.py
test_file_search_responses.py fix(file_search): escape the dropped vector_store_id in the warning 2026-09-05 16:44:54 -07:00
test_lifecycle_fix.py
test_polling_url_origin_match.py
test_predibase_transformation.py