litellm/tests/test_litellm/llms
shrey kharbanda eed6b2bb75 fix(bedrock): keep count_tokens body key order and narrow the thinking display warning
Rebuild the InvokeModel count body in place so keys stay in request order
and only messages is rewritten. Gate the thinking display coercion on the
dict check before calling the normalizer. Pin the already-empty content
list next to an offender, malformed message entries next to an offender,
and the count body key order in the mapped tests
2026-09-24 19:59:29 +00:00
..
aiml/image_generation test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
anthropic fix(anthropic): preserve MCP tool results in the non-Anthropic Messages bridge (#42783) 2026-09-23 13:03:25 -07:00
azure test(realtime): drop legacy InvalidStatusCode tests and pin websockets imports (#42624) 2026-09-22 17:42:12 -07:00
azure_ai fix(cost): honor deployment pricing for image generation (#39311) 2026-09-22 11:40:39 -07:00
base_llm feat(bedrock): serve the OpenAI models on bedrock-runtime's native Responses API (internal copy of #38489) (#42767) 2026-09-23 15:12:39 -07:00
bedrock fix(bedrock): keep count_tokens body key order and narrow the thinking display warning 2026-09-24 19:59:29 +00:00
bedrock_mantle fix(anthropic): map the dangerous-tool-use beta for Bedrock Mantle so safeguards never reach it without the beta 2026-09-21 13:24:52 -07:00
black_forest_labs test(llms): migrate phase 5 provider unit tests to tests/unit 2026-09-20 07:50:38 +00:00
cerebras test(llms): migrate phase 5 provider unit tests to tests/unit 2026-09-20 07:50:38 +00:00
chatgpt Merge pull request #42109 from BerriAI/litellm_migrate_tests_p5 2026-09-20 04:00:48 -07:00
cometapi/chat test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
compactifai fix(exceptions): map upstream status codes for providers with no exception_type branch 2026-08-26 00:47:28 -07:00
crusoe test(llms): migrate phase 6 provider unit tests to tests/unit 2026-09-20 07:50:30 +00:00
custom_httpx feat(bedrock): serve the OpenAI models on bedrock-runtime's native Responses API (internal copy of #38489) (#42767) 2026-09-23 15:12:39 -07:00
dashscope test: keep the Qwen brand missing-key tests off the network and split the ChatGPT fields test back out 2026-09-21 12:54:23 -07:00
databricks chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
deepgram fix(deepgram): forward only the first model and language values to /listen 2026-09-18 21:29:29 +00:00
deepinfra test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
deepseek test(llms): migrate phase 6 provider unit tests to tests/unit 2026-09-20 07:50:30 +00:00
edenai fix(edenai): advertise reasoning_effort only for models the price map flags as reasoning 2026-09-21 19:58:58 +00:00
fal_ai fix(fal_ai): honour global api_base for image generation and reject non-string reasoning_effort with 400 (#42512) 2026-09-22 13:13:54 -07:00
featherless_ai/chat test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
fireworks_ai/completion test(llms): migrate phase 7 provider unit tests to tests/unit 2026-09-20 08:08:12 +00:00
gdc/chat Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5 2026-08-29 06:03:33 -07:00
gemini chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
gigachat test(llms): migrate phase 7 provider unit tests to tests/unit 2026-09-20 08:08:12 +00:00
github_copilot chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
gradient_ai test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
groq test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
heroku
huggingface test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
inception test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
langflow test: migrate wave 1 phase 8 legacy llm tests to tests/unit 2026-09-20 08:03:54 +00:00
lemonade test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
lm_studio
manus test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
minimax test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
mistral test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
modelscope/chat test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
nebius test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
nvidia_riva test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
oci test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
ocr test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 2026-09-20 08:09:49 +00:00
ollama fix(ollama): read the JSON thinking field on non-streaming completions (#42838) 2026-09-23 18:26:02 -07:00
openai ci: add merge smoke checks workflow with loopback-only harness and 11 curated cases (#42709) 2026-09-23 11:01:08 -07:00
openai_like feat: add configurable provider affinity header mapping (#41033) 2026-09-22 13:31:33 -07:00
ovhcloud test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
parallel_ai test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
pass_through test: remove four mirror test files that exercise none of their module 2026-07-25 10:57:19 -07:00
perplexity test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
pg_vector/vector_stores test: require a match= on broad pytest.raises, and drop duplicate parametrize cases (#37769) 2026-08-20 20:24:49 -07:00
reducto test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
s3_vectors test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
sagemaker feat(bedrock): thread aws_session_tags into STS AssumeRole 2026-09-09 12:37:36 -07:00
sambanova
sap test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
snowflake test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
soniox test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
stability test: migrate phase 12 legacy llm provider tests to tests/unit 2026-09-20 11:02:53 +00:00
tencent Merge pull request #42145 from BerriAI/litellm_migrate_tests_p13 2026-09-20 10:50:18 -07:00
tinyfish test: require a match= on broad pytest.raises, and drop duplicate parametrize cases (#37769) 2026-08-20 20:24:49 -07:00
vercel_ai_gateway test: migrate legacy provider tests to tests/unit (wave 2, phase 13) 2026-09-20 14:18:49 +00:00
vertex_ai fix(cost-map): sync vertex-ai rows (gemma 4 maas cache price, chirp_2) (#42942) 2026-09-24 04:39:09 -07:00
volcengine test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
voyage/rerank test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
wandb chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
watsonx test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
xai chore(cost-map): remove models past their deprecation date (#42435) 2026-09-22 21:19:26 +00:00
you_com test: migrate phase 14 wave 2 provider tests to tests/unit 2026-09-20 11:01:40 +00:00
test_cache_control_and_reasoning.py test: drop the cwd-relative sys.path.insert calls from the test suite (#37802) 2026-08-22 09:25:58 -07:00
test_file_content_block.py
test_file_search_responses.py fix(file_search): escape the dropped vector_store_id in the warning 2026-09-05 16:44:54 -07:00
test_lifecycle_fix.py
test_polling_url_origin_match.py
test_predibase_transformation.py