litellm/tests/test_litellm/llms
yucheng-berri 4301ac4940
Merge pull request #41986 from BerriAI/litellm_revert_post_call_guardrail_context
revert(guardrails): drop the scoped request conversation and tools from post-call scans (#41220)
2026-09-19 12:06:30 -07:00
..
a2a refactor(a2a): resolve the relay's Entra hop bearer inside the a2a provider helper 2026-09-16 17:56:42 -07:00
aiml/image_generation test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
amazon_nova/chat
anthropic Revert "Merge pull request #41220 from BerriAI/litellm_post_call_guardrail_context" 2026-09-19 17:45:15 +00:00
apiserpent
azure Merge pull request #40147 from abhirup7/fix/azure-image-generation-entra-id-auth 2026-09-19 04:44:07 -07:00
azure_ai Merge pull request #39424 from emerzon/litellm_azure_ai_flux_2_flex 2026-09-18 14:30:25 -07:00
base_llm feat(vertex_ai): stream Chirp speech-to-text over /v1/realtime 2026-09-17 17:57:40 -07:00
baseten/chat
bedrock Merge pull request #41904 from BerriAI/litellm_bedrock_batch_retrieve_sigv4_over_env_bearer 2026-09-18 18:33:10 -07:00
bedrock_mantle test(bedrock_mantle): document mantle in-region pricing invariant 2026-09-18 19:18:45 +00:00
black_forest_labs fix(image_edit): await an async transform hook and hide the URL policy verdict from callers 2026-09-04 23:20:21 -07:00
bytez/chat
cerebras test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
chat fix(bedrock): keep x-amzn-RequestId on chat error responses (#40089) 2026-09-07 17:16:47 -07:00
chatgpt test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
cloudflare
cohere test: drop tests that pin provider-owned cost map values 2026-09-18 03:55:51 +00:00
cometapi/chat
compactifai
crusoe test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
custom_httpx Merge remote-tracking branch 'origin/main' into litellm_mistral_ocr_batches 2026-09-18 21:51:33 -07:00
dashscope test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
databricks test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
datarobot
deepgram fix(deepgram): forward only the first model and language values to /listen 2026-09-18 21:29:29 +00:00
deepinfra
deepseek fix(cost): bill DeepSeek V4.1 Flash and V4 Pro at their off-peak rates outside peak hours 2026-09-19 04:31:55 -07:00
docker_model_runner
elevenlabs
fal_ai test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
fastcrw/search
featherless_ai/chat
fireworks_ai fix(cost_calc): coerce string fireworks rates and drop the match fall-through 2026-09-19 01:33:41 +00:00
gdc/chat
gemini test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
gigachat fix(gigachat): fold cached tokens back into prompt and total token counts 2026-08-31 15:16:44 -07:00
github_copilot
gradient_ai
groq test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
heroku
hosted_vllm fix(hosted_vllm): reject image edit params vLLM-Omni ignores 2026-09-08 20:11:01 -07:00
huggingface
inception test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
jina_ai/embedding
langflow
lemonade
litellm_proxy test(mcp): read SDK2 snake_case fields on CallToolResult 2026-09-19 00:36:03 +00:00
llamafile/chat
lm_studio
manus
meta/realtime fix(vertex_ai): carry turns across stream rotation and route by model info 2026-09-18 15:35:59 -07:00
meta_llama
minimax
mistral fix(mistral): read back files whose purpose Mistral never lets us upload as user_data 2026-09-19 03:04:45 -07:00
modelscope
mongodb/vector_stores fix: preserve MongoDB deadlines and secure remote sidecar transport 2026-09-07 23:43:21 -07:00
moonshot test: drop tests that pin provider-owned cost map values 2026-09-18 03:55:51 +00:00
nebius
neosantara
nimble/search
novita/chat
nscale/chat
nvidia_nim fix(proxy): reject mixed NIM model groups and strip the deployment model before the group in /nvidia_nim URLs 2026-09-15 23:34:22 +00:00
nvidia_riva
oci test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
ocr
ollama perf: move Anthropic, Vertex Anthropic, Ollama and HF template fetches off the event loop (#40311) 2026-09-08 15:53:43 -07:00
oobabooga/chat
openai Revert "Merge pull request #41220 from BerriAI/litellm_post_call_guardrail_context" 2026-09-19 17:45:15 +00:00
openai_like test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
openrouter
ovhcloud
parallel_ai test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
parasail
pass_through
perplexity test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
pg_vector/vector_stores
publicai
ragflow/chat
recraft
reducto test: keep the pinning-test removal free of unrelated reformatting 2026-09-18 04:27:28 +00:00
runwayml
s3_vectors fix(s3_vectors): reject a store id with an empty bucket or index part 2026-09-19 03:52:48 -07:00
sagemaker feat(bedrock): thread aws_session_tags into STS AssumeRole 2026-09-09 12:37:36 -07:00
sambanova
sap
scaleway
snowflake fix(async): move remote image fetches off the event loop for Snowflake, Bedrock invoke Claude, Mantle and Gemini 2026-09-04 17:48:56 -07:00
soniox test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
stability
tencent test: drop tests that pin provider-owned cost map values 2026-09-18 03:55:51 +00:00
tinyfish
together_ai/chat test(together_ai): drop the prefix-strip assertion, e2e covers it live 2026-09-16 13:58:38 -07:00
valkey/vector_stores fix(vector-store): route embeddings through router 2026-09-01 15:33:18 -07:00
vercel_ai_gateway
vertex_ai fix(gemini): drop ttl values whose expiry Google cannot store (past the year 9999) 2026-09-19 01:00:27 -07:00
volcengine
voyage fix(rerank): stamp a fresh response id when Voyage, watsonx, or Fireworks omit one 2026-09-13 01:34:22 -07:00
wandb test: keep behavior tests that read the cost map for a later fixture rewrite 2026-09-18 04:52:06 +00:00
watsonx fix(rerank): stamp a fresh response id when Voyage, watsonx, or Fireworks omit one 2026-09-13 01:34:22 -07:00
xai fix(xai): reject non-success stt responses before parsing 2026-09-19 01:22:25 +00:00
you_com
zai test: delete assertions that pin vendor cost map facts 2026-09-18 00:28:49 +00:00
test_cache_control_and_reasoning.py
test_file_content_block.py
test_file_search_responses.py fix(file_search): escape the dropped vector_store_id in the warning 2026-09-05 16:44:54 -07:00
test_lifecycle_fix.py
test_polling_url_origin_match.py
test_predibase_transformation.py