scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-22 00:31:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 51
litellm/tests/llm_translation
History
Nathan Brake 1c4fdb4a8f
Enhance Mistral API: Add support for parallel tool calls (#11770) 
* Enhance Mistral API: Add support for parallel tool calls and refine name handling in tool messages. Plus, introduce a new test for parallel tool calls in the Mistral model.

* tests

* make mypy happy

* Refine name handling in Mistral chat transformation: clarify conditions for removing the 'name' field based on message role and content.
2025-06-19 20:12:39 -07:00
..
test_llm_response_utils Support caching on reasoning content + other fixes (#8973) 2025-03-04 21:12:16 -08:00
base_audio_transcription_unit_tests.py [Feat] Perf fix - ensure deepgram provider uses async httpx calls (#11641) 2025-06-11 18:32:01 -07:00
base_embedding_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_llm_unit_tests.py Ensure consistent 'created' across all chunks + set tool call id for ollama streaming calls (#11528) 2025-06-07 20:50:07 -07:00
base_rerank_unit_tests.py Add cost tracking for rerank via bedrock (#8691) 2025-02-20 21:00:18 -08:00
conftest.py aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598) 2025-01-06 21:39:11 -08:00
dog.wav (feat) Support audio param in responses streaming (#6312) 2024-10-18 19:16:14 +05:30
duck.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
gettysburg.wav Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
guinea.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
log.xt Litellm dev 04 05 2025 p2 (#9774) 2025-04-07 21:02:52 -07:00
Readme.md LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_aiohttp_openai.py (proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ (#7659) 2025-01-09 17:24:18 -08:00
test_anthropic_completion.py Add model access groups on UI (#11719) 2025-06-13 21:20:25 -07:00
test_anthropic_text_completion.py Easier user onboarding via SSO (#8187) 2025-02-02 23:02:33 -08:00
test_aws_base_llm.py (fix) BaseAWSLLM - cache IAM role credentials when used (#7775) 2025-01-14 20:16:22 -08:00
test_azure_ai.py Litellm dev 06 18 2025 p1 (#11872) 2025-06-18 21:24:36 -07:00
test_azure_o_series.py test azure o series 2025-04-02 09:46:45 -07:00
test_azure_openai.py Convert scientific notation str to int + Bubble up azure content filter results (#11655) 2025-06-11 23:07:22 -07:00
test_bedrock_agents.py [Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM (#11239) 2025-05-29 16:48:55 -07:00
test_bedrock_completion.py test: update test 2025-06-06 09:15:08 -07:00
test_bedrock_dynamic_auth_params_unit_tests.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_bedrock_embedding.py fix: remove aws params from bedrock embedding request body (#8618) (#8696) 2025-02-24 10:04:58 -08:00
test_bedrock_invoke_tests.py [Bedrock] Fixes to only allow accepted fields for tool json schema (#10062) 2025-05-13 19:49:30 -07:00
test_bedrock_llama.py Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) 2025-05-06 16:06:24 -07:00
test_bedrock_nova_json.py Extract 'thinking' from nova response + Add 'drop_params' support for gpt-image-1 (#10680) 2025-05-08 23:01:38 -07:00
test_clarifai_completion.py (Refactor) Code Quality improvement - Use Common base handler for clarifai/ (#7125) 2024-12-09 21:04:48 -08:00
test_cloudflare.py (Refactor) Code Quality improvement - Use Common base handler for cloudflare/ provider (#7127) 2024-12-10 10:12:22 -08:00
test_cohere.py feat: Add support for Cohere Embed v4.0 model (#11329) 2025-06-02 11:25:29 -07:00
test_cohere_generate_api.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_convert_dict_to_image.py Fix None values in usage field for gpt-image-1 model responses (#11448) 2025-06-05 13:19:18 -07:00
test_databricks.py fix(databricks/chat/transformation.py): handle empty headers case 2025-04-05 08:33:56 -07:00
test_deepgram.py Litellm dev 12 28 2024 p3 (#7464) 2024-12-28 19:18:58 -08:00
test_deepseek_completion.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_fireworks_ai_translation.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_gemini.py set flaky tests as flaky 2025-06-14 13:51:52 -07:00
test_gpt4o_audio.py Add gemini audio input support + handle special tokens in sagemaker response (#9640) 2025-03-29 19:23:09 -07:00
test_groq.py fix(spend_tracking_utils.py): revert api key pass through fix (#7977) 2025-01-24 21:04:36 -08:00
test_huggingface_chat_completion.py fix inference endpoints (#11630) (#11631) 2025-06-11 10:45:54 -07:00
test_infinity.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_jina_ai.py Litellm 12 02 2024 (#6994) 2024-12-02 22:00:01 -08:00
test_litellm_proxy_provider.py fix(transformation.py): correctly translate 'thinking' param for lite… (#9904) 2025-04-11 23:25:13 -07:00
test_mistral_api.py Enhance Mistral API: Add support for parallel tool calls (#11770) 2025-06-19 20:12:39 -07:00
test_nvidia_nim.py [Feat] Add tools support for Nvidia NIM (#10763) 2025-05-12 14:07:35 -07:00
test_openai.py test: update unit testing 2025-06-14 08:41:34 -07:00
test_openai_o1.py test: override flaky test 2025-04-29 18:54:49 -07:00
test_optional_params.py Support returning virtual key in custom auth + Handle provider-specific optional params for embedding calls (#11346) 2025-06-03 07:24:13 -07:00
test_perplexity_reasoning.py [Feat] Add reasoning_effort support for perplexity models (#11562) 2025-06-09 17:07:31 -07:00
test_prompt_caching.py (feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 2024-10-03 23:31:10 +05:30
test_prompt_factory.py Add DBRX Anthropic w/ thinking + response_format support (#9744) 2025-04-04 22:13:32 -07:00
test_rerank.py test: update tests to new deployment model (#10142) 2025-04-18 14:22:12 -07:00
test_router_llm_translation_tests.py test_prompt_caching 2025-02-26 09:29:15 -08:00
test_snowflake.py added mock_tests 2025-03-11 16:32:15 -04:00
test_text_completion.py Add inference providers support for Hugging Face (#8258) (#9738) (#9773) 2025-04-05 10:50:15 -07:00
test_text_completion_unit_tests.py test: fixes 2025-05-31 12:42:56 -07:00
test_together_ai.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_triton.py fix(triton/completion/transformation.py): remove bad_words / stop wor… (#10163) 2025-04-19 11:23:37 -07:00
test_unit_test_bedrock_invoke.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_voyage_ai.py Add unit test 2025-03-14 18:14:41 +01:00
test_watsonx.py Support env var vertex credentials for passthrough + ignore space id on watsonx deployment (throws Json validation errors) (#11527) 2025-06-07 20:31:05 -07:00
test_xai.py test_xai_check_for_stop_in_supported_params 2025-06-14 16:33:38 -07:00

Readme.md

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.