scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 89
litellm/tests/llm_translation
History
Krish Dholakia 010a4d44af
Fix passing standard optional params (#11124) 
* fix(main.py): use processed non-default-params as standard input params for langfuse

Fixes https://github.com/BerriAI/litellm/issues/11072

 Fixes https://github.com/BerriAI/litellm/issues/11096

* fix(main.py): rename variable to be more accurate

* test(test_langfuse_e2e_test.py): add router unit test for langfuse e2e testing

Prevent https://github.com/BerriAI/litellm/issues/11072 from happening again

* build: update lock

* fix(utils.py): refactor optional params function

make it easier to get the standardized non default params

* fix(utils.py): improve process non default params function

* fix(main.py): include provider specific params in processed non default params used in logging

ensures user can see any provider specific params on langfuse

 ensures user can see any provider specific params on langfus e
2025-05-24 12:12:31 -07:00
..
test_llm_response_utils Support caching on reasoning content + other fixes (#8973) 2025-03-04 21:12:16 -08:00
base_audio_transcription_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_embedding_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_llm_unit_tests.py Handle openai gpt file data + add openai 'supports_pdf_input' to all vision models + Support bedrock tool cache pointing (#10897) 2025-05-17 07:29:01 -07:00
base_rerank_unit_tests.py Add cost tracking for rerank via bedrock (#8691) 2025-02-20 21:00:18 -08:00
conftest.py aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598) 2025-01-06 21:39:11 -08:00
dog.wav (feat) Support audio param in responses streaming (#6312) 2024-10-18 19:16:14 +05:30
duck.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
gettysburg.wav Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
guinea.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
log.xt Litellm dev 04 05 2025 p2 (#9774) 2025-04-07 21:02:52 -07:00
Readme.md LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_aiohttp_openai.py (proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ (#7659) 2025-01-09 17:24:18 -08:00
test_anthropic_completion.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_anthropic_text_completion.py Easier user onboarding via SSO (#8187) 2025-02-02 23:02:33 -08:00
test_aws_base_llm.py (fix) BaseAWSLLM - cache IAM role credentials when used (#7775) 2025-01-14 20:16:22 -08:00
test_azure_ai.py test: update test due to cohere ssl issues 2025-05-19 20:07:57 -07:00
test_azure_o_series.py test azure o series 2025-04-02 09:46:45 -07:00
test_azure_openai.py test: update tests to new deployment model (#10142) 2025-04-18 14:22:12 -07:00
test_bedrock_completion.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_bedrock_dynamic_auth_params_unit_tests.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_bedrock_embedding.py fix: remove aws params from bedrock embedding request body (#8618) (#8696) 2025-02-24 10:04:58 -08:00
test_bedrock_invoke_tests.py [Bedrock] Fixes to only allow accepted fields for tool json schema (#10062) 2025-05-13 19:49:30 -07:00
test_bedrock_llama.py Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) 2025-05-06 16:06:24 -07:00
test_bedrock_nova_json.py Extract 'thinking' from nova response + Add 'drop_params' support for gpt-image-1 (#10680) 2025-05-08 23:01:38 -07:00
test_clarifai_completion.py (Refactor) Code Quality improvement - Use Common base handler for clarifai/ (#7125) 2024-12-09 21:04:48 -08:00
test_cloudflare.py (Refactor) Code Quality improvement - Use Common base handler for cloudflare/ provider (#7127) 2024-12-10 10:12:22 -08:00
test_cohere.py Migrate cohere to /v2/embed - adds support for output_dimensions param (#10809) 2025-05-13 23:06:56 -07:00
test_cohere_generate_api.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_convert_dict_to_image.py fix ImageObject conversion (#6584) 2024-11-04 15:46:43 -08:00
test_databricks.py fix(databricks/chat/transformation.py): handle empty headers case 2025-04-05 08:33:56 -07:00
test_deepgram.py Litellm dev 12 28 2024 p3 (#7464) 2024-12-28 19:18:58 -08:00
test_deepseek_completion.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_fireworks_ai_translation.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_gemini.py Support Anthropic web search tool + Add more google finish reason mapping (#10785) 2025-05-12 22:45:51 -07:00
test_gpt4o_audio.py Add gemini audio input support + handle special tokens in sagemaker response (#9640) 2025-03-29 19:23:09 -07:00
test_groq.py fix(spend_tracking_utils.py): revert api key pass through fix (#7977) 2025-01-24 21:04:36 -08:00
test_huggingface_chat_completion.py VertexAI non-jsonl file storage support (#9781) 2025-04-09 14:01:48 -07:00
test_infinity.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_jina_ai.py Litellm 12 02 2024 (#6994) 2024-12-02 22:00:01 -08:00
test_litellm_proxy_provider.py fix(transformation.py): correctly translate 'thinking' param for lite… (#9904) 2025-04-11 23:25:13 -07:00
test_mistral_api.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_nvidia_nim.py [Feat] Add tools support for Nvidia NIM (#10763) 2025-05-12 14:07:35 -07:00
test_openai.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_openai_o1.py test: override flaky test 2025-04-29 18:54:49 -07:00
test_optional_params.py Fix passing standard optional params (#11124) 2025-05-24 12:12:31 -07:00
test_prompt_caching.py (feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 2024-10-03 23:31:10 +05:30
test_prompt_factory.py Add DBRX Anthropic w/ thinking + response_format support (#9744) 2025-04-04 22:13:32 -07:00
test_rerank.py test: update tests to new deployment model (#10142) 2025-04-18 14:22:12 -07:00
test_router_llm_translation_tests.py test_prompt_caching 2025-02-26 09:29:15 -08:00
test_snowflake.py added mock_tests 2025-03-11 16:32:15 -04:00
test_text_completion.py Add inference providers support for Hugging Face (#8258) (#9738) (#9773) 2025-04-05 10:50:15 -07:00
test_text_completion_unit_tests.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_together_ai.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_triton.py fix(triton/completion/transformation.py): remove bad_words / stop wor… (#10163) 2025-04-19 11:23:37 -07:00
test_unit_test_bedrock_invoke.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_vertex.py Add vertex ai meta llama 4 support + handle tool call result in content for vertex ai (#10492) 2025-05-01 22:47:06 -07:00
test_voyage_ai.py Add unit test 2025-03-14 18:14:41 +01:00
test_watsonx.py Deepseek r1 support + watsonx qa improvements (#7907) 2025-01-21 23:13:15 -08:00
test_xai.py test fix xai 2025-05-24 07:25:47 -07:00

Readme.md

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.