litellm/tests/llm_translation
Krish Dholakia c10ae8879e
fix(vertex_ai/gemini/transformation.py): handle 'http://' in gemini p… (#7660)
* fix(vertex_ai/gemini/transformation.py): handle 'http://' in gemini process url

* refactor(router.py): refactor '_prompt_management_factory' to use logging obj get_chat_completion logic

deduplicates code

* fix(litellm_logging.py): update 'get_chat_completion_prompt' to update logging object messages

* docs(prompt_management.md): update prompt management to be in beta

given feedback - this still needs to be revised (e.g. passing in user message, not ignoring)

* refactor(prompt_management_base.py): introduce base class for prompt management

allows consistent behaviour across prompt management integrations

* feat(prompt_management_base.py): support adding client message to template message + refactor langfuse prompt management to use prompt management base

* fix(litellm_logging.py): log prompt id + prompt variables to langfuse if set

allows tracking what prompt was used for what purpose

* feat(litellm_logging.py): log prompt management metadata in standard logging payload + use in langfuse

allows logging prompt id / prompt variables to langfuse

* test: fix test

* fix(router.py): cleanup unused imports

* fix: fix linting error

* fix: fix trace param typing

* fix: fix linting errors

* fix: fix code qa check
2025-01-10 07:31:59 -08:00
..
test_llm_response_utils LiteLLM Minor Fixes & Improvements (10/23/2024) (#6407) 2024-10-24 19:01:41 -07:00
base_audio_transcription_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_embedding_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_llm_unit_tests.py Litellm dev 12 30 2024 p1 (#7480) 2024-12-30 21:52:52 -08:00
base_rerank_unit_tests.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
conftest.py aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598) 2025-01-06 21:39:11 -08:00
dog.wav (feat) Support audio param in responses streaming (#6312) 2024-10-18 19:16:14 +05:30
gettysburg.wav Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
Readme.md LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_aiohttp_openai.py (proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ (#7659) 2025-01-09 17:24:18 -08:00
test_anthropic_completion.py Litellm dev 01 07 2025 p2 (#7622) 2025-01-08 16:56:39 -08:00
test_anthropic_text_completion.py [Bug Fix]: ImportError: cannot import name 'T' from 're' (#7314) 2024-12-19 13:09:30 -08:00
test_azure_ai.py Litellm dev 12 30 2024 p2 (#7495) 2025-01-01 18:57:29 -08:00
test_azure_o1.py Litellm dev 12 30 2024 p1 (#7480) 2024-12-30 21:52:52 -08:00
test_azure_openai.py (Feat) - LiteLLM Use UsernamePasswordCredential for Azure OpenAI (#7496) 2025-01-01 14:11:27 -08:00
test_bedrock_completion.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
test_clarifai_completion.py (Refactor) Code Quality improvement - Use Common base handler for clarifai/ (#7125) 2024-12-09 21:04:48 -08:00
test_cloudflare.py (Refactor) Code Quality improvement - Use Common base handler for cloudflare/ provider (#7127) 2024-12-10 10:12:22 -08:00
test_cohere.py (Refactor) Code Quality improvement - use Common base handler for Cohere (#7117) 2024-12-09 17:45:29 -08:00
test_cohere_generate_api.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_convert_dict_to_image.py fix ImageObject conversion (#6584) 2024-11-04 15:46:43 -08:00
test_databricks.py Litellm dev 12 25 2024 p1 (#7411) 2024-12-25 17:36:30 -08:00
test_deepgram.py Litellm dev 12 28 2024 p3 (#7464) 2024-12-28 19:18:58 -08:00
test_deepseek_completion.py test_multilingual_requests deepseek 2024-12-03 20:40:02 -08:00
test_fireworks_ai_translation.py Litellm dev 12 28 2024 p2 (#7458) 2024-12-28 19:38:06 -08:00
test_gemini.py LiteLLM Minor Fixes & Improvements (12/23/2024) - p3 (#7394) 2024-12-23 22:02:52 -08:00
test_gpt4o_audio.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_groq.py Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
test_huggingface.py Litellm dev 12 25 2024 p1 (#7411) 2024-12-25 17:36:30 -08:00
test_infinity.py (feat) add infinity rerank models (#7321) 2024-12-19 18:30:28 -08:00
test_jina_ai.py Litellm 12 02 2024 (#6994) 2024-12-02 22:00:01 -08:00
test_max_completion_tokens.py Litellm dev 12 24 2024 p3 (#7403) 2024-12-24 18:07:53 -08:00
test_mistral_api.py test_multilingual_requests 2024-12-03 20:52:19 -08:00
test_nvidia_nim.py LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_openai.py update tests 2025-01-06 22:36:00 -08:00
test_openai_o1.py test: override openai o1 prompt caching test - openai backend not caching right now 2024-12-24 16:49:48 -08:00
test_optional_params.py Litellm dev 01 01 2025 p2 (#7615) 2025-01-07 21:40:33 -08:00
test_prompt_caching.py (feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 2024-10-03 23:31:10 +05:30
test_prompt_factory.py Code Quality Improvement - use vertex_ai/ as folder name for vertexAI (#7166) 2024-12-11 00:32:41 -08:00
test_rerank.py test_rerank_response_assertions (#7476) 2024-12-30 10:12:56 -08:00
test_router_llm_translation_tests.py Litellm add router to base llm testing (#7202) 2024-12-13 19:16:28 -08:00
test_text_completion.py (fix) litellm.text_completion raises a non-blocking error on simple usage (#6546) 2024-11-04 15:47:48 -08:00
test_text_completion_unit_tests.py LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_together_ai.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
test_triton.py [Bug fix ]: Triton /infer handler incompatible with batch responses (#7337) 2024-12-20 20:59:40 -08:00
test_vertex.py fix(vertex_ai/gemini/transformation.py): handle 'http://' in gemini p… (#7660) 2025-01-10 07:31:59 -08:00
test_voyage_ai.py (fix) unable to pass input_type parameter to Voyage AI embedding mode (#7276) 2024-12-17 19:23:49 -08:00
test_watsonx.py Support checking provider-specific /models endpoints for available models based on key (#7538) 2025-01-03 19:29:59 -08:00
test_xai.py ci/cd run again 2025-01-05 14:11:27 -08:00

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.