scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-12 23:01:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 89
litellm/tests/llm_translation
History
Exact
Jugal D. Bhatt aea0605eed
[LLM Translation] Fix Realtime API endpoint for no intent (#13476) 
* fix intent params

* Add responses

* fix unrelated test

* test fix - fireworks API endpoint is down

* test fix fireworks ai is having an active outage

* test_completion_cost_databricks

* dbrx fix test API currently not responding

* Update OpenAI Realtime handler to use the correct endpoint and include all query parameters. Adjusted error messages for missing API base and key. Updated health check URL construction to pass model as a query parameter.

* Enhance OpenAI Realtime handler tests to ensure model parameter inclusion in WebSocket URL. Added new tests to verify correct URL construction with model and additional parameters, preventing 'missing_model' errors. Updated existing tests for consistency.

* Remove debug print statements for API base and key in OpenAIRealtime handler to clean up the code.

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-08-14 16:24:14 -07:00
..
test_llm_response_utils Support caching on reasoning content + other fixes (#8973) 2025-03-04 21:12:16 -08:00
base_audio_transcription_unit_tests.py [Feat] Perf fix - ensure deepgram provider uses async httpx calls (#11641) 2025-06-11 18:32:01 -07:00
base_embedding_unit_tests.py Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
base_llm_unit_tests.py test_function_calling_with_tool_response 2025-08-05 09:55:47 -07:00
base_rerank_unit_tests.py Add cost tracking for rerank via bedrock (#8691) 2025-02-20 21:00:18 -08:00
conftest.py aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598) 2025-01-06 21:39:11 -08:00
dog.wav (feat) Support audio param in responses streaming (#6312) 2024-10-18 19:16:14 +05:30
duck.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
gettysburg.wav Litellm dev 12 25 2025 p2 (#7420) 2024-12-25 18:35:34 -08:00
guinea.png fix vertex ai multimodal embedding translation (#9471) 2025-03-24 23:23:28 -07:00
log.xt Litellm dev 04 05 2025 p2 (#9774) 2025-04-07 21:02:52 -07:00
Readme.md LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965) 2024-12-01 05:24:11 -08:00
test_aiohttp_openai.py (proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ (#7659) 2025-01-09 17:24:18 -08:00
test_anthropic_completion.py VertexAI - camelcase optional params for image generation + Anthropic - streaming, always ensure assistant role set on only first chunk (#12889) 2025-07-27 10:09:43 -07:00
test_aws_base_llm.py (fix) BaseAWSLLM - cache IAM role credentials when used (#7775) 2025-01-14 20:16:22 -08:00
test_azure_ai.py [Bug Fix]: Azure OpenAI GPT-5 max_tokens + reasoning param support (#13510) 2025-08-11 15:40:53 -07:00
test_azure_o_series.py test azure o series 2025-04-02 09:46:45 -07:00
test_azure_openai.py Anthropic /v1/messages - Custom LLM Server support (#12016) 2025-06-24 22:00:44 -07:00
test_bedrock_agents.py Add 'audio_url' message type support for VLLM (#12270) 2025-07-02 20:37:45 -07:00
test_bedrock_completion.py Bedrock Passthrough cost tracking (/invoke + /converse routes - streaming + non-streaming) (#12123) 2025-06-27 20:01:12 -07:00
test_bedrock_dynamic_auth_params_unit_tests.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_bedrock_embedding.py fix: remove aws params from bedrock embedding request body (#8618) (#8696) 2025-02-24 10:04:58 -08:00
test_bedrock_govcloud.py [LLM Translation] Add Gov Cloud bedrock model pricing and context windows (#12773) 2025-07-19 16:12:05 -07:00
test_bedrock_gpt_oss.py [Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346) 2025-08-12 08:39:36 -07:00
test_bedrock_invoke_tests.py [Bedrock] Fixes to only allow accepted fields for tool json schema (#10062) 2025-05-13 19:49:30 -07:00
test_bedrock_llama.py Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) 2025-05-06 16:06:24 -07:00
test_bedrock_nova_json.py Extract 'thinking' from nova response + Add 'drop_params' support for gpt-image-1 (#10680) 2025-05-08 23:01:38 -07:00
test_clarifai_completion.py (Refactor) Code Quality improvement - Use Common base handler for clarifai/ (#7125) 2024-12-09 21:04:48 -08:00
test_cloudflare.py (Refactor) Code Quality improvement - Use Common base handler for cloudflare/ provider (#7127) 2024-12-10 10:12:22 -08:00
test_cohere.py feat: Add support for Cohere Embed v4.0 model (#11329) 2025-06-02 11:25:29 -07:00
test_cohere_generate_api.py fix(acompletion): support fallbacks on acompletion (#7184) 2024-12-11 19:20:54 -08:00
test_convert_dict_to_image.py Fix None values in usage field for gpt-image-1 model responses (#11448) 2025-06-05 13:19:18 -07:00
test_databricks.py test: skip dbrx claude 3-7 sonnet test - rate limit errors 2025-07-28 17:34:42 -07:00
test_deepgram.py Litellm dev 12 28 2024 p3 (#7464) 2024-12-28 19:18:58 -08:00
test_deepseek_completion.py test_completion_cost_deepseek 2025-07-23 13:16:12 -07:00
test_elevenlabs.py [Feat] Add Eleven Labs - Speech To Text Support on LiteLLM (#12119) 2025-06-27 17:50:49 -07:00
test_fireworks_ai_translation.py [LLM Translation] Fix Realtime API endpoint for no intent (#13476) 2025-08-14 16:24:14 -07:00
test_gemini.py [Bug Fix] Mistral Tool Calling - Grammar error: at 3(11): failed to compile JSON schema (#13389) 2025-08-07 13:50:22 -07:00
test_gpt4o_audio.py Add gemini audio input support + handle special tokens in sagemaker response (#9640) 2025-03-29 19:23:09 -07:00
test_groq.py fix(spend_tracking_utils.py): revert api key pass through fix (#7977) 2025-01-24 21:04:36 -08:00
test_huggingface_chat_completion.py Revert "Revert "fix tests (#12286)"" 2025-07-03 12:08:27 -07:00
test_hyperbolic.py Revert "Litellm dev 07 21 2025 p1 (#12848)" 2025-07-22 18:28:36 -07:00
test_infinity.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_jina_ai.py Litellm 12 02 2024 (#6994) 2024-12-02 22:00:01 -08:00
test_lambda_ai.py Revert "Litellm dev 07 21 2025 p1 (#12848)" 2025-07-22 18:28:36 -07:00
test_litellm_proxy_provider.py LiteLLM SDK <-> Proxy: support user param + Prisma - remove use_prisma_migrate flag - redundant as this is now default (#13555) 2025-08-12 22:03:39 -07:00
test_mistral_api.py TestMistralCompletion 2025-07-19 15:37:13 -07:00
test_morph.py fix morph api tests 2025-07-22 18:44:44 -07:00
test_nvidia_nim.py [Feat] Add tools support for Nvidia NIM (#10763) 2025-05-12 14:07:35 -07:00
test_openai.py [Bug Fix] - Allow using reasoning_effort for gpt-5 model family and reasoning for Responses API (#13475) 2025-08-10 09:55:36 -07:00
test_openai_o1.py test: remove o1-preview 2025-07-28 17:47:57 -07:00
test_openai_realtime.py [LLM Translation] Fix Realtime API endpoint for no intent (#13476) 2025-08-14 16:24:14 -07:00
test_optional_params.py VertexAI - camelcase optional params for image generation + Anthropic - streaming, always ensure assistant role set on only first chunk (#12889) 2025-07-27 10:09:43 -07:00
test_perplexity_reasoning.py [Feat] Add reasoning_effort support for perplexity models (#11562) 2025-06-09 17:07:31 -07:00
test_prompt_caching.py (feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 2024-10-03 23:31:10 +05:30
test_prompt_factory.py Add DBRX Anthropic w/ thinking + response_format support (#9744) 2025-04-04 22:13:32 -07:00
test_rerank.py test: update tests to new deployment model (#10142) 2025-04-18 14:22:12 -07:00
test_router_llm_translation_tests.py test_prompt_caching 2025-02-26 09:29:15 -08:00
test_snowflake.py ruff check ./litellm --fix 2025-07-12 11:04:02 -07:00
test_text_completion.py Add inference providers support for Hugging Face (#8258) (#9738) (#9773) 2025-04-05 10:50:15 -07:00
test_text_completion_unit_tests.py test: fixes 2025-05-31 12:42:56 -07:00
test_together_ai.py [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
test_triton.py fix(triton/completion/transformation.py): remove bad_words / stop wor… (#10163) 2025-04-19 11:23:37 -07:00
test_unit_test_bedrock_invoke.py Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724) 2025-05-10 17:41:57 -07:00
test_v0.py feat: add v0 provider support (#12751) 2025-07-18 18:26:44 -07:00
test_voyage_ai.py Add unit test 2025-03-14 18:14:41 +01:00
test_watsonx.py Support env var vertex credentials for passthrough + ignore space id on watsonx deployment (throws Json validation errors) (#11527) 2025-06-07 20:31:05 -07:00
test_xai.py test fix xai - it goes through base llm tests already 2025-07-30 18:18:49 -07:00

Readme.md

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.