litellm/tests/test_litellm
Sameer Kankute 058b6a66eb
Add custom_llm_provider support for video endpoints (non-generation) (#16121)
* fix model error for apis which don't need model

* fix print statments:

* fix mypy lint errors

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-11-01 12:09:11 -07:00
..
caching [Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000) 2025-09-30 16:49:35 -07:00
completion_extras/litellm_responses_transformation feat(openai/): convert chat completion tool calls to responses api 2025-10-10 19:41:11 -07:00
enterprise/enterprise_callbacks Perf speed up pytest (#15951) 2025-10-27 19:43:40 -07:00
experimental_mcp_client fix(mcp/): add ssl certificate settings for mcp clients 2025-10-06 18:36:05 -07:00
google_genai [Oct Staging Branch] (#15460) 2025-10-17 17:52:25 -07:00
integrations Add GitlabPromptCache and enable subfolder access (#15712) 2025-10-28 14:46:50 -07:00
litellm_core_utils Added fallback logic for detecting file content-type when S3 returns generic (#15635) 2025-10-29 08:24:20 -07:00
llms Add custom_llm_provider support for video endpoints (non-generation) (#16121) 2025-11-01 12:09:11 -07:00
passthrough fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
proxy (feat) Azure AI Vector Stores - support "virtual" indexes + create vector store on passthrough API (#16160) 2025-11-01 12:01:32 -07:00
responses fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
router_strategy fix: Prevent AttributeError for _get_tags_from_request_kwargs (#14735) 2025-09-19 15:21:02 -07:00
router_utils test 2025-09-06 16:38:43 -07:00
secret_managers test(test_get_azure_ad_token_provider.py): add unit test to ensure default azure credentials used in the right context 2025-09-11 16:07:32 -07:00
types [LLM Translation] Fix Model Usage not having text tokens (#13234) 2025-08-04 21:06:49 +05:30
vector_stores [Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query (#13787) 2025-08-19 15:39:36 -07:00
__init__.py [Feat] Add github co-pilot as a new LLM API provider (#12325) 2025-07-04 13:12:16 -07:00
conftest.py Perf speed up pytest (#15951) 2025-10-27 19:43:40 -07:00
log.txt fix: fix linting errors 2025-09-27 14:25:05 -07:00
readme.md Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_acompletion_session_reuse_e2e.py [Fix] - Sessions not being shared (#15388) 2025-10-09 16:57:40 -07:00
test_aembedding_session_reuse_e2e.py [Fix] - shared session parsing and usage issue (#15440) 2025-10-10 19:26:53 -07:00
test_azure_video_router.py Litellm sameer oct staging (#15806) 2025-10-24 12:17:22 -07:00
test_constants.py tes numeric constants 2025-10-29 18:23:38 -07:00
test_cost_calculation_log_level.py Enhance logging in cost calculation tests to ensure DEBUG level captures are accurate. Updated tests to set logger level before assertions and restored original logger level after execution. This improves reliability of log level checks in both cost and batch cost calculation tests. 2025-08-14 14:21:22 -07:00
test_cost_calculator.py claude-sonnet-4-5-20250929 fix 2025-10-31 18:20:52 -07:00
test_exception_mapping_request_attribute.py Added test 2025-09-29 21:43:31 +05:30
test_filter_out_litellm_params.py [Bug Fix] Exa Search API - ensure request params are sent to Exa AI (#15855) 2025-10-23 11:56:30 -07:00
test_groq_streaming_encoding.py [Bug] Fix: Vertex Mistral not working for streaming (#13952) 2025-08-25 17:39:40 -07:00
test_logging.py [Bug Fix] StandardLoggingPayload on cache_hits should track custom llm provider + DD LLM Obs span type (#12652) 2025-07-16 15:43:15 -07:00
test_lowest_latency_zero_tokens.py fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046) 2025-09-29 15:49:46 -07:00
test_main.py build: squash merge litellm_dev_10_10_2025_p1 2025-10-25 12:21:12 -07:00
test_redis.py fix: Apply max_connections configuration to Redis async client (#15797) 2025-10-22 09:19:08 -07:00
test_responses_id_security.py (security) Responses API - prevent User A from retrieving User B's response, if response.id is leaked (#15757) 2025-10-25 13:41:59 -07:00
test_router.py test fix claude-sonnet-4-5-20250929 2025-10-28 19:05:13 -07:00
test_router_google_genai.py test(gemini): Add unit tests for Google GenAI adapter 2025-09-29 18:51:35 +08:00
test_shared_session_integration.py feat: Add shared_session parameter for aiohttp ClientSession reuse 2025-09-19 01:46:53 -07:00
test_system_message_format_bug.py Ensure that function_call_prompt extends system messages following its current schema 2025-08-03 17:47:13 +02:00
test_utils.py test fix claude-sonnet-4-5-20250929 2025-10-28 19:05:13 -07:00
test_uuid_helper.py Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941) 2025-09-26 09:14:20 -07:00
test_video_generation.py Add custom_llm_provider support for video endpoints (non-generation) (#16121) 2025-11-01 12:09:11 -07:00

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py