litellm/tests/test_litellm
2026-09-24 14:10:51 +05:30
..
a2a_protocol chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
batches chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
caching chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
chat_completions chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
completion_extras chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
containers chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
embeddings chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
endpoints chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
enterprise chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
expected_fine_tuning_api refactor: refactor testing 2026-03-28 18:39:32 -07:00
expected_responses_api_request chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
experimental_mcp_client chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
fixtures/together_ai_sync chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
google_genai chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
images chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
integrations chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
interactions chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
litellm_core_utils chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
llms chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
messages chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
ocr chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
passthrough chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
proxy chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
rag chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
rerank_api chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
responses chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
router_strategy chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
router_utils chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
rust_bridge chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
secret_managers chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
types chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
vector_stores chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
videos chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
__init__.py
conftest.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
log.txt
readme.md
test_a2a_registry_lookup.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_acompletion_session_reuse_e2e.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_add_deployment_no_master_key.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_aembedding_session_reuse_e2e.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_anthropic_beta_headers_filtering.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_anthropic_skills_transformation.py fix: encode upstream URL path identifiers 2026-04-29 22:02:39 -07:00
test_assert_ci_coverage.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_assert_workflow_dir_hygiene.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_audio_transcription_rust_bridge.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_auto_update_price_and_context_window_file.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_azure_ad_token_credential_resolution.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_azure_ai_grok_4_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_azure_ai_grok_4_6_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_baseten_glm_5_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_batch_completion_models_all_responses.py test(batches): move orphan tests into tests/test_litellm for CI coverage (#30510) 2026-06-16 10:20:59 -07:00
test_bedrock_marengo_embed_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_budget_ratchet_check.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_chat_ui_responses_session.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_check_licenses.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_mcp_operation_boundary.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_migrations_no_data_rewrites.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_py310_typing_imports.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_test_quality.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_type_discipline.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_circleci_path_filter.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_circleci_rust_toolchain.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_fable_5_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_opus_4_6_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_opus_4_8_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_opus_5_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_sonnet_5_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_cloudflare_workers_ai_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_completion_timeout_resolution.py fix(router): honor litellm_settings.request_timeout as an independent per-attempt timeout (#31119) 2026-06-23 14:22:54 -07:00
test_component_entrypoint.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_compression.py Prompt Compression - add it to the proxy (#25729) 2026-04-20 15:08:00 -07:00
test_conftest.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_conftest_isolation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_constants.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_container_router.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_cost_calculation_log_level.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_cost_calculator.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_cost_map_guard.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_count_tokens_public_api.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dashscope_image_generation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_daybreak_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_deepseek_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_default_branch.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_detect_changes.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dockerfile_apk_repository.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dockerfile_bedrock_realtime_extra.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dockerfile_non_root.py fix(docker.non_root): use numeric UID 65534 for K8s runAsNonRoot (#26268) 2026-04-22 18:00:04 -07:00
test_drop_params_env_var.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_e2e_egress_sentinel.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_eager_tiktoken_load.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_env_key_doc_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_exception_exports.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_exception_header_preservation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_exception_mapping_request_attribute.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_filter_out_litellm_params.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_fireworks_serverless_model_costs.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gate_slot_lock.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gemini_3_1_flash_lite_image_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gemini_tts_native_audio_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_get_blog_posts.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_git_hooks.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_5_4_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_5_5_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_image_cost_calculator.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_realtime_mode.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_groq_streaming_encoding.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_guardrail_exception_status_codes.py Litellm oss staging (#28161) 2026-05-18 16:27:44 -07:00
test_lazy_imports.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_lint_workflow_diff_gates.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_litellm_params_reserved_keys.py
test_logging.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_lowest_latency_zero_tokens.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_main.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_main_module_header.py Add main module header comment 2026-05-06 00:26:17 +00:00
test_mistral_medium_3_5_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_mistral_small_4_0_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_mistral_zai_glm_5_2_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_model_block_unblock.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_model_cost_aliases.py [Feat] - Ishaan main merge branch (#23596) 2026-03-14 09:40:00 -07:00
test_model_param_helper.py style: black format test_model_param_helper.py 2026-04-15 18:18:52 -07:00
test_model_prices_schema.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_model_response_normalization.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_muse_spark_1_1_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_muse_spark_1_2_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_muse_spark_1_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_mutation_report.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_nested_drop_params.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_non_chat_routes_open_llm_spans.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_openai_embedding_encoding_format_default.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_openai_service_tier_long_context_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_pre_commit_lint.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_prisma_generate_if_needed.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_process_helpers.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_project_alias_tracking.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_project_tags_pydantic.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_proxy_auth.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_rag_openai_ingestion.py chore: litellm oss staging (#30745) 2026-06-18 13:55:35 -07:00
test_rate_limit_error_unification.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_redact_string_in_error_paths.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_redis.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_redis_credential_provider.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_register_model_custom_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_register_model_zero_cost_persistence.py chore(oss): litellm oss staging 150626 (#30463) 2026-06-16 12:06:41 -07:00
test_replicate_model_key_format.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_responses_api_bridge_non_stream.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_responses_id_security.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_responses_streaming_container_ownership.py chore(oss): litellm oss staging 150626 (#30463) 2026-06-16 12:06:41 -07:00
test_retrieve_batch_bedrock_dispatch.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_block_helpers.py feat: litellm oss 110626 (#30202) 2026-06-11 22:30:26 -07:00
test_router_exception_redaction.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_google_genai.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_model_cost_isolation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_order_fallback.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_per_deployment_num_retries.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_redis_init.py
test_router_retry_backoff_headers.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_retry_non_retryable_errors.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_retry_policy_update.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_silent_experiment.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_streaming_fallback_metadata.py chore: litellm oss staging (#30968) 2026-06-23 07:31:44 -07:00
test_router_weighted_failover.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_ruff_strict_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_sambanova_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_secret_redaction.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_select_ui_test_scope.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_service_logger.py fix: missing span for guardrail passthrough (#29552) 2026-06-03 01:25:15 +00:00
test_setup_wizard.py test: test 2026-03-28 19:17:38 -07:00
test_shared_session_integration.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_ssl_verify_unit.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_stream_chunk_builder_annotations.py fix: merge annotations from all streaming chunks in stream_chunk_builder 2026-03-15 14:20:45 +05:30
test_stream_chunk_builder_citations.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_stream_chunk_builder_images.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_streaming_connection_cleanup.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_sync_together_ai_models.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_system_message_format_bug.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_test_quality_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_thinking_enabled.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_together_ai_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_type_check_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_type_discipline_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_typesafe_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_unit_shard_missing_paths.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_unit_shard_per_test_timeout.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_utils.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_utils_module_docstring.py Add utils module docstring 2026-05-06 00:42:49 +00:00
test_uuid_helper.py
test_vcr_safe_body_matcher.py test: stabilize batch VCR coverage and stop live upload/network leaks (#29477) 2026-06-02 16:11:52 -07:00
test_vertex_ai_xai_grok_prompt_caching_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_video_generation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_with_dashboard_node.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_xai_grok_4_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_xai_responses_auto_routing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py