litellm/tests/test_litellm
2026-09-24 16:53:08 -04:00
..
a2a_protocol chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
batches feat(vertex): native batch JSONL passthrough with cost tracking (#42810) 2026-09-24 12:35:34 -07:00
caching chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
chat_completions chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
completion_extras chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
containers chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
embeddings chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
endpoints chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
enterprise chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
expected_fine_tuning_api
expected_responses_api_request chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
experimental_mcp_client chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
files feat(vertex): native batch JSONL passthrough with cost tracking (#42810) 2026-09-24 12:35:34 -07:00
fixtures/together_ai_sync chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
google_genai chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
images chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
integrations fix(proxy): stop leaking periodic tasks on every DB config reload (#42784) 2026-09-24 15:42:36 -05:00
interactions chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
litellm_core_utils fix(logging): pass provider response headers to callbacks on every endpoint (#42824) 2026-09-24 13:01:12 -07:00
llms fix(bedrock): route unmapped openai family model ids to converse (#42713) 2026-09-24 13:08:27 -07:00
messages chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
ocr chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
passthrough chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
proxy fix(proxy): pass team member spend rows as jsonb so a $0 flush cannot poison the pool connection (#43029) 2026-09-24 20:44:56 +00:00
rag chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
rerank_api chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
responses chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
router_strategy fix(proxy): stop leaking periodic tasks on every DB config reload (#42784) 2026-09-24 15:42:36 -05:00
router_utils chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
rust_bridge feat(rust): shape Anthropic Messages requests natively (#42982) 2026-09-24 19:08:32 +00:00
secret_managers chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
types chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
vector_stores chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
videos chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
__init__.py
conftest.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
log.txt
readme.md
test_a2a_registry_lookup.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_acompletion_session_reuse_e2e.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_add_deployment_no_master_key.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_aembedding_session_reuse_e2e.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_anthropic_beta_headers_filtering.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_anthropic_skills_transformation.py
test_assert_ci_coverage.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_assert_workflow_dir_hygiene.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_audio_transcription_rust_bridge.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_auto_update_price_and_context_window_file.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_azure_ad_token_credential_resolution.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_azure_ai_grok_4_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_azure_ai_grok_4_6_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_baseten_glm_5_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_batch_completion_models_all_responses.py
test_bedrock_marengo_embed_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_budget_ratchet_check.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_chat_ui_responses_session.py
test_check_licenses.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_mcp_operation_boundary.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_migrations_no_data_rewrites.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_py310_typing_imports.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_test_quality.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_check_type_discipline.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_circleci_path_filter.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_circleci_rust_toolchain.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_fable_5_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_opus_4_6_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_opus_4_8_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_opus_5_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_claude_sonnet_5_config.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_cloudflare_workers_ai_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_completion_timeout_resolution.py
test_component_entrypoint.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_compression.py
test_conftest.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_conftest_isolation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_constants.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_container_router.py
test_cost_calculation_log_level.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_cost_calculator.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_cost_map_guard.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_count_tokens_public_api.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dashscope_image_generation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_daybreak_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_deepseek_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_default_branch.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_detect_changes.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dockerfile_apk_repository.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dockerfile_bedrock_realtime_extra.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_dockerfile_non_root.py
test_drop_params_env_var.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_e2e_egress_sentinel.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_eager_tiktoken_load.py
test_env_key_doc_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_exception_exports.py
test_exception_header_preservation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_exception_mapping_request_attribute.py
test_filter_out_litellm_params.py
test_fireworks_serverless_model_costs.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gate_slot_lock.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gemini_3_1_flash_lite_image_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gemini_tts_native_audio_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_get_blog_posts.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_git_hooks.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_5_4_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_5_5_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_image_cost_calculator.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt_realtime_mode.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_groq_streaming_encoding.py
test_guardrail_exception_status_codes.py
test_lazy_imports.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_lint_workflow_diff_gates.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_litellm_params_reserved_keys.py
test_logging.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_lowest_latency_zero_tokens.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_main.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_main_module_header.py
test_mistral_medium_3_5_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_mistral_small_4_0_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_mistral_zai_glm_5_2_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_model_block_unblock.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_model_cost_aliases.py
test_model_param_helper.py
test_model_prices_schema.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_model_response_normalization.py
test_muse_spark_1_1_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_muse_spark_1_2_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_muse_spark_1_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_mutation_report.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_nested_drop_params.py
test_non_chat_routes_open_llm_spans.py fix(logging): pass provider response headers to callbacks on every endpoint (#42824) 2026-09-24 13:01:12 -07:00
test_openai_embedding_encoding_format_default.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_openai_service_tier_long_context_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_pre_commit_lint.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_prisma_generate_if_needed.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_process_helpers.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_project_alias_tracking.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_project_tags_pydantic.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_proxy_auth.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_rag_openai_ingestion.py
test_rate_limit_error_unification.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_redact_string_in_error_paths.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_redis.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_redis_credential_provider.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_redis_disconnect.py fix(redis): guard missing async pool on shutdown 2026-09-24 14:11:57 +05:30
test_register_model_custom_pricing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_register_model_zero_cost_persistence.py
test_replicate_model_key_format.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_responses_api_bridge_non_stream.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_responses_id_security.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_responses_streaming_container_ownership.py
test_retrieve_batch_bedrock_dispatch.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router.py feat(vertex): native batch JSONL passthrough with cost tracking (#42810) 2026-09-24 12:35:34 -07:00
test_router_block_helpers.py
test_router_exception_redaction.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_google_genai.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_model_cost_isolation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_order_fallback.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_per_deployment_num_retries.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_redis_init.py
test_router_retry_backoff_headers.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_retry_non_retryable_errors.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_retry_policy_update.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_silent_experiment.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_router_streaming_fallback_metadata.py
test_router_weighted_failover.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_ruff_strict_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_sambanova_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_secret_redaction.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_select_ui_test_scope.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_service_logger.py
test_setup_wizard.py
test_shared_session_integration.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_ssl_verify_unit.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_stream_chunk_builder_annotations.py
test_stream_chunk_builder_citations.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_stream_chunk_builder_images.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_streaming_connection_cleanup.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_sync_together_ai_models.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_system_message_format_bug.py
test_test_quality_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_thinking_enabled.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_together_ai_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_type_check_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_type_discipline_gate.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_typesafe_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_unit_shard_missing_paths.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_unit_shard_per_test_timeout.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_utils.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_utils_module_docstring.py
test_uuid_helper.py
test_vcr_safe_body_matcher.py
test_vertex_ai_xai_grok_prompt_caching_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_video_generation.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_with_dashboard_node.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_xai_grok_4_3_model_metadata.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_xai_responses_auto_routing.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30

Testing for litellm/

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

  1. Increase test coverage of litellm/
  2. Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

  • litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
  • test_<filename>.py maps to litellm/<filename>.py