litellm/tests
2026-09-24 22:35:55 +05:30
..
_support chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
agent_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
audio_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
base_sdk_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
basic_proxy_startup_tests build: migrate packaging, CI, and Docker from Poetry to uv (#25007) 2026-04-09 11:46:23 -07:00
batches_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
benchmarks chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
code_coverage_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
documentation_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
e2e chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
enterprise chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
guardrails_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
image_gen_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
integration chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
litellm-proxy-extras chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
litellm_utils_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
llm_responses_api_testing chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
llm_translation chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
load_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
local_testing chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
logging_callback_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
mcp_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
multi_instance_e2e_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
ocr_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
openai_endpoints_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
otel_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
pass_through_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
pass_through_unit_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
proxy_admin_ui_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
proxy_behavior chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
proxy_e2e_anthropic_messages_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
proxy_migration_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
proxy_security_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
proxy_unit_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
router_unit_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
rust-python-harness chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
search_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
spend_tracking_tests chore(ci): modernize model references in tests and configs (#27856) 2026-05-15 15:44:28 -07:00
store_model_in_db_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_gateway chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_litellm test(sse): update expectations for normalized vendor error codes 2026-09-24 22:35:55 +05:30
test_litellm_rust chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
unified_google_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
unit chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
vector_store_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
windows_tests chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
__init__.py
_fake_openai_endpoint_server.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
_flush_vcr_cache.py tests(vcr): isolate cassette redis to CASSETTE_REDIS_URL 2026-05-01 12:32:59 -07:00
_live_test_helpers.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
_openai_record_replay_proxy.py Extend the record/replay proxy to chat, embeddings, moderations, rerank, and Anthropic (#29847) 2026-06-06 14:33:42 -07:00
_process_helpers.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
_vcr_conftest_common.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
_vcr_redis_persister.py test(vcr): stop refreshing cassette TTL on read so cassettes lapse after 24h (#29784) 2026-06-05 10:22:41 -07:00
_wait_helpers.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
_ws_vcr.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
AGENTS.md chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
capturing_transport.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
eval_swe_bench.py Prompt Compression - add it to the proxy (#25729) 2026-04-20 15:08:00 -07:00
fake_openai_endpoint.py test: point router/completion/triton tests at the local fake OpenAI endpoint (#30900) 2026-06-20 16:20:35 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json test: add e2e tests for spend, budgets and llms (#30869) 2026-06-24 15:01:57 -07:00
README.MD
test_anthropic_compaction_usage.py chore(oss): litellm oss staging 150626 (#30463) 2026-06-16 12:06:41 -07:00
test_budget_management.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_callbacks_on_proxy.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_debug_warning.py
test_default_encoding_non_root.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_end_users.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_fallbacks.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_gpt5_azure_temperature_support.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_health.py fix(tests): swap dall-e to gpt-image-1 after openai deprecation 2026-05-12 16:55:18 -07:00
test_keys.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_litellm_proxy_responses_config.py chore(ci): modernize model references in tests and configs (#27856) 2026-05-15 15:44:28 -07:00
test_logging.conf
test_models.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_new_vector_store_endpoints.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_openai_endpoints.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_organizations.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_otel_thread_leak.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_presidio_latency.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_proxy_server_non_root.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_ratelimit.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_resource_cleanup.py style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
test_rust_python_harness.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_service_logger_otel.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_spend_logs.py Litellm oss staging 04 21 2026 2 (#26569) 2026-05-20 21:25:19 -07:00
test_team.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_team_logging.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_team_members.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30
test_users.py chore: sync branch with upstream main 2026-09-24 09:17:57 +05:30

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.