litellm/tests
2026-09-24 16:53:08 -04:00
..
_support chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
agent_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
audio_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
base_sdk_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
basic_proxy_startup_tests
batches_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
benchmarks chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
code_coverage_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
documentation_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
e2e fix(bedrock): route unmapped openai family model ids to converse (#42713) 2026-09-24 13:08:27 -07:00
enterprise fix(prometheus): add model_group label to deployment request and rate limit metrics (#42966) 2026-09-24 12:15:01 -07:00
guardrails_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
image_gen_tests fix(logging): pass provider response headers to callbacks on every endpoint (#42824) 2026-09-24 13:01:12 -07:00
integration fix(proxy): pass team member spend rows as jsonb so a $0 flush cannot poison the pool connection (#43029) 2026-09-24 20:44:56 +00:00
litellm-proxy-extras chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
litellm_utils_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
llm_responses_api_testing chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
llm_translation fix(logging): pass provider response headers to callbacks on every endpoint (#42824) 2026-09-24 13:01:12 -07:00
load_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
local_testing test(ollama): assert the images sent to Ollama instead of echoing them through response (#42905) 2026-09-24 11:54:26 -07:00
logging_callback_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
mcp_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
multi_instance_e2e_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
ocr_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
openai_endpoints_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
otel_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
pass_through_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
pass_through_unit_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
proxy_admin_ui_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
proxy_behavior feat(proxy): server-side Team Usage export beyond the top-N key cap (#42996) 2026-09-24 15:40:36 -05:00
proxy_e2e_anthropic_messages_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
proxy_migration_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
proxy_security_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
proxy_unit_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
router_unit_tests feat(vertex): native batch JSONL passthrough with cost tracking (#42810) 2026-09-24 12:35:34 -07:00
rust-python-harness chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
search_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
spend_tracking_tests
store_model_in_db_tests test(mcp): patch create_mcp_server_if_identifier_free in the store-model-in-db MCP tests (#42916) 2026-09-24 11:59:52 -07:00
test_gateway chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_litellm Merge 5e843bcfde into 5e4b1b9df0 2026-09-24 16:53:08 -04:00
test_litellm_rust feat(rust): shape Anthropic Messages requests natively (#42982) 2026-09-24 19:08:32 +00:00
unified_google_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
unit fix(logging): pass provider response headers to callbacks on every endpoint (#42824) 2026-09-24 13:01:12 -07:00
vector_store_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
windows_tests chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
__init__.py
_fake_openai_endpoint_server.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
_flush_vcr_cache.py
_live_test_helpers.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
_openai_record_replay_proxy.py
_process_helpers.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
_vcr_conftest_common.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
_vcr_redis_persister.py
_wait_helpers.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
_ws_vcr.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
AGENTS.md chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
capturing_transport.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_fallbacks.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_new_vector_store_endpoints.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_openai_endpoints.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_organizations.py
test_otel_thread_leak.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_resource_cleanup.py
test_rust_python_harness.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_service_logger_otel.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_spend_logs.py
test_team.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_team_logging.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_team_members.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30
test_users.py chore: sync branch with upstream main 2026-09-24 14:10:51 +05:30

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.