litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00

History

mateo-berri e641864e6f test(e2e/ui): give the seeded users passwords that pass the default password policy The default password policy from #39381 (12+ chars with upper, lower, number, and special) makes globalSetup's POST /user/update with password "test" fail with a 400, so every role login in the UI e2e suite has been failing since that merge. Seed the roles, the noteam@test.local login, and the second-admin spec with policy-compliant passwords and update the scrypt hash in seed.sql to match.		2026-09-02 16:58:53 -07:00
..
agent_tests
audio_tests
base_sdk_tests
basic_proxy_startup_tests
batches_tests
benchmarks
code_coverage_tests	fix(agents): redact secret litellm_params fields from all /v1/agents responses (#39389 )	2026-09-02 14:28:44 -07:00
documentation_tests	Merge remote-tracking branch 'origin/main' into litellm_bedrock_messages_disconnect_billing	2026-08-31 08:58:37 -07:00
e2e	test(e2e/ui): give the seeded users passwords that pass the default password policy	2026-09-02 16:58:53 -07:00
enterprise	fix(prometheus): bound requested_model label cardinality on client failure paths	2026-09-01 10:34:58 -07:00
guardrails_tests
image_gen_tests
integration
litellm-proxy-extras	revert: default the proxy back to the v1 migration resolver	2026-09-01 12:56:08 -07:00
litellm_utils_tests	test(aiohttp): pin NO_PROXY so proxy env cannot hijack the refused-port probe	2026-08-28 12:45:46 -07:00
llm_responses_api_testing	fix(guardrails): deliver modify_response block as valid SSE on streaming chat and Responses	2026-08-31 16:01:39 -07:00
llm_translation	test: exempt MockTransport request-shape embedding tests from VCR replay	2026-09-01 13:29:12 -07:00
load_tests
local_testing	Merge pull request #39185 from BerriAI/litellm_fix_embedding_encoding_format_suite_break	2026-09-01 13:52:51 -07:00
logging_callback_tests	test(bedrock): type the router parameter on the knowledge base search fake	2026-09-02 16:03:39 -07:00
mcp_tests	fix(mcp): follow tools/list pagination from upstream servers (#39172 )	2026-09-01 14:34:14 -07:00
multi_instance_e2e_tests
ocr_tests	fix(vertex): avoid duplicate DeepSeek OCR model namespace	2026-09-01 14:39:15 -07:00
openai_endpoints_tests	test(responses): expect the bad-temperature 400 on a non-reasoning model	2026-08-29 01:58:15 -07:00
otel_tests
pass_through_tests	fix(anthropic_messages): dispatch deferred spend logging when the client disconnects mid-relay	2026-08-31 10:17:27 -07:00
pass_through_unit_tests	test(websearch): carry a reasoned test-quality suppression on the router patch	2026-08-31 22:32:05 -07:00
proxy_admin_ui_tests	test(access-groups): give each xdist worker its own fixture ids	2026-08-28 09:35:12 -07:00
proxy_behavior
proxy_e2e_anthropic_messages_tests
proxy_migration_tests	test(proxy-extras): use the modern optional annotation in the deploy budget test	2026-09-02 12:36:29 -07:00
proxy_security_tests
proxy_unit_tests	fix(proxy): share per-model budget counters across replicas through the spend counter cache (#39375 )	2026-09-02 12:40:59 -07:00
router_unit_tests	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_containers_route_model_list_creds	2026-09-02 19:10:45 +00:00
rust-python-harness	test: add interactive Rust Python parity harness (#39419 )	2026-09-02 15:51:08 -07:00
sdk_function_trace	refactor(python-bridge): split routes and add shared function tracing (#39031 )	2026-09-02 16:26:35 -07:00
search_tests
spend_tracking_tests
store_model_in_db_tests
test_litellm	Merge pull request #39091 from BerriAI/litellm_techdebt_20260901	2026-09-02 16:46:52 -07:00
unified_google_tests
vector_store_tests
windows_tests
__init__.py
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py
_openai_record_replay_proxy.py
_vcr_conftest_common.py
_vcr_redis_persister.py
_wait_helpers.py
_ws_vcr.py
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py	test: fix staging CI regressions from #38182 , #38144 , #38265 , #37962 , and #37969	2026-08-25 23:01:20 -07:00
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_new_vector_store_endpoints.py
test_openai_endpoints.py
test_organizations.py
test_otel_thread_leak.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py
test_resource_cleanup.py
test_rust_python_harness.py	test: add interactive Rust Python parity harness (#39419 )	2026-09-02 15:51:08 -07:00
test_service_logger_otel.py
test_spend_logs.py
test_team.py
test_team_logging.py
test_team_members.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.