litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-15 23:31:29 +00:00

History

Mateo Wang c2c2a623c0 Some checks are pending ai-gateway image / ai-gateway release image (push) Waiting to run Details CI Coverage / assert-ci-coverage (push) Waiting to run Details CodSpeed Benchmarks / benchmarks (push) Waiting to run Details Publish basedpyright base counts / publish (push) Waiting to run Details Code Quality Checks / code-quality (push) Waiting to run Details Code Quality Checks / python-310-import-smoke (push) Waiting to run Details Unit Tests: Proxy DB Operations / auth-checks (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / budgets (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / custom-logging (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / db-and-spend (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / endpoints-and-responses (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / guardrails-hooks (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / jwt-and-keys (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / key-generation (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / logging-misc (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / proxy-runtime (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / proxy-server-core (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / proxy-utils (push) Blocked by required conditions Details Unit Tests / proxy-endpoints (push) Waiting to run Details Unit Tests / proxy-extras (push) Waiting to run Details Unit Tests / caching-local (push) Waiting to run Details Unit Tests / core-utils (push) Waiting to run Details Unit Tests / enterprise-package (push) Waiting to run Details Unit Tests / enterprise-routing (push) Waiting to run Details Unit Tests / integrations (push) Waiting to run Details Unit Tests / All Other Providers (push) Waiting to run Details Unit Tests / Vertex AI (push) Waiting to run Details Unit Tests / proxy-infra (push) Waiting to run Details Unit Tests / proxy-server (push) Waiting to run Details GitHub Actions Security Analysis / zizmor (push) Waiting to run Details UI Unit Tests / ui-unit-tests (push) Waiting to run Details Postgres Tests / proxy-security (push) Waiting to run Details Postgres Tests / schema-migration (push) Waiting to run Details Postgres Tests / proxy-behavior (push) Waiting to run Details LiteLLM Rust / rust-lint (push) Waiting to run Details LiteLLM Rust / rust-test (push) Waiting to run Details Unit Tests: Documentation Validation / documentation (push) Waiting to run Details Unit Tests: Proxy DB Operations / assert-shard-coverage (push) Waiting to run Details Unit Tests / misc (push) Waiting to run Details Unit Tests / proxy-auth (push) Waiting to run Details Unit Tests / responses-caching-types (push) Waiting to run Details Merge pull request #39846 from BerriAI/litellm_bedrock_mantle_govcloud_cost_row fix(bedrock_mantle): price GovCloud regions from the regional cost row and accept region-prefixed model names		2026-09-12 21:13:58 -07:00
..
agent_tests
audio_tests
base_sdk_tests
basic_proxy_startup_tests	build: migrate packaging, CI, and Docker from Poetry to uv (#25007 )	2026-04-09 11:46:23 -07:00
batches_tests	feat(batches): enrich batch cost rows with breakdown, identity, session, and org spend	2026-09-03 17:23:53 -04:00
benchmarks
code_coverage_tests	test(e2e): verify IdP readiness through real HTTP	2026-09-11 17:25:38 -07:00
documentation_tests
e2e	docs(e2e): ban unit tests under tests/e2e (#33852 )	2026-09-12 21:13:43 -07:00
enterprise	fix(projects): persist explicit budget cap clears	2026-09-12 13:43:55 -07:00
guardrails_tests	fix(logging): blocked requests no longer report guardrail_status=success in multi-guardrail configs (#39596 )	2026-09-03 17:33:31 -07:00
image_gen_tests
integration
litellm-proxy-extras	fix(jwt): cascade-delete JWT key mappings when their virtual key is deleted	2026-09-09 15:39:21 -07:00
litellm_utils_tests	fix(reset_budget_job): reset end users by budget link, not by user id	2026-09-10 16:57:53 -07:00
llm_responses_api_testing
llm_translation	test: fix stale completion response fixtures	2026-09-10 17:18:56 -07:00
load_tests	feat(proxy): per-worker admission control that rejects excess requests with 503 (#39352 )	2026-09-03 18:19:04 -07:00
local_testing	test: respect optional logging payload fields	2026-09-10 18:07:12 -07:00
logging_callback_tests	Merge origin/litellm_internal_staging into litellm_spend_log_request_id_call_id	2026-09-12 21:04:25 -07:00
mcp_tests	fix(mcp): reject initialize with 403 when the key grants no MCP servers (#40616 )	2026-09-10 14:25:30 -07:00
multi_instance_e2e_tests
ocr_tests	test(ocr): exempt native parity requests from cassette replay	2026-09-11 22:50:39 -07:00
openai_endpoints_tests	test(responses): fix stale Anthropic smoke request	2026-09-11 13:56:27 -07:00
otel_tests	test: drop the cwd-relative sys.path.insert calls from the test suite (#37802 )	2026-08-22 09:25:58 -07:00
pass_through_tests	fix(logging): key bridged /v1/messages rows on the id the caller received	2026-09-03 01:15:06 -07:00
pass_through_unit_tests	feat(proxy): granular key/team access control for Claude Code marketplace plugins (#40518 )	2026-09-10 14:26:09 -07:00
proxy_admin_ui_tests	refactor(tests): assign the streamed id and lock poll once instead of rebinding	2026-09-03 13:49:43 -07:00
proxy_behavior	fix(proxy): attribute gate-rejected requests to their endpoint in cache analytics (#40824 )	2026-09-12 16:03:38 -07:00
proxy_e2e_anthropic_messages_tests
proxy_migration_tests	fix(proxy): run migrations through python -m prisma when the prisma console script is not on PATH	2026-09-09 18:17:12 -07:00
proxy_security_tests
proxy_unit_tests	fix(proxy): surface runtime-registered callbacks in UI Logging page (#38974 )	2026-09-09 22:03:16 -07:00
router_unit_tests	fix(router): count allowed_fails in the shared router cache so multi-worker proxies bench a deployment fleet-wide (#40224 )	2026-09-08 13:54:48 -07:00
rust-python-harness	refactor(ocr): complete native lifecycle and preserve Azure auth (#40734 )	2026-09-12 11:56:49 -07:00
search_tests
spend_tracking_tests
store_model_in_db_tests	test(proxy): expect the sanitized unknown-model message in the spend-log error test	2026-09-11 19:18:10 -07:00
test_gateway	feat(proxy): offload spend tracking to a pod-local collector sidecar (#40545 )	2026-09-10 17:14:13 -07:00
test_litellm	Merge pull request #39846 from BerriAI/litellm_bedrock_mantle_govcloud_cost_row	2026-09-12 21:13:58 -07:00
test_litellm_rust	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_ocr_custom_pricing	2026-09-12 15:42:59 -07:00
unified_google_tests
vector_store_tests	fix(vector-store): carry request metadata into the Router executor built from the router kwarg	2026-09-02 16:53:05 -07:00
windows_tests
__init__.py	[Feat] Add github co-pilot as a new LLM API provider (#12325 )	2025-07-04 13:12:16 -07:00
_fake_openai_endpoint_server.py	test(timeout): time out against the local fake endpoint instead of api.openai.com	2026-09-03 09:53:30 -07:00
_flush_vcr_cache.py	tests(vcr): isolate cassette redis to CASSETTE_REDIS_URL	2026-05-01 12:32:59 -07:00
_live_test_helpers.py
_openai_record_replay_proxy.py
_vcr_conftest_common.py
_vcr_redis_persister.py	test(vcr): stop refreshing cassette TTL on read so cassettes lapse after 24h (#29784 )	2026-06-05 10:22:41 -07:00
_wait_helpers.py
_ws_vcr.py
eval_swe_bench.py	Prompt Compression - add it to the proxy (#25729 )	2026-04-20 15:08:00 -07:00
fake_openai_endpoint.py
gettysburg.wav
large_text.py	fix(router.py): check for context window error when handling 400 status code errors	2024-03-26 08:08:15 -07:00
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py	test: address review notes on the chronic-test repairs	2026-09-04 10:18:15 -07:00
test_new_vector_store_endpoints.py
test_openai_endpoints.py
test_organizations.py
test_otel_thread_leak.py
test_presidio_latency.py
test_proxy_server_non_root.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_ratelimit.py
test_resource_cleanup.py
test_rust_python_harness.py	test: address review notes on the chronic-test repairs	2026-09-04 10:18:15 -07:00
test_service_logger_otel.py	fix(langfuse): send v4 ingestion header for otel callback (#33907 )	2026-07-18 20:36:51 -07:00
test_spend_logs.py
test_team.py
test_team_logging.py
test_team_members.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.