litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-10-13 03:59:12 +00:00

History

Kerry Lu ce6fcafd04 Some checks are pending CodSpeed Benchmarks / benchmarks (push) Waiting to run Details Deploy main to gateway-dev / dispatch (push) Waiting to run Details Publish lint base counts / publish (basedpyright, scripts/type_check_gate.py) (push) Waiting to run Details Publish lint base counts / publish (openapi-docs, scripts/openapi_docs_gate.py) (push) Waiting to run Details Publish lint base counts / publish (ruff-strict, scripts/ruff_strict_gate.py) (push) Waiting to run Details Publish lint base counts / publish (test-quality, scripts/test_quality_gate.py) (push) Waiting to run Details LiteLLM Rust / rust-lint (push) Waiting to run Details Terraform Modules / fmt, validate, test (aws) (push) Waiting to run Details Publish lint base counts / publish (type-discipline, scripts/type_discipline_gate.py) (push) Waiting to run Details Scorecard supply-chain security / Scorecard analysis (push) Waiting to run Details LiteLLM Rust / rust-test (push) Waiting to run Details LiteLLM Rust / rust-wheel (push) Waiting to run Details Terraform Modules / fmt, validate, test (gcp) (push) Waiting to run Details unit / jwt-and-keys (push) Blocked by required conditions Details unit / key-generation (push) Blocked by required conditions Details unit / logging-misc (push) Blocked by required conditions Details unit / mcp-oauth (push) Blocked by required conditions Details unit / proxy-runtime (push) Blocked by required conditions Details unit / proxy-server-core (push) Blocked by required conditions Details unit / root (push) Blocked by required conditions Details unit / proxy-utils (push) Blocked by required conditions Details unit / llms-anthropic (push) Blocked by required conditions Details unit / llms-bedrock (push) Blocked by required conditions Details unit / llms-openai-meta (push) Blocked by required conditions Details unit / llms-providers (push) Blocked by required conditions Details unit / llms-vertex-ai (push) Blocked by required conditions Details unit / mcp-elicitation (push) Blocked by required conditions Details unit / mcp-server (push) Blocked by required conditions Details unit / proxy-auth (push) Blocked by required conditions Details unit / proxy-endpoints (push) Blocked by required conditions Details unit / proxy-extras (push) Blocked by required conditions Details unit / proxy-feature-endpoints (push) Blocked by required conditions Details unit / proxy-hooks-client (push) Blocked by required conditions Details unit / proxy-infra (push) Blocked by required conditions Details unit / proxy-infra-root (push) Blocked by required conditions Details unit / responses-caching-types (push) Blocked by required conditions Details unit / router (push) Blocked by required conditions Details unit / rust-bridge-harness (push) Blocked by required conditions Details unit / auth-checks (push) Blocked by required conditions Details unit / budgets (push) Blocked by required conditions Details unit / custom-logging (push) Blocked by required conditions Details unit / db-and-spend (push) Blocked by required conditions Details unit / endpoints-and-responses (push) Blocked by required conditions Details unit / enterprise-routing (push) Blocked by required conditions Details unit / guardrails-hooks (push) Blocked by required conditions Details unit / rust-bridge (push) Waiting to run Details unit / assert-shard-coverage (push) Waiting to run Details unit / enterprise-managed-files (push) Blocked by required conditions Details unit / proxy-server (push) Blocked by required conditions Details unit / lens-python-310 (push) Blocked by required conditions Details unit / caching-local (push) Blocked by required conditions Details unit / core-utils (push) Blocked by required conditions Details unit / endpoints (push) Blocked by required conditions Details unit / enterprise-package (push) Blocked by required conditions Details unit / enterprise-repositories-secrets (push) Blocked by required conditions Details unit / integrations (push) Blocked by required conditions Details unit / ui-unit (push) Waiting to run Details unit / docs (push) Waiting to run Details unit / helm (push) Waiting to run Details unit / OpenAI 2.20.0 compatibility (push) Waiting to run Details unit / OpenAI 3.0.0 compatibility (push) Waiting to run Details unit / OpenAI 3.25.0 compatibility (push) Waiting to run Details unit / redis-py 5.3.1 compatibility (push) Blocked by required conditions Details unit / redis-py 6.4.0 compatibility (push) Blocked by required conditions Details unit / redis-py 7.4.1 compatibility (push) Blocked by required conditions Details unit / redis-py 8.0.1 compatibility (push) Blocked by required conditions Details unit / coverage (push) Blocked by required conditions Details unit / unit passed (push) Blocked by required conditions Details GitHub Actions Security Analysis / zizmor (push) Waiting to run Details test(cost): add azure gpt-6 /v1/messages bridge cost parity pairs (#46139 ) Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-10-13 03:26:46 +00:00
..
_support	fix(params): validate stream_chunk_size once, before any provider call (#43222 )	2026-09-26 23:01:20 +00:00
base_sdk_tests	test: move packaging and install checks off CircleCI build_and_test (#45757 )	2026-10-10 09:33:51 -07:00
benchmarks	refactor: expose core private helpers under public names (#44871 )	2026-10-07 00:05:27 +00:00
code_coverage_tests	chore: drop Greptile from the PR template, AGENTS.md and CI (#46013 )	2026-10-12 18:32:39 +00:00
documentation_tests	fix(proxy): let configured pass-through endpoints outrank built-in provider prefix routes (#44133 )	2026-10-10 12:26:17 -07:00
e2e	fix(proxy): enforce the personal max_budget on proxy-admin JWTs (#43070 )	2026-10-12 16:04:12 -07:00
e2e_harness	test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077 )	2026-10-12 13:54:03 -07:00
fixtures	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
harness_e2e	feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885 )	2026-10-01 22:27:49 +00:00
integration	test(cost): add azure gpt-6 /v1/messages bridge cost parity pairs (#46139 )	2026-10-13 03:26:46 +00:00
rust-python-harness	docs(agents): ban semicolons and colons in human-facing text (#45684 )	2026-10-09 16:36:32 -07:00
test_litellm_rust	refactor(rust_bridge): route Python state reads through host modules (#45689 )	2026-10-11 14:10:16 -07:00
typing	fix: support OpenAI SDK 3 while retaining SDK 2 compatibility (#44927 )	2026-10-09 19:45:50 -07:00
unit	fix(gemini): bill context cache creation tokens from cachedContents responses (#46144 )	2026-10-13 03:18:50 +00:00
windows_tests	test: move packaging and install checks off CircleCI build_and_test (#45757 )	2026-10-10 09:33:51 -07:00
__init__.py	refactor: expose core private helpers under public names (#44871 )	2026-10-07 00:05:27 +00:00
_fake_openai_endpoint_server.py
_flush_vcr_cache.py	[Infra] Promote internal staging to main (#27245 )	2026-05-05 16:15:03 -07:00
_live_test_helpers.py	refactor(test): validate cost-map entries into a typed model	2026-09-16 14:32:08 -07:00
_master_key.py	fix(security): remove the publicly known master key from the repo (#44718 )	2026-10-06 10:55:24 -07:00
_openai_record_replay_proxy.py
_process_helpers.py	test: count a zombie grandchild as gone in the migrate deploy timeout test (#42570 )	2026-09-22 14:59:26 -07:00
_vcr_conftest_common.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
_vcr_redis_persister.py	test(vcr): stop refreshing cassette TTL on read so cassettes lapse after 24h (#29784 )	2026-06-05 10:22:41 -07:00
_wait_helpers.py
_ws_vcr.py
AGENTS.md	docs(agents): ban semicolons and colons in human-facing text (#45684 )	2026-10-09 16:36:32 -07:00
capturing_transport.py	test(vcr): guard leaked cassette patches and make injected-transport embedding tests immune (#42542 )	2026-09-22 14:20:18 -07:00
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD	test: finish the non-proxy half of tests/test_litellm (#43281 )	2026-09-25 22:43:41 -07:00
test_logging.conf
test_rust_python_harness.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352 )	2026-10-08 10:33:35 -07:00
VCR_TESTING.md	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
white_100x100.png	test: stop CI tests from downloading tokenizer files and images (#43257 )	2026-09-25 19:27:48 -07:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/unit

This folder can only run mock tests.