litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-10-15 04:19:08 +00:00

History

devin-ai-integration[bot] 02f56c6319 Some checks are pending CodSpeed Benchmarks / benchmarks (push) Waiting to run Details Deploy main to gateway-dev / dispatch (push) Waiting to run Details Publish lint base counts / publish (basedpyright, scripts/type_check_gate.py) (push) Waiting to run Details Publish lint base counts / publish (openapi-docs, scripts/openapi_docs_gate.py) (push) Waiting to run Details Publish lint base counts / publish (ruff-strict, scripts/ruff_strict_gate.py) (push) Waiting to run Details Publish lint base counts / publish (test-quality, scripts/test_quality_gate.py) (push) Waiting to run Details Publish lint base counts / publish (type-discipline, scripts/type_discipline_gate.py) (push) Waiting to run Details Scorecard supply-chain security / Scorecard analysis (push) Waiting to run Details LiteLLM Rust / rust-lint (push) Waiting to run Details LiteLLM Rust / rust-test (push) Waiting to run Details LiteLLM Rust / rust-wheel (push) Waiting to run Details unit / proxy-server-core (push) Blocked by required conditions Details unit / root (push) Blocked by required conditions Details unit / proxy-utils (push) Blocked by required conditions Details unit / proxy-infra (push) Blocked by required conditions Details unit / proxy-infra-root (push) Blocked by required conditions Details unit / responses-caching-types (push) Blocked by required conditions Details unit / router (push) Blocked by required conditions Details unit / rust-bridge-harness (push) Blocked by required conditions Details unit / auth-checks (push) Blocked by required conditions Details unit / budgets (push) Blocked by required conditions Details unit / jwt-and-keys (push) Blocked by required conditions Details unit / key-generation (push) Blocked by required conditions Details unit / logging-misc (push) Blocked by required conditions Details unit / mcp-oauth (push) Blocked by required conditions Details unit / proxy-runtime (push) Blocked by required conditions Details unit / assert-shard-coverage (push) Waiting to run Details unit / proxy-server (push) Blocked by required conditions Details unit / endpoints (push) Blocked by required conditions Details unit / enterprise-package (push) Blocked by required conditions Details unit / llms-vertex-ai (push) Blocked by required conditions Details unit / proxy-feature-endpoints (push) Blocked by required conditions Details unit / docs (push) Waiting to run Details unit / OpenAI 2.20.0 compatibility (push) Waiting to run Details unit / redis-py 8.0.1 compatibility (push) Blocked by required conditions Details unit / coverage (push) Blocked by required conditions Details unit / unit passed (push) Blocked by required conditions Details unit / custom-logging (push) Blocked by required conditions Details unit / db-and-spend (push) Blocked by required conditions Details unit / endpoints-and-responses (push) Blocked by required conditions Details unit / enterprise-routing (push) Blocked by required conditions Details unit / guardrails-hooks (push) Blocked by required conditions Details unit / rust-bridge (push) Waiting to run Details unit / enterprise-managed-files (push) Blocked by required conditions Details unit / lens-python-310 (push) Blocked by required conditions Details unit / caching-local (push) Blocked by required conditions Details unit / core-utils (push) Blocked by required conditions Details unit / enterprise-repositories-secrets (push) Blocked by required conditions Details unit / integrations (push) Blocked by required conditions Details unit / llms-anthropic (push) Blocked by required conditions Details unit / llms-bedrock (push) Blocked by required conditions Details unit / llms-openai-meta (push) Blocked by required conditions Details unit / llms-providers (push) Blocked by required conditions Details unit / mcp-elicitation (push) Blocked by required conditions Details unit / mcp-server (push) Blocked by required conditions Details unit / proxy-auth (push) Blocked by required conditions Details unit / proxy-endpoints (push) Blocked by required conditions Details unit / proxy-extras (push) Blocked by required conditions Details unit / proxy-hooks-client (push) Blocked by required conditions Details unit / ui-unit (push) Waiting to run Details unit / helm (push) Waiting to run Details unit / OpenAI 3.0.0 compatibility (push) Waiting to run Details unit / OpenAI 3.25.0 compatibility (push) Waiting to run Details unit / redis-py 5.3.1 compatibility (push) Blocked by required conditions Details unit / redis-py 6.4.0 compatibility (push) Blocked by required conditions Details unit / redis-py 7.4.1 compatibility (push) Blocked by required conditions Details GitHub Actions Security Analysis / zizmor (push) Waiting to run Details test(integration): cover guardrails_policies endpoint contracts (#44722 ) * test(integration): cover guardrails_policies endpoint contracts Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): let the admin submissions list carry other rows Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): close guardrails policies review gaps Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): cover guardrail auth and policy attachments Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): tidy guardrail policy test helpers * test(integration): keep plain non-admin submission refusal live * test: expand policy attachment integration coverage Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): accept the intended 403 for plain submission keys Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): pin multi-tag header and spend row tags for policy tag scope Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): drop the duplicate pydantic import left by the main merge Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: mateo <mateo@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: Devin <noreply@devin.ai>		2026-10-14 04:07:26 +00:00
..
_support	fix(params): validate stream_chunk_size once, before any provider call (#43222 )	2026-09-26 23:01:20 +00:00
base_sdk_tests	test: move packaging and install checks off CircleCI build_and_test (#45757 )	2026-10-10 09:33:51 -07:00
benchmarks	refactor: expose core private helpers under public names (#44871 )	2026-10-07 00:05:27 +00:00
code_coverage_tests	fix(proxy-extras): bound migration lock waits with SET LOCAL lock_timeout in the migration SQL (#46329 )	2026-10-13 20:51:03 -07:00
documentation_tests	fix(proxy): let configured pass-through endpoints outrank built-in provider prefix routes (#44133 )	2026-10-10 12:26:17 -07:00
e2e	fix(proxy-extras): bound migration lock waits with SET LOCAL lock_timeout in the migration SQL (#46329 )	2026-10-13 20:51:03 -07:00
e2e_harness	test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077 )	2026-10-12 13:54:03 -07:00
fixtures	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
harness_e2e	feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885 )	2026-10-01 22:27:49 +00:00
integration	test(integration): cover guardrails_policies endpoint contracts (#44722 )	2026-10-14 04:07:26 +00:00
rust-python-harness	docs(agents): ban semicolons and colons in human-facing text (#45684 )	2026-10-09 16:36:32 -07:00
test_litellm_rust	refactor(rust_bridge): route Python state reads through host modules (#45689 )	2026-10-11 14:10:16 -07:00
typing	fix: support OpenAI SDK 3 while retaining SDK 2 compatibility (#44927 )	2026-10-09 19:45:50 -07:00
unit	fix(proxy-extras): bound migration lock waits with SET LOCAL lock_timeout in the migration SQL (#46329 )	2026-10-13 20:51:03 -07:00
windows_tests	test: move packaging and install checks off CircleCI build_and_test (#45757 )	2026-10-10 09:33:51 -07:00
__init__.py	refactor: expose core private helpers under public names (#44871 )	2026-10-07 00:05:27 +00:00
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py	refactor(test): validate cost-map entries into a typed model	2026-09-16 14:32:08 -07:00
_master_key.py	fix(security): remove the publicly known master key from the repo (#44718 )	2026-10-06 10:55:24 -07:00
_openai_record_replay_proxy.py
_process_helpers.py	test: count a zombie grandchild as gone in the migrate deploy timeout test (#42570 )	2026-09-22 14:59:26 -07:00
_vcr_conftest_common.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
_vcr_redis_persister.py
_wait_helpers.py	test: replace blind sleeps with deadline waits in callback and caching tests (#37660 )	2026-08-20 18:48:43 +00:00
_ws_vcr.py
AGENTS.md	docs(agents): ban semicolons and colons in human-facing text (#45684 )	2026-10-09 16:36:32 -07:00
capturing_transport.py	test(vcr): guard leaked cassette patches and make injected-transport embedding tests immune (#42542 )	2026-09-22 14:20:18 -07:00
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav	feat(main.py): support openai transcription endpoints	2024-03-08 10:25:19 -08:00
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD	test: finish the non-proxy half of tests/test_litellm (#43281 )	2026-09-25 22:43:41 -07:00
test_logging.conf	feat(proxy_cli.py): add new 'log_config' cli param (#6352 )	2024-10-21 21:25:58 -07:00
test_rust_python_harness.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352 )	2026-10-08 10:33:35 -07:00
VCR_TESTING.md	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
white_100x100.png	test: stop CI tests from downloading tokenizer files and images (#43257 )	2026-09-25 19:27:48 -07:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/unit

This folder can only run mock tests.