litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-10-17 04:34:25 +00:00

History

devin-ai-integration[bot] 9f9a02b646 Some checks are pending CodSpeed Benchmarks / benchmarks (push) Waiting to run Details Deploy main to gateway-dev / dispatch (push) Waiting to run Details Publish lint base counts / publish (basedpyright, scripts/type_check_gate.py) (push) Waiting to run Details Publish lint base counts / publish (openapi-docs, scripts/openapi_docs_gate.py) (push) Waiting to run Details Publish lint base counts / publish (ruff-strict, scripts/ruff_strict_gate.py) (push) Waiting to run Details Publish lint base counts / publish (test-quality, scripts/test_quality_gate.py) (push) Waiting to run Details Publish lint base counts / publish (type-discipline, scripts/type_discipline_gate.py) (push) Waiting to run Details Scorecard supply-chain security / Scorecard analysis (push) Waiting to run Details LiteLLM Rust / rust-lint (push) Waiting to run Details LiteLLM Rust / rust-test (push) Waiting to run Details LiteLLM Rust / rust-wheel (push) Waiting to run Details unit / logging-misc (push) Blocked by required conditions Details unit / mcp-oauth (push) Blocked by required conditions Details unit / proxy-runtime (push) Blocked by required conditions Details unit / proxy-server-core (push) Blocked by required conditions Details unit / root (push) Blocked by required conditions Details unit / proxy-utils (push) Blocked by required conditions Details unit / proxy-infra-root (push) Blocked by required conditions Details unit / responses-caching-types (push) Blocked by required conditions Details unit / router (push) Blocked by required conditions Details unit / rust-bridge-harness (push) Blocked by required conditions Details unit / enterprise-routing (push) Blocked by required conditions Details unit / guardrails-hooks (push) Blocked by required conditions Details unit / jwt-and-keys (push) Blocked by required conditions Details unit / key-generation (push) Blocked by required conditions Details unit / rust-bridge (push) Waiting to run Details unit / proxy-infra (push) Blocked by required conditions Details unit / auth-checks (push) Blocked by required conditions Details unit / budgets (push) Blocked by required conditions Details unit / custom-logging (push) Blocked by required conditions Details unit / db-and-spend (push) Blocked by required conditions Details unit / endpoints-and-responses (push) Blocked by required conditions Details unit / assert-shard-coverage (push) Waiting to run Details unit / endpoints (push) Blocked by required conditions Details unit / enterprise-package (push) Blocked by required conditions Details unit / enterprise-managed-files (push) Blocked by required conditions Details unit / enterprise-repositories-secrets (push) Blocked by required conditions Details unit / proxy-server (push) Blocked by required conditions Details unit / lens-python-310 (push) Blocked by required conditions Details unit / caching-local (push) Blocked by required conditions Details unit / core-utils (push) Blocked by required conditions Details unit / llms-vertex-ai (push) Blocked by required conditions Details unit / mcp-elicitation (push) Blocked by required conditions Details unit / mcp-server (push) Blocked by required conditions Details unit / proxy-auth (push) Blocked by required conditions Details unit / proxy-endpoints (push) Blocked by required conditions Details unit / proxy-extras (push) Blocked by required conditions Details unit / proxy-feature-endpoints (push) Blocked by required conditions Details unit / proxy-hooks-client (push) Blocked by required conditions Details unit / ui-unit (push) Waiting to run Details unit / OpenAI 3.25.0 compatibility (push) Waiting to run Details unit / redis-py 5.3.1 compatibility (push) Blocked by required conditions Details unit / integrations (push) Blocked by required conditions Details unit / llms-anthropic (push) Blocked by required conditions Details unit / llms-bedrock (push) Blocked by required conditions Details unit / llms-openai-meta (push) Blocked by required conditions Details unit / llms-providers (push) Blocked by required conditions Details unit / docs (push) Waiting to run Details unit / helm (push) Waiting to run Details unit / OpenAI 2.20.0 compatibility (push) Waiting to run Details unit / OpenAI 3.0.0 compatibility (push) Waiting to run Details unit / redis-py 8.0.1 compatibility (push) Blocked by required conditions Details unit / redis-py 6.4.0 compatibility (push) Blocked by required conditions Details unit / redis-py 7.4.1 compatibility (push) Blocked by required conditions Details unit / coverage (push) Blocked by required conditions Details unit / unit passed (push) Blocked by required conditions Details GitHub Actions Security Analysis / zizmor (push) Waiting to run Details fix(mcp): log upstream exchange when an MCP health check fails (#44125 ) Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: jesus <jesus@berri.ai>		2026-10-16 20:58:26 -07:00
..
_support	fix(params): validate stream_chunk_size once, before any provider call (#43222 )	2026-09-26 23:01:20 +00:00
base_sdk_tests	test: extend runtime regression contracts for Messages and SDK (#46641 )	2026-10-15 17:51:15 +00:00
benchmarks	fix(anthropic): keep trailing user messages with None or empty list content (#41397 )	2026-10-16 07:41:05 +00:00
code_coverage_tests	fix(proxy)!: answer 400 for malformed tools on count_tokens instead of crashing (#46583 )	2026-10-16 14:57:53 -07:00
documentation_tests	fix(proxy): let configured pass-through endpoints outrank built-in provider prefix routes (#44133 )	2026-10-10 12:26:17 -07:00
e2e	test(e2e): assert the Vertex cache-creation billing contract in the prompt caching test (#47027 )	2026-10-16 18:51:38 -07:00
e2e_harness	test(perf): cap every background Postgres statement at 0.9 calls per request (#46957 )	2026-10-16 19:58:32 +00:00
fixtures	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
harness_e2e	feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885 )	2026-10-01 22:27:49 +00:00
integration	fix(bedrock): use native structured output on Haiku 5.5 and Sonnet 5.5, and fix Fable 5 and Sonnet 4.6 schema 400s (#46870 )	2026-10-16 20:57:23 -07:00
rust-python-harness	docs(agents): ban semicolons and colons in human-facing text (#45684 )	2026-10-09 16:36:32 -07:00
test_litellm_rust	test(rust-bridge): relocate dispatch tests before routing changes (#46926 )	2026-10-16 12:29:33 -07:00
typing	fix: support OpenAI SDK 3 while retaining SDK 2 compatibility (#44927 )	2026-10-09 19:45:50 -07:00
unit	fix(mcp): log upstream exchange when an MCP health check fails (#44125 )	2026-10-16 20:58:26 -07:00
windows_tests	test: move packaging and install checks off CircleCI build_and_test (#45757 )	2026-10-10 09:33:51 -07:00
__init__.py	refactor: expose core private helpers under public names (#44871 )	2026-10-07 00:05:27 +00:00
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py
_master_key.py	fix(security): remove the publicly known master key from the repo (#44718 )	2026-10-06 10:55:24 -07:00
_openai_record_replay_proxy.py
_process_helpers.py	test: count a zombie grandchild as gone in the migrate deploy timeout test (#42570 )	2026-09-22 14:59:26 -07:00
_vcr_conftest_common.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
_vcr_redis_persister.py
_wait_helpers.py
_ws_vcr.py
AGENTS.md	docs(agents): ban semicolons and colons in human-facing text (#45684 )	2026-10-09 16:36:32 -07:00
capturing_transport.py	test(vcr): guard leaked cassette patches and make injected-transport embedding tests immune (#42542 )	2026-09-22 14:20:18 -07:00
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD	test: finish the non-proxy half of tests/test_litellm (#43281 )	2026-09-25 22:43:41 -07:00
test_logging.conf
test_rust_python_harness.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352 )	2026-10-08 10:33:35 -07:00
VCR_TESTING.md	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
white_100x100.png	test: stop CI tests from downloading tokenizer files and images (#43257 )	2026-09-25 19:27:48 -07:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/unit

This folder can only run mock tests.