litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-11-08 08:08:37 +00:00

History

mateo-berri bd31b30c21 refactor(types): leave provider reply parsers for a follow-up with live provider calls Restores the Bedrock Stability, Bedrock KB, AgentCore, Replicate, Recraft, Aleph Alpha and Guardrails AI parsers to main, since no live provider call could prove the stricter schemas. Also types the cache delete route tests.		2026-10-28 19:12:00 -07:00
..
_support	fix(proxy)!: end a chat completions stream with an error event when a guardrail blocks mid-stream (#46953 )	2026-10-17 18:00:12 -07:00
audio_tests	feat(vertex-ai)!: support gemini 3.1 flash tts (#31915 )	2026-10-21 04:18:42 +00:00
base_sdk_tests	refactor(rust-bridge): require the native extension (#48852 )	2026-10-28 13:16:56 -07:00
benchmarks	refactor(mcp): drop the experimental label from the MCP server and client paths (#48513 )	2026-10-27 17:47:50 +00:00
code_coverage_tests	fix(audio): return 400 for unsupported transcription providers (#47971 )	2026-10-28 19:20:17 +00:00
documentation_tests	fix(proxy): let configured pass-through endpoints outrank built-in provider prefix routes (#44133 )	2026-10-10 12:26:17 -07:00
e2e	fix(responses): forward top-level moderation param to OpenAI (#48708 )	2026-10-28 10:33:11 -07:00
e2e_harness	test(perf): ramp the load cases until the pod stops keeping up and floor sustained_rps (#47758 )	2026-10-20 22:31:08 -07:00
fixtures	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
harness_e2e	fix(harness): set PWD to the working directory of local sandbox commands (#47530 )	2026-10-20 20:06:11 +00:00
integration	fix(anthropic): map model_context_window_exceeded stop reason to length (#48874 )	2026-10-28 13:48:37 -07:00
rust-python-harness	feat(rust): encode LiteLLM response ids on native responses (#46572 )	2026-10-18 20:52:34 -07:00
test_litellm_rust	refactor(rust-bridge): require the native extension (#48852 )	2026-10-28 13:16:56 -07:00
typing	fix: support OpenAI SDK 3 while retaining SDK 2 compatibility (#44927 )	2026-10-09 19:45:50 -07:00
unit	refactor(types): leave provider reply parsers for a follow-up with live provider calls	2026-10-28 19:12:00 -07:00
windows_tests	refactor(rust-bridge): require the native extension (#48852 )	2026-10-28 13:16:56 -07:00
__init__.py	refactor: expose core private helpers under public names (#44871 )	2026-10-07 00:05:27 +00:00
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py
_master_key.py	fix(security): remove the publicly known master key from the repo (#44718 )	2026-10-06 10:55:24 -07:00
_openai_record_replay_proxy.py
_process_helpers.py
_vcr_conftest_common.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
_vcr_redis_persister.py
_wait_helpers.py
_ws_vcr.py
AGENTS.md	docs(agents): ban semicolons and colons in human-facing text (#45684 )	2026-10-09 16:36:32 -07:00
capturing_transport.py
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_logging.conf
test_rust_python_harness.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352 )	2026-10-08 10:33:35 -07:00
VCR_TESTING.md	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759 )	2026-10-11 07:58:53 +00:00
white_100x100.png

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/unit

This folder can only run mock tests.