litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-26 01:12:21 +00:00

History

mateo-berri 0a31f7b705 fix(interactions): keep the stored settlement gate when registration raises after landing, and fail resumed-poll deletes closed A registration that raised after its row committed moved the poll to a private in-memory gate, so the creating worker billed while the stored row stayed unclaimed for another replica's delete or the next boot to bill again. The row is now read back once and, when it landed, the poll claims through it like every other settler. A worker that resumed the poll after a restart is not the creator, so its delete on a failed pre-delete fetch now fails with the fetch's error instead of releasing and deleting. After a fleet restart every worker holds resumed polls, which left the fail-closed path applying nowhere.		2026-09-24 13:13:40 -07:00
..
_support	fix(params): stop stream_chunk_size reaching provider request bodies (#42664 )	2026-09-23 10:27:47 -07:00
agent_tests
audio_tests
base_sdk_tests	fix(mcp): explain missing public client dependencies	2026-09-19 19:52:13 -07:00
basic_proxy_startup_tests
batches_tests
benchmarks	feat(tokenizer): preserve Python defaults with opt-in Rust dispatch (#42174 )	2026-09-22 04:41:11 +00:00
code_coverage_tests	ci: add merge smoke checks workflow with loopback-only harness and 11 curated cases (#42709 )	2026-09-23 11:01:08 -07:00
documentation_tests
e2e	test(e2e/ui): give the logout specs their own admin session (#42930 )	2026-09-24 11:55:07 -07:00
enterprise	fix(prometheus): add model_group label to deployment request and rate limit metrics (#42966 )	2026-09-24 12:15:01 -07:00
guardrails_tests	Revert "Merge pull request #41220 from BerriAI/litellm_post_call_guardrail_context"	2026-09-19 17:45:15 +00:00
image_gen_tests
integration	test(guardrails): run the cache-hit redis outage test on the shared owned_redis helper (#42925 )	2026-09-24 12:00:10 -07:00
litellm-proxy-extras	Merge remote-tracking branch 'origin/main' into litellm_v2_migration_startup	2026-09-18 20:55:05 -07:00
litellm_utils_tests	test: point CircleCI-only suites at models still in the cost map (#42617 )	2026-09-22 17:28:34 -07:00
llm_responses_api_testing
llm_translation	test: point CircleCI-only suites at models still in the cost map (#42617 )	2026-09-22 17:28:34 -07:00
load_tests
local_testing	test(ollama): assert the images sent to Ollama instead of echoing them through response (#42905 )	2026-09-24 11:54:26 -07:00
logging_callback_tests	test: point CircleCI-only suites at models still in the cost map (#42617 )	2026-09-22 17:28:34 -07:00
mcp_tests	fix(mcp): apply post-call rewrites without stale structured output (#41530 )	2026-09-22 13:44:25 -07:00
multi_instance_e2e_tests
ocr_tests	test(ocr): replace per-provider OCR test classes with a declarative provider x auth x input matrix	2026-09-18 21:27:03 +00:00
openai_endpoints_tests
otel_tests	test: fix stale budget-status and bad-database-url assertions	2026-09-21 15:00:54 -07:00
pass_through_tests	fix(mcp): preserve legacy behavior on SDK2 and streamline verification	2026-09-18 22:28:31 -07:00
pass_through_unit_tests	feat(proxy): add TinyFish Agent API passthrough with per-step billing (#41099 )	2026-09-21 21:21:43 -07:00
proxy_admin_ui_tests
proxy_behavior	Merge pull request #42026 from BerriAI/litellm_user_jwt_savings	2026-09-21 16:41:16 -07:00
proxy_e2e_anthropic_messages_tests	fix(test): run the all-beta-headers bedrock cases on Claude Fable 5.1	2026-09-19 23:33:29 +00:00
proxy_migration_tests	test: count a zombie grandchild as gone in the migrate deploy timeout test (#42570 )	2026-09-22 14:59:26 -07:00
proxy_security_tests	refactor(proxy): rename the local development override to dangerously_permit_weak_or_unset_master_key so the name says exactly what it permits	2026-09-19 18:53:14 -07:00
proxy_unit_tests	fix(proxy): keep the in-flight daily spend batch when shutdown cancels the flush (#42593 )	2026-09-22 17:58:08 -07:00
router_unit_tests	Merge pull request #42283 from BerriAI/litellm_mid_stream_fallback_walks_full_list	2026-09-21 15:14:04 -07:00
rust-python-harness
search_tests
spend_tracking_tests
store_model_in_db_tests	test(mcp): patch create_mcp_server_if_identifier_free in the store-model-in-db MCP tests (#42916 )	2026-09-24 11:59:52 -07:00
test_gateway
test_litellm	fix(interactions): keep the stored settlement gate when registration raises after landing, and fail resumed-poll deletes closed	2026-09-24 13:13:40 -07:00
test_litellm_rust	feat(rust): shape Anthropic Messages requests natively (#42982 )	2026-09-24 19:08:32 +00:00
unified_google_tests	test(google_genai): move unified_google_tests to gemini-3.5-flash-lite (#42520 )	2026-09-22 13:07:37 -07:00
unit	test(vertex_ai): run the files peak-memory guards without coverage tracing (#42914 )	2026-09-24 11:56:42 -07:00
vector_store_tests
windows_tests
__init__.py
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py
_openai_record_replay_proxy.py
_process_helpers.py	test: count a zombie grandchild as gone in the migrate deploy timeout test (#42570 )	2026-09-22 14:59:26 -07:00
_vcr_conftest_common.py	test(vcr): guard leaked cassette patches and make injected-transport embedding tests immune (#42542 )	2026-09-22 14:20:18 -07:00
_vcr_redis_persister.py
_wait_helpers.py
_ws_vcr.py
AGENTS.md	ci(tests): wire tests/unit into CircleCI and drain legacy unit shards green	2026-09-20 07:05:42 +00:00
capturing_transport.py	test(vcr): guard leaked cassette patches and make injected-transport embedding tests immune (#42542 )	2026-09-22 14:20:18 -07:00
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_new_vector_store_endpoints.py
test_openai_endpoints.py
test_organizations.py
test_otel_thread_leak.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py
test_resource_cleanup.py
test_rust_python_harness.py
test_service_logger_otel.py
test_spend_logs.py
test_team.py
test_team_logging.py
test_team_members.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.