litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-26 01:12:21 +00:00

History

Yucheng He c1c566db87 fix(proxy): record aborted outcome when spend-log cleanup is cancelled at shutdown cleanup_old_spend_logs only caught Exception, so a run cut short by CancelledError recorded no outcome and logged nothing. Under uvicorn the job was never cancelled at all: uvicorn re-raises the captured SIGTERM as soon as the lifespan shutdown returns, before asyncio cancels outstanding tasks, so an in-flight scheduler job simply died with the process. The cleanup now handles CancelledError by logging elapsed time, rows deleted and batch count at error level, recording outcome="aborted", and re-raising. The lifespan shutdown stops the scheduler and awaits the jobs it cancels while the database is still connected, so that handler runs under uvicorn too, and the pod lock is released instead of orphaned. Resolves LIT-6990		2026-09-18 20:00:19 +00:00
..
agent_tests	fix(a2a): keep the upstream status on card discovery failures and inject the card client in tests	2026-09-16 23:55:57 +00:00
audio_tests
base_sdk_tests
basic_proxy_startup_tests
batches_tests
benchmarks
code_coverage_tests	ci: drop aws partition hardcode gate	2026-09-17 20:16:07 +00:00
documentation_tests
e2e	test(e2e): assert config ownership instead of absence from the stored row	2026-09-18 02:53:37 -07:00
enterprise	fix(projects): persist explicit budget cap clears	2026-09-12 13:43:55 -07:00
guardrails_tests	fix(guardrails): give post-call scans the scoped request conversation and tools	2026-09-15 09:58:53 +00:00
image_gen_tests	test: remove fully commented-out test files that collect no tests	2026-09-17 20:05:27 +00:00
integration	Merge pull request #41373 from BerriAI/litellm_fix_integration_conftest_import	2026-09-17 13:34:05 -07:00
litellm-proxy-extras	test(proxy-extras): move the LITELLM_LOG logger test into the CI-run proxy-extras shard	2026-09-15 22:57:23 +00:00
litellm_utils_tests	test: keep the pinning-test removal free of unrelated reformatting	2026-09-18 04:27:28 +00:00
llm_responses_api_testing	test: fix five tests left stale by #41311 , #41337 , #39996 and #41310	2026-09-16 17:47:27 -07:00
llm_translation	test(bedrock): expect canonical session tags in the dynamic auth params propagation test	2026-09-18 11:17:34 -07:00
load_tests
local_testing	Merge remote-tracking branch 'origin/main' into litellm_max_parallel_requests_queue_size	2026-09-18 08:57:53 +00:00
logging_callback_tests	test(logging): add azure_spillover to the GCS pub/sub spend-log golden	2026-09-17 18:33:42 -07:00
mcp_tests	fix(mcp): reject initialize with 403 when the key grants no MCP servers (#40616 )	2026-09-10 14:25:30 -07:00
multi_instance_e2e_tests
ocr_tests	test(ocr): exempt native parity requests from cassette replay	2026-09-11 22:50:39 -07:00
openai_endpoints_tests	test(responses): fix stale Anthropic smoke request	2026-09-11 13:56:27 -07:00
otel_tests	feat(cli): deprecate the litellm-proxy entrypoint in favour of lite	2026-09-17 14:05:31 -07:00
pass_through_tests
pass_through_unit_tests	test(pass_through): shorten protocol-constrained route docstring	2026-09-17 00:24:29 +00:00
proxy_admin_ui_tests
proxy_behavior	fix(proxy): enforce org budget ceilings on /team/update	2026-09-16 15:38:30 -07:00
proxy_e2e_anthropic_messages_tests
proxy_migration_tests	fix(bedrock): support aws-sdk-bedrock-runtime 0.10 and 0.11 in the realtime handler	2026-09-17 01:40:52 +00:00
proxy_security_tests
proxy_unit_tests	refactor(proxy): resolve config and DB settings precedence in one SettingsStore	2026-09-17 23:36:27 -07:00
router_unit_tests	test(router): force the callback to observe the usage stamp before the pre-header increment fails	2026-09-16 20:10:22 +00:00
rust-python-harness	test: drop tests that pin provider-owned cost map values	2026-09-18 03:55:51 +00:00
search_tests	test: remove fully commented-out test files that collect no tests	2026-09-17 20:05:27 +00:00
spend_tracking_tests
store_model_in_db_tests	test(proxy): expect the sanitized unknown-model message in the spend-log error test	2026-09-11 19:18:10 -07:00
test_gateway	feat(proxy): offload spend tracking to a pod-local collector sidecar (#40545 )	2026-09-10 17:14:13 -07:00
test_litellm	fix(proxy): record aborted outcome when spend-log cleanup is cancelled at shutdown	2026-09-18 20:00:19 +00:00
test_litellm_rust	test(ocr): restore public-boundary OCR coverage the Rust move cannot replace	2026-09-17 21:36:48 -07:00
unified_google_tests
vector_store_tests
windows_tests
__init__.py
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py	refactor(test): validate cost-map entries into a typed model	2026-09-16 14:32:08 -07:00
_openai_record_replay_proxy.py
_vcr_conftest_common.py
_vcr_redis_persister.py
_wait_helpers.py
_ws_vcr.py
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_new_vector_store_endpoints.py
test_openai_endpoints.py	test: fix five tests left stale by #41311 , #41337 , #39996 and #41310	2026-09-16 17:47:27 -07:00
test_organizations.py
test_otel_thread_leak.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py
test_resource_cleanup.py
test_rust_python_harness.py	refactor(rust): remove gateway, config, router, realtime, and trace-parity infrastructure	2026-09-16 16:00:07 +00:00
test_service_logger_otel.py
test_spend_logs.py
test_team.py
test_team_logging.py
test_team_members.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.