litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-19 00:01:29 +00:00

History

mateo-berri c85da0a75f fix(logging): key bridged /v1/messages rows on the id the caller received /v1/messages against a non-Anthropic model answers with the Responses id, but the spend row was built from a fresh ModelResponse, so it landed on a chatcmpl- uuid nobody can look up. Carry that id through the same way the Anthropic branch now does, and make the passthrough spend assertions fail on an empty lookup instead of skipping past it.		2026-09-03 01:15:06 -07:00
..
agent_tests
audio_tests
base_sdk_tests
basic_proxy_startup_tests
batches_tests	merge(litellm_internal_staging): reconcile batch observability with per-line resilience	2026-08-24 19:08:40 -04:00
benchmarks
code_coverage_tests	fix: keep litellm importable on Python 3.10 and guard 3.11-only typing imports in CI (#39448 )	2026-09-02 18:27:19 -07:00
documentation_tests	Merge remote-tracking branch 'origin/main' into litellm_bedrock_messages_disconnect_billing	2026-08-31 08:58:37 -07:00
e2e	test(e2e): correlate anthropic passthrough spend rows by the served message id	2026-09-03 00:46:07 -07:00
enterprise	fix(prometheus): bound requested_model label cardinality on client failure paths	2026-09-01 10:34:58 -07:00
guardrails_tests
image_gen_tests
integration
litellm-proxy-extras	revert: default the proxy back to the v1 migration resolver	2026-09-01 12:56:08 -07:00
litellm_utils_tests	test(aiohttp): pin NO_PROXY so proxy env cannot hijack the refused-port probe	2026-08-28 12:45:46 -07:00
llm_responses_api_testing	fix(guardrails): deliver modify_response block as valid SSE on streaming chat and Responses	2026-08-31 16:01:39 -07:00
llm_translation	test: exempt MockTransport request-shape embedding tests from VCR replay	2026-09-01 13:29:12 -07:00
load_tests	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_ruff_dead_test_code	2026-08-24 09:46:56 -07:00
local_testing	Merge pull request #39185 from BerriAI/litellm_fix_embedding_encoding_format_suite_break	2026-09-01 13:52:51 -07:00
logging_callback_tests	test(vector-store): accept embedding_executor in the Bedrock KB hook fake handler	2026-09-02 19:22:12 -07:00
mcp_tests	fix(mcp): follow tools/list pagination from upstream servers (#39172 )	2026-09-01 14:34:14 -07:00
multi_instance_e2e_tests
ocr_tests	fix(vertex): avoid duplicate DeepSeek OCR model namespace	2026-09-01 14:39:15 -07:00
openai_endpoints_tests	test(responses): expect the 404 OpenAI now returns for an unknown model	2026-09-02 18:08:45 -07:00
otel_tests
pass_through_tests	fix(logging): key bridged /v1/messages rows on the id the caller received	2026-09-03 01:15:06 -07:00
pass_through_unit_tests	test(websearch): carry a reasoned test-quality suppression on the router patch	2026-08-31 22:32:05 -07:00
proxy_admin_ui_tests	test(access-groups): give each xdist worker its own fixture ids	2026-08-28 09:35:12 -07:00
proxy_behavior	fix(proxy): reset a stuck team member's budget (#37971 )	2026-08-25 09:50:09 -07:00
proxy_e2e_anthropic_messages_tests
proxy_migration_tests	test(proxy-extras): use the modern optional annotation in the deploy budget test	2026-09-02 12:36:29 -07:00
proxy_security_tests
proxy_unit_tests	fix(proxy): share per-model budget counters across replicas through the spend counter cache (#39375 )	2026-09-02 12:40:59 -07:00
router_unit_tests	feat(router): arm safeguard-refusal fallback on generic chains when no content-policy list exists (#39274 )	2026-09-02 18:31:25 -07:00
rust-python-harness	test: add mistral ocr transformation parity coverage (#39482 )	2026-09-02 20:40:00 -07:00
sdk_function_trace	refactor(python-bridge): split routes and add shared function tracing (#39031 )	2026-09-02 16:26:35 -07:00
search_tests	fix(search): harden bing_grounding auth, result cap, status, and cost	2026-08-24 12:26:07 -07:00
spend_tracking_tests
store_model_in_db_tests
test_litellm	fix(logging): key bridged /v1/messages rows on the id the caller received	2026-09-03 01:15:06 -07:00
unified_google_tests
vector_store_tests	fix(vector-store): carry request metadata into the Router executor built from the router kwarg	2026-09-02 16:53:05 -07:00
windows_tests
__init__.py
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py
_openai_record_replay_proxy.py
_vcr_conftest_common.py
_vcr_redis_persister.py
_wait_helpers.py
_ws_vcr.py
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py	test: fix staging CI regressions from #38182 , #38144 , #38265 , #37962 , and #37969	2026-08-25 23:01:20 -07:00
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_new_vector_store_endpoints.py
test_openai_endpoints.py
test_organizations.py
test_otel_thread_leak.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py
test_resource_cleanup.py
test_rust_python_harness.py	feat(rust-python-harness): wire existing e2e SDK tests into the matrix (#39463 )	2026-09-03 02:50:08 +00:00
test_service_logger_otel.py
test_spend_logs.py
test_team.py
test_team_logging.py
test_team_members.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.