litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-21 00:21:49 +00:00

History

mateo-berri 24064e3b31 fix(guardrails): treat the stored Javelin api_version default as unset for Azure Content Safety Guardrails created through POST /guardrails on older releases have api_version "v1" saved in the database, because the writer persists every default. Azure Content Safety never accepts that value, so those guardrails kept answering 404 after the default moved to None. The Azure base now resolves "v1" to 2024-09-01 the same way it resolves a missing value. Also restores the OpenAPI snapshot line that a Python 3.14 regeneration had dedented		2026-09-19 02:29:43 -07:00
..
agent_tests	fix(a2a): keep the upstream status on card discovery failures and inject the card client in tests	2026-09-16 23:55:57 +00:00
audio_tests
base_sdk_tests
basic_proxy_startup_tests
batches_tests
benchmarks
code_coverage_tests	chore: consolidate CLAUDE.md into AGENTS.md	2026-09-19 02:30:35 +00:00
documentation_tests	fix(docs-test): restore line-anchored table regex in router settings check	2026-09-18 20:10:20 +00:00
e2e	chore: consolidate CLAUDE.md into AGENTS.md	2026-09-19 02:30:35 +00:00
enterprise	fix(projects): persist explicit budget cap clears	2026-09-12 13:43:55 -07:00
guardrails_tests	fix(guardrails): give post-call scans the scoped request conversation and tools	2026-09-15 09:58:53 +00:00
image_gen_tests	test: remove fully commented-out test files that collect no tests	2026-09-17 20:05:27 +00:00
integration	Merge pull request #41901 from BerriAI/litellm_off_peak_pricing_integration_tests	2026-09-18 17:26:51 -07:00
litellm-proxy-extras	test(proxy-extras): move the LITELLM_LOG logger test into the CI-run proxy-extras shard	2026-09-15 22:57:23 +00:00
litellm_utils_tests	test: keep the pinning-test removal free of unrelated reformatting	2026-09-18 04:27:28 +00:00
llm_responses_api_testing	test: fix five tests left stale by #41311 , #41337 , #39996 and #41310	2026-09-16 17:47:27 -07:00
llm_translation	test(bedrock): expect canonical session tags in the dynamic auth params propagation test	2026-09-18 11:17:34 -07:00
load_tests
local_testing	Merge remote-tracking branch 'origin/main' into litellm_max_parallel_requests_queue_size	2026-09-18 08:57:53 +00:00
logging_callback_tests	test(logging): add azure_spillover to the GCS pub/sub spend-log golden	2026-09-17 18:33:42 -07:00
mcp_tests	test(mcp): give the new cache and tombstone patches TQ008 reasons and match the keyword eviction call	2026-09-18 02:49:41 +00:00
multi_instance_e2e_tests
ocr_tests	test(ocr): replace per-provider OCR test classes with a declarative provider x auth x input matrix	2026-09-18 21:27:03 +00:00
openai_endpoints_tests	test(responses): fix stale Anthropic smoke request	2026-09-11 13:56:27 -07:00
otel_tests	feat(cli): deprecate the litellm-proxy entrypoint in favour of lite	2026-09-17 14:05:31 -07:00
pass_through_tests
pass_through_unit_tests	test(pass_through): shorten protocol-constrained route docstring	2026-09-17 00:24:29 +00:00
proxy_admin_ui_tests
proxy_behavior	fix(proxy): enforce org budget ceilings on /team/update	2026-09-16 15:38:30 -07:00
proxy_e2e_anthropic_messages_tests
proxy_migration_tests	fix(bedrock): support aws-sdk-bedrock-runtime 0.10 and 0.11 in the realtime handler	2026-09-17 01:40:52 +00:00
proxy_security_tests
proxy_unit_tests	Merge pull request #40243 from zoroyihan7/fix-responses-stream-error-events	2026-09-18 17:29:57 -07:00
router_unit_tests	test(router): force the callback to observe the usage stamp before the pre-header increment fails	2026-09-16 20:10:22 +00:00
rust-python-harness	test: drop tests that pin provider-owned cost map values	2026-09-18 03:55:51 +00:00
search_tests	test: remove fully commented-out test files that collect no tests	2026-09-17 20:05:27 +00:00
spend_tracking_tests
store_model_in_db_tests	test(proxy): expect the sanitized unknown-model message in the spend-log error test	2026-09-11 19:18:10 -07:00
test_gateway	feat(proxy): offload spend tracking to a pod-local collector sidecar (#40545 )	2026-09-10 17:14:13 -07:00
test_litellm	fix(guardrails): treat the stored Javelin api_version default as unset for Azure Content Safety	2026-09-19 02:29:43 -07:00
test_litellm_rust	fix(rust): keep native OCR on the proxy by declining only a supplied client	2026-09-18 18:47:36 -07:00
unified_google_tests
vector_store_tests
windows_tests
__init__.py
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py	refactor(test): validate cost-map entries into a typed model	2026-09-16 14:32:08 -07:00
_openai_record_replay_proxy.py
_vcr_conftest_common.py
_vcr_redis_persister.py
_wait_helpers.py
_ws_vcr.py
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_new_vector_store_endpoints.py
test_openai_endpoints.py	test: fix five tests left stale by #41311 , #41337 , #39996 and #41310	2026-09-16 17:47:27 -07:00
test_organizations.py
test_otel_thread_leak.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py
test_resource_cleanup.py
test_rust_python_harness.py	refactor(rust): remove gateway, config, router, realtime, and trace-parity infrastructure	2026-09-16 16:00:07 +00:00
test_service_logger_otel.py
test_spend_logs.py
test_team.py
test_team_logging.py
test_team_members.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.