Yassin Kortam be5e9000b2 perf(spend): write each daily spend batch in one upsert statement (#36448) ... The daily spend flush emitted one INSERT ... ON CONFLICT per aggregated key, so every replica put hundreds of statements on the database each interval, all contending for the same handful of hot rows and each holding its row locks for the rest of the enclosing batch transaction. LiteLLM_DailyTagSpend felt it worst because a request writes one row per tag, and litellm adds two user-agent tags of its own by default. A batch now goes out as a single multi-row statement. Rows are folded by the conflict tuple first, and every nullable member of that tuple is normalized to '': a NULL can never match itself in a unique index, so such a row was re-inserted on every flush rather than aggregating, and a NULL model made prisma reject the whole batch.		2026-08-10 17:06:00 -07:00
..
example_config_yaml	test: test	2026-03-28 19:17:38 -07:00
test_configs	test: test	2026-03-28 19:17:38 -07:00
test_model_response_typing
azure_fine_tune.jsonl
batch_job_results_furniture.jsonl
conftest copy.py
conftest.py	[Fix] conftest: flush cache instances and warn on silent skips	2026-04-20 22:19:36 -07:00
data_map.txt
eagle.wav
gettysburg.wav
large_text.py
messages_with_counts.py
model_cost.json
openai_batch_completions.jsonl
openai_batch_completions_router.jsonl
speech_vertex.mp3
test_aproxy_startup.py
test_audit_logs_proxy.py	fix(proxy): require opt in for audit header fallback	2026-04-30 11:17:04 -07:00
test_auth_checks.py	fix(proxy-auth): deny provider-wildcard access inferred through an unrecognized model namespace	2026-07-11 19:00:03 -07:00
test_banned_keyword_list.py
test_blog_posts_endpoint.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_check_batch_cost.py	fix(batches): keep batch state in sync on a poll without claiming attribution (#34456)	2026-08-08 16:01:47 -07:00
test_check_responses_cost.py	fix(proxy): fall back to the SDK when a queued response's deployment is missing	2026-08-05 23:13:15 -07:00
test_custom_callback_input.py
test_custom_logger_s3_gcs.py	chore(tests): thread config_file_path through s3/gcs custom-logger tests	2026-05-13 01:13:52 +00:00
test_custom_tokenizer_bug.py	test: make custom_tokenizer proxy tests hermetic (#29643)	2026-06-04 12:51:37 -07:00
test_db_schema_changes.py
test_default_end_user_budget_simple.py	Litellm oss staging 030626 (#29578)	2026-06-03 11:01:51 -07:00
test_deployed_proxy_keygen.py
test_deprecated_key_grace_period.py	Litellm key rotation bug (#27756)	2026-05-12 17:16:37 -07:00
test_e2e_pod_lock_manager.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_gemini_agents_endpoints.py	Gemini managed agents support (#28270)	2026-05-19 16:02:03 -07:00
test_get_favicon.py	test(proxy): align favicon remote asset expectations	2026-04-30 11:46:45 -07:00
test_get_image.py	fix(static-assets): browser-load remote branding assets	2026-04-30 11:30:57 -07:00
test_google_endpoint_routing.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_google_gemini_proxy_request.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_jwt.py	test(proxy): stop running real-DB tests in GitHub Actions unit jobs (#29700)	2026-06-04 14:56:02 -07:00
test_jwt_key_mapping.py	feat(auth): resolve caller identity once into a Principal at the auth seam (#30887)	2026-06-20 18:49:41 -07:00
test_key_generate_dynamodb.py
test_key_generate_prisma.py	fix(spend-tracking): drop orphaned imports; align tests with alias contract	2026-04-29 18:53:12 +00:00
test_models_fallback_endpoint.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_multipart_bypass_repro.py	fix: harden /key/update authorization checks (#27878)	2026-05-14 04:16:04 +00:00
test_prisma_client_backoff_retry.py
test_prompt_test_endpoint.py	fix: harden /key/update authorization checks (#27878)	2026-05-14 04:16:04 +00:00
test_proxy_config_unit_test.py	fix(proxy): yaml store_prompts_in_spend_logs should take precedence over DB cached value (#35769)	2026-08-06 09:32:44 -07:00
test_proxy_custom_auth.py
test_proxy_custom_logger.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_proxy_encrypt_decrypt.py
test_proxy_exception_mapping.py
test_proxy_gunicorn.py
test_proxy_pass_user_config.py	test: test	2026-03-28 19:17:38 -07:00
test_proxy_reject_logging.py	[internal copy of #29089] fix: duplicate claude code traces (#29311)	2026-05-29 22:23:24 -07:00
test_proxy_routes.py	chore(ci): merge dev branch (#28801)	2026-05-25 13:44:49 -07:00
test_proxy_server.py	feat(router): add per-deployment allowed_fails_policy and cooldown_time override support (#34416)	2026-08-10 11:02:06 -07:00
test_proxy_server_caching.py
test_proxy_server_keys.py
test_proxy_server_langfuse.py
test_proxy_server_spend.py
test_proxy_setting_guardrails.py	fix(lakera-guardrail): use os.environ.get() to avoid KeyError on missing LAKERA_API_KEY	2026-02-17 19:30:22 -03:00
test_proxy_token_counter.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_proxy_utils.py	fix(proxy): skip team model aliases that point at deleted deployments	2026-07-28 19:45:00 +00:00
test_realtime_cache.py	feat: litellm oss 110626 (#30202)	2026-06-11 22:30:26 -07:00
test_reducto_ocr_route.py	Litellm oss staging 04 21 2026 2 (#26569)	2026-05-20 21:25:19 -07:00
test_request_size_limit_middleware.py	Fix early proxy request size enforcement (#27311)	2026-05-06 12:29:11 -07:00
test_response_polling_handler.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_response_polling_pre_call_checks.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_search_api_logging.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_server_root_path.py
test_skills_db.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_ui_path_detection.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_unit_test_max_model_budget_limiter.py	feat(proxy): add key-level budget_fallbacks to reroute requests when a per-model budget is exceeded (#31783)	2026-07-03 12:20:12 -07:00
test_unit_test_proxy_hooks.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_update_daily_tag_spend.py	perf(spend): write each daily spend batch in one upsert statement (#36448)	2026-08-10 17:06:00 -07:00
test_update_spend.py	feat(spend): rebuild the auto-router benchmarks backend as a per-session rollup (#35910)	2026-08-05 20:06:32 +00:00
test_user_api_key_auth.py	revert(proxy)!: stop enforcing user budget on team keys (#35271)	2026-07-30 20:19:49 +00:00
test_zero_cost_model_budget_bypass.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
vertex_key.json	test: update to new vertex ai keys	2026-03-28 20:19:05 -07:00