joshua-berri 0ede0e10e7 fix(batch): preserve recoverable costs and prevent poll starvation (#47190) ... * fix(batch): preserve recoverable costs and rotate polling pages * test(batch): type retirement failure regression * fix(batch): alternate new arrivals with retry polling * test(batch): defer polling row annotation on Python 3.12 * test(batch): reconcile fixtures with atomic metadata claims * refactor(batch): simplify reconciliation to one bounded scan * fix(batch): restore arrival priority during retry scans * fix(batch): preserve recoverable jobs on unrelated resource errors * fix: revisit recent batches before old retry backlog --------- Co-authored-by: Joshua Valluru <326636767+joshua-berri@users.noreply.github.com>		2026-10-20 08:22:19 -07:00
..
html_forms
__init__.py
test_admin_ui_utils.py
test_auth_cache_invalidation_pubsub.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_cache_aware_routing.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_cache_codec.py
test_callback_config_validation.py	feat(otel): let a team or key excluded_services override the global setting for its OTel v2 destination (#45880)	2026-10-12 19:25:52 -04:00
test_callback_utils.py
test_check_batch_cost.py	fix(batch): preserve recoverable costs and prevent poll starvation (#47190)	2026-10-20 08:22:19 -07:00
test_check_responses_cost.py	fix(responses): count billed background responses toward the creator's project and per-model budgets (#47504)	2026-10-20 12:59:37 +00:00
test_codex_model_catalog.py
test_config_sync_pubsub.py	fix(proxy): resync configuration after Redis reconnect (#43313)	2026-10-19 21:21:53 -07:00
test_credential_hydration.py	fix(secret_managers)!: resolve oidc/file and oidc/env refs in admin-configured api_key per request (#47341)	2026-10-20 01:43:59 +00:00
test_custom_openapi_spec.py	docs(proxy): describe /v1/decisions and /v1/systemone in Swagger UI (#45838)	2026-10-10 21:04:59 +00:00
test_debug_utils.py	fix(router): keep the prompt caching affinity pin alive as long as the prefix's cache_control ttl (#46084)	2026-10-14 21:10:09 -07:00
test_discoverable_model_filter.py
test_encrypt_decrypt_utils.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_error_body_call_id.py
test_expired_ui_session_key_cleanup_manager.py
test_get_routes.py
test_http_parsing_utils.py	refactor(lens): connect LiteLLM to the independent Lens service (#45529)	2026-10-09 16:17:05 -07:00
test_json_merge_patch.py
test_key_rotation_e2e.py
test_key_rotation_integration.py
test_key_rotation_lock.py
test_key_rotation_manager.py
test_load_config_utils.py
test_model_deprecation.py	feat(proxy): name the successor model for deprecating deployments (#41670)	2026-10-15 14:50:14 -07:00
test_model_listing_utils.py	fix(proxy): resolve model aliases to their target deployment for listing metadata (#41041)	2026-10-15 00:38:50 -07:00
test_openai_endpoint_utils.py
test_openai_error_payload.py
test_openapi_route.py	fix(proxy): build the OpenAPI schema off the event loop so a cold /openapi.json no longer stalls the worker (#47352)	2026-10-20 04:31:37 +00:00
test_openapi_schema_compat.py	fix(proxy): build the OpenAPI schema off the event loop so a cold /openapi.json no longer stalls the worker (#47352)	2026-10-20 04:31:37 +00:00
test_periodic_reload_schedule.py
test_proxy_encrypt_decrypt.py
test_rbac_utils.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_realtime_cache.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_registry_read_through.py	feat(decisions): add Databricks ai_decide as a /v1/decisions provider and auto-router decider (#45200)	2026-10-09 16:19:23 -07:00
test_request_tag_mappings.py	feat(proxy): map baggage values to budget tags (#47358)	2026-10-20 09:09:42 +00:00
test_reset_budget_job.py	fix(proxy): reset end-user spend in committed pages so the budget cascade survives a large LiteLLM_EndUserTable (#46502)	2026-10-15 19:47:12 -07:00
test_resource_ownership.py	refactor(core_utils): move resource_ownership out of the proxy (#45805)	2026-10-10 21:02:53 +00:00
test_scheduled_job_stagger.py
test_semantic_text_index.py	fix(mcp): leave out tool texts too long to embed instead of failing tool search (#43554)	2026-10-14 14:53:00 -07:00
test_slow_gc_logger.py	test(e2e): event_loop_stalls perf case fails on a gateway event-loop hold over 100 ms that is not on its allowlist (#46974)	2026-10-17 06:55:53 +00:00
test_sse_keepalive.py
test_static_asset_utils.py
test_swagger_utils.py
test_timezone_utils.py
test_token_count_settings.py	feat(bedrock): route token counts from model metadata (#47441)	2026-10-19 21:36:13 -07:00
test_upsert_budget_membership.py	feat(proxy): per-model team member budgets with router fallback (#43887)	2026-10-10 20:33:55 +00:00
test_user_api_key_cache.py
test_validation_error_body.py