litellm/tests/code_coverage_tests
mateo-berri b997a28c53
fix(ci): report budgets the startup guard cannot resolve
The timeout contract check skipped a job whenever either budget came from
a `with:` value it could not parse, or from a matrix column no `include`
row supplied as a number. Both paths produced no pairs and no errors, so
the guard printed "invariants hold" for a caller whose budgets were never
compared at all. A caller reading `${{ matrix.timeout }}` off a mistyped
column while capping the job at 1 minute passed clean.

Unresolvable budgets now come back as the reason they could not be read
and are reported as violations, which is the whole point of a guard built
to catch checks that silently do not run. `Column` tags a matrix
reference so it stays distinguishable from that reason string, and the
report names only the columns that resolve nowhere, since a column every
row supplies is not what left the pair unchecked.
2026-08-10 18:12:18 +00:00
..
azure_client_usage_test.py
ban_constant_numbers.py
ban_copy_deepcopy_kwargs.py
bedrock_pricing.py
callback_manager_test.py
check_data_replace_usage.py
check_e2e_no_raw_requests.py test(e2e): drive a real Linear OAuth MCP through chat completions under both ingress headers 2026-07-22 23:29:10 -07:00
check_endpoint_coverage.py
check_fastuuid_usage.py
check_get_model_cost_key_performance.py
check_guardrail_apply_decorator.py
check_licenses.py
check_prisma_binary_cache.py fix(ci): bound setup steps so pytest always gets its full budget 2026-08-10 16:22:07 +00:00
check_provider_folders_documented.py
check_spanattributes_value_usage.py
check_unsafe_enterprise_import.py
check_workflow_startup_safety.py fix(ci): report budgets the startup guard cannot resolve 2026-08-10 18:12:18 +00:00
code_qa_check_tests.py
enforce_llms_folder_style.py feat(search): add TinyFish as search provider (#30634) 2026-06-18 09:17:53 -07:00
ensure_async_clients_test.py
info_log_check.py
liccheck.ini feat(rust): 1:1 port of OpenAI Responses API WebSockets to litellm-rust (#33849) 2026-07-19 01:55:35 +00:00
license_cache.json
litellm_logging_code_coverage.py
log.txt
memory_test.py
pass_through_code_coverage.py
prevent_key_leaks_in_exceptions.py
recursive_detector.py fix(guardrails): scan /v1/messages tool traffic 2026-08-05 14:11:27 -07:00
router_code_coverage.py
router_enforce_line_length.py
test_aio_http_image_conversion.py
test_ban_set_verbose.py
test_chat_completion_imports.py
test_proxy_types_import.py
test_router_strategy_async.py
user_api_key_auth_code_coverage.py