mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-05 02:41:56 +00:00
0ec619e7d1
Mutation testing surfaced three factory functions whose tests ran against them but asserted nothing that a mutation could break, so every planted bug survived. - litellm/llms/litellm_proxy/skills/code_execution.py: the OpenAI and Anthropic tool schemas were unpinned (the Anthropic one was not reached by any test at all) and the handler's default fallbacks were unchecked - litellm/containers/endpoint_factory.py: the endpoints.json contract, the generated sync/async function set and the response-type mapping were unpinned - litellm/llms/openai_like/dynamic_config.py: the generated Responses API config class had no coverage of auth header, URL resolution or the store override The openai_like tests clear _responses_config_cache around each test. Without that, the module-level cache hands back a class built before the mutation and the tests pass against mutated code. Verified by re-running mutmut per scope: llms/litellm_proxy 45.2% -> 62.8% (70 mutants newly killed) containers 36.8% -> 84.3% (45 mutants newly killed) llms/openai_like 55.7% -> 66.9% (34 mutants newly killed) |
||
|---|---|---|
| .. | ||
| chat | ||
| embedding | ||
| messages | ||
| responses | ||
| __init__.py | ||
| test_abliteration_provider.py | ||
| test_assemblyai_provider.py | ||
| test_charity_engine.py | ||
| test_cognition_provider.py | ||
| test_dynamic_config.py | ||
| test_empiriolabs_provider.py | ||
| test_json_providers.py | ||
| test_libertai_provider.py | ||
| test_meta_provider.py | ||
| test_pinstripes_provider.py | ||
| test_scx_ai_provider.py | ||
| test_tensormesh_provider.py | ||
| test_xiaomi_mimo.py | ||