litellm/tests/translation_characterization/cases
mateo-berri 85585b63b0 test: add translation characterization corpus pinning v1 transform seams
Snapshot corpus for the translation v2 differential gate: 19 OpenAI-format
request cases x {anthropic, bedrock converse, bedrock invoke} through the
real v1 transform_request path (get_optional_params, validate_environment
included), recorded provider responses through transform_response, SSE and
event-stream replays through CustomStreamWrapper plus the real decoders, and
both /v1/messages surfaces (anthropic<->openai adapter round-trip and the
native AnthropicMessagesConfig quirks: max_tokens pop, reasoning_effort
rewrite, advisor-block stripping). 89 canonical-JSON snapshots, deterministic
via frozen uuid/fastuuid/time, regenerated with --snapshot-update or
SNAPSHOT_UPDATE=1. Wired into CI as a job in test-unit-llm-providers.yml and
a make test-characterization target
2026-06-11 18:48:10 +00:00
..
cache_control_messages.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
cache_control_tools.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
full_combo.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
image_base64.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
image_url.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
multi_turn.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
params_sampling.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
pdf_base64.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
plain_text.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
reasoning_effort_low.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
response_format_json_object.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
response_format_json_schema.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
system_prompt.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
thinking_enabled.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
thinking_history_blocks.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
tools_basic.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
tools_forced_choice.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
tools_parallel.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00
tools_streamed_args_roundtrip.json test: add translation characterization corpus pinning v1 transform seams 2026-06-11 18:48:10 +00:00