7 commits

Author	SHA1	Message	Date
kerry	8ecbf3dbc1	test: drop tests that pin provider-owned cost map values ... The repo rule is that a test must only fail when litellm code changes, never when a vendor updates a price, renames a field, or drops a model. These tests asserted shipped catalog entries directly, comparing lookup results to literals copied from model_prices_and_context_window.json or requiring named entries to exist or be absent, so every cost map sync could break them without any litellm code changing Tests that exercise real litellm behavior with an injected local model_cost, invariants like backup parity, and assertions on non-lookup code paths are untouched Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-18 03:55:51 +00:00
Yujong Lee	561533c596	wip	2026-09-14 11:48:24 -07:00
yujonglee	5f2b4d27d7	test(ocr): add SDK callback E2E parity (#40061) ... * test(ocr): cover SDK callback parity * test(ocr): compare callback kwargs	2026-09-07 11:23:12 -07:00
yujonglee	b75ac5cf52	feat(python): rename Rust rollout API (#39704)	2026-09-04 08:40:44 -07:00
yujonglee	ee08c36fc0	refactor(tests): restructure rust python harness around strategy definitions (#39628) ... * wip * refactor(tests): move sdk function tracing into rust python harness * dead code * fix: handle harness keyboard interrupts * refactor(tests): deduplicate rust python harness helpers * fix(harness): expose validated strategy choices * wip * refactor(harness): let strategies own parity reports * docs(harness): update strategy structure * refactor(harness): localize strategy report views * wip * fix(harness): satisfy mapping runner type checks * fix(harness): clarify trace parity output * wip * fix(harness): clarify unit mapping report * fix(harness): finalize trace parity contracts * refactor(harness): structure parity contracts * feat: derive unit test mapping from traces * feat(harness): map rstest test families * feat(ocr): port Azure document intelligence tests * feat(harness): enforce complete unit mappings * feat(ocr): add reducto core transforms * feat(harness): classify host-only unit tests * fix(ocr): complete Rust provider plumbing * fix(harness): reuse OCR parity workers	2026-09-03 21:15:01 -07:00
Yujong Lee	8c180afd4b	test(ocr): record provider fixtures in the migration harness	2026-09-03 10:16:40 -07:00
yujonglee	2c30fe16b0	Merge pull request #38765 from BerriAI/litellm_ocr_sdk_parity_tests ... test(harness): add OCR parity with migration strategy runners	2026-09-03 10:16:35 -07:00