mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-02 07:13:02 +00:00
docs(accounting): publish sanitized T5 verification evidence
This commit is contained in:
commit
59bd3e4ac0
4 changed files with 63 additions and 0 deletions
17
README.md
Normal file
17
README.md
Normal file
|
|
@ -0,0 +1,17 @@
|
|||
# T5 round-three review evidence
|
||||
|
||||
Sanitized independent Devin evidence for [foundation #49190](https://github.com/BerriAI/litellm/pull/49190) and [capture #49133](https://github.com/BerriAI/litellm/pull/49133)
|
||||
|
||||
[Download the evidence bundle](r3_t5_evidence_sanitized.zip)
|
||||
|
||||
Archive SHA-256 `eeddf7eaa98b01205355e9b32d0b8ef439dc76d6e6e64dbf34695de31e675799`
|
||||
|
||||
Baseline `ccc56d27adeeece2a1069bde587c76486ba9ab39`, foundation `b368c432d03de80d5b6efc2dd6d6389c4d9c9b11`, combined capture `a2fbb6d260a5a25076542e836d9eb398648e51c5`
|
||||
|
||||
The archive includes the acceptance report, provenance, live measurements/logs, reproduction scripts/configuration, and complete per-PR coverage JSON/XML. Start with README.txt and artifacts/R3_T5_ACCEPTANCE_REPORT.md inside it. Historical round-two carry-forward evidence retains its tested SHA attribution
|
||||
|
||||
Changed-line coverage with real PostgreSQL integration is 204/206 (99.03%) for foundation and 491/508 (96.65%) for capture. The report explains remaining lines and baseline-reproduced unrelated test failures
|
||||
|
||||
Live Vertex/GCS lifecycle was not run due to unavailable bucket access. The author accepted this explicit verification limitation for T5. Existing Vertex unit coverage and the local OpenAI route reproduction do not prove live GCS behavior
|
||||
|
||||
Ephemeral test credentials and database credentials are redacted, with a redaction manifest. Process-ID files and compiled Python caches are excluded. No measurement or coverage result is changed. No application code or workflow lives on this evidence-only branch. No scripts were executed during packaging
|
||||
31
capture-diff-coverage.txt
Normal file
31
capture-diff-coverage.txt
Normal file
|
|
@ -0,0 +1,31 @@
|
|||
/home/ubuntu/repos/wt-head/.venv/lib/python3.12/site-packages/diff_cover/diff_cover_tool.py:315: UserWarning: The --json-report option is deprecated. Use --format json:/home/ubuntu/t5_verify/artifacts/r3cov_cap_diff_cover.json instead.
|
||||
warnings.warn(
|
||||
-------------
|
||||
Diff Coverage
|
||||
Diff: b368c432d03de80d5b6efc2dd6d6389c4d9c9b11...HEAD, staged and unstaged changes
|
||||
-------------
|
||||
litellm/_internal_context.py (100%)
|
||||
litellm/batches/batch_utils.py (87.0%): Missing lines 325-327
|
||||
litellm/litellm_core_utils/litellm_logging.py (96.2%): Missing lines 2675,2869,6983
|
||||
litellm/litellm_core_utils/realtime_streaming.py (50.0%): Missing lines 545
|
||||
litellm/llms/vertex_ai/batches/transformation.py (100%)
|
||||
litellm/proxy/_types.py (100%)
|
||||
litellm/proxy/common_request_processing.py (100%)
|
||||
litellm/proxy/hooks/proxy_track_cost_callback.py (89.7%): Missing lines 334-335,339,631
|
||||
litellm/proxy/proxy_server.py (100%)
|
||||
litellm/proxy/spend_tracking/cost_finalization.py (100%)
|
||||
litellm/proxy/spend_tracking/spend_tracking_utils.py (100%)
|
||||
litellm/proxy/spend_tracking/usage_capture.py (98.6%): Missing lines 305,571,574,594
|
||||
litellm/proxy/utils.py (100%)
|
||||
litellm/rag/main.py (100%)
|
||||
litellm/responses/main.py (0.0%): Missing lines 437,514
|
||||
litellm/responses/mcp/chat_completions_handler.py (100%)
|
||||
litellm/router.py (100%)
|
||||
litellm/types/utils.py (100%)
|
||||
litellm/utils.py (100%)
|
||||
-------------
|
||||
Total: 508 lines
|
||||
Missing: 17 lines
|
||||
Coverage: 96%
|
||||
-------------
|
||||
|
||||
15
foundation-diff-coverage.txt
Normal file
15
foundation-diff-coverage.txt
Normal file
|
|
@ -0,0 +1,15 @@
|
|||
/home/ubuntu/repos/wt-fnd/.venv/lib/python3.12/site-packages/diff_cover/diff_cover_tool.py:315: UserWarning: The --json-report option is deprecated. Use --format json:/home/ubuntu/t5_verify/artifacts/r3cov_fnd_diff_cover.json instead.
|
||||
warnings.warn(
|
||||
-------------
|
||||
Diff Coverage
|
||||
Diff: ccc56d27adeeece2a1069bde587c76486ba9ab39...HEAD, staged and unstaged changes
|
||||
-------------
|
||||
litellm/proxy/db/accounting_ledger.py (100%)
|
||||
litellm/proxy/db/exception_handler.py (100%)
|
||||
litellm/proxy/spend_tracking/usage_meter.py (98.8%): Missing lines 165,219
|
||||
-------------
|
||||
Total: 206 lines
|
||||
Missing: 2 lines
|
||||
Coverage: 99%
|
||||
-------------
|
||||
|
||||
BIN
r3_t5_evidence_sanitized.zip
Normal file
BIN
r3_t5_evidence_sanitized.zip
Normal file
Binary file not shown.
Loading…
Add table
Reference in a new issue