litellm/litellm-rust
Yujong Lee a04b76fe7d feat(lens): own trace reads behind a cached TraceStore port
Move storage-independent trace reads into litellm-traces-cache behind a
TraceStore port that ClickHouse implements. One keyset pager drives the
span, list span and spend reads, and a run list batch reads spend once.

Trace opens, pages and list summaries share one resolved read per trace
in an in-process cache with single-flight loading. Live traces and reads
with unknown spend expire after 5s, quiet traces after 10 minutes, failed
reads are never cached, and the accepted list page size is remembered per
scope.

Trace read failures map to their own status and code (400, 409, 413, 503
with Retry-After), and the trace drawer retries temporary failures while
offering only a refresh for changed or oversized traces.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-04 10:23:27 -07:00
..
.agents/skills/rust-tracing feat(rust): add structured route lifecycle tracing (#43466) 2026-09-27 19:18:58 -07:00
crates feat(lens): own trace reads behind a cached TraceStore port 2026-10-04 10:23:27 -07:00
.gitignore feat: add LiteLLM Rust workspace with Mistral OCR bridge (#31033) 2026-06-23 13:16:47 -07:00
AGENTS.md feat(rust): add structured route lifecycle tracing (#43466) 2026-09-27 19:18:58 -07:00
Cargo.lock feat(lens): own trace reads behind a cached TraceStore port 2026-10-04 10:23:27 -07:00
Cargo.toml refactor(traces): extract snapshot cache (#44424) 2026-10-03 13:03:30 -07:00
clippy.toml feat(rust): add the MCP gateway (#43470) 2026-09-27 19:37:41 -07:00