litellm/litellm-rust/docs/customer-proxy
Nate Armstrong 2d2ca95481
feat(gateway): write spend to the proxy's database from a native observer (#47041)
Adds a spend writer observer that records every gateway request in the
proxy's own Postgres tables with the same statements the Python proxy
uses: spend logs, key/user/team/team member/end user spend, and the
daily user, team and end-user activity tables. Writes are batched on the
proxy's timers and are additive, so replicas and Python proxies can
write side by side. The database pool is now shared between virtual
keys and the writer.


Claude-Session: https://claude.ai/code/session_0138knkqKpkoSr6PApenZan5

Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-19 09:58:43 -07:00
..
bedrock_messages-flow.svg feat(gateway): native Bedrock invoke for /v1/messages (#46814) 2026-10-16 12:43:01 -07:00
hooks-pipeline.svg feat(gateway): hooks and observers around inference requests, with usage and cost (#47032) 2026-10-19 09:58:43 -07:00
loadtest-rig.svg feat(gateway): load-test kit, Docker build knobs and TCP_NODELAY for the customer proxy (#46806) 2026-10-16 12:42:59 -07:00
openai_chat-flow.svg feat(gateway): native OpenAI chat completions with SSE passthrough (#46813) 2026-10-16 12:43:00 -07:00
ops-drain.svg feat(gateway): health probes, Prometheus /metrics and graceful drain (#46808) 2026-10-16 12:43:00 -07:00
ops-metrics.svg feat(gateway): health probes, Prometheus /metrics and graceful drain (#46808) 2026-10-16 12:43:00 -07:00
routing-cooldown.svg feat(router): load balance, retry and cool down across deployments of a model group (#46817) 2026-10-16 12:43:01 -07:00
routing-request-flow.svg feat(router): load balance, retry and cool down across deployments of a model group (#46817) 2026-10-16 12:43:01 -07:00
shared_state-redis.svg feat(gateway): share router cooldowns and follow proxy key invalidations through Redis (#47017) 2026-10-17 16:34:03 -07:00
spend-writer.svg feat(gateway): write spend to the proxy's database from a native observer (#47041) 2026-10-19 09:58:43 -07:00
virtual_keys-auth-flow.svg feat(gateway): accept virtual keys from LiteLLM_VerificationToken (#46819) 2026-10-16 12:43:01 -07:00