mirror of
https://github.com/fabro-sh/fabro.git
synced 2026-10-01 02:04:24 +00:00
27f16f89c4
lithos-llm attaches a cost to every response at the client: the codec keeps a provider-reported cost when the provider supplies one, and the resolver fills the catalog's price for the route when it does not. Pebble records that priced usage on every assistant turn and sums it, so each AssistantMessage on the stream, and the store fold's live stage usage, already carries the cost. Fabro's catalog re-pricing of the same tokens was redundant, and is gone. model_usage_from_llm, with_reported_cost, and every estimate_cost call in fabro are deleted. The pebble handler's stage_usage groups pebble's accounts by route and sums them with Usage::saturating_add, keeping the cost and source pebble carried, so the terminal stage.completed usage is the live fold's sum; it no longer fails when the catalog does not know a provider. A one-shot prompt stage records the response's own usage and cost as lithos-llm returned it. The per-model price cards in fabro-llm's API module stay. Tests: the pebble handler sums Catalog and Provider costs per row and leaves a row's and the total's cost unknown once an answer was unpriced; the store fold shows the same tokens and cost live and at completion, and None at both for an unpriced answer; the agent integration test compares the whole completed Usage with the live fold, cost included; a one-shot prompt stage on a mocked OpenAI-compatible provider reports a Catalog cost that lithos-llm's resolver attached, with no fabro pricing. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| attractor_compat.rs | ||
| cp_integration.rs | ||
| daytona_integration.rs | ||
| git_integration.rs | ||
| integration.rs | ||
| main.rs | ||
| pebble_agent.rs | ||