mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-11 08:38:24 +00:00
07be67603c
* test: update the spend tests that still expected the pre-ledger accounting queues #49872 made the SpendLogs ledger the default accounting path on purpose. A batch with no billable request now writes no cost row, a call the guardrail fails closed during a vendor outage keeps one spend row of either status while its key is still charged once, and charges left at a graceful shutdown are applied by the next start. The daily spend batch shutdown tests exercise the old queue, so they pin use_spend_logs_ledger to false. * test(integration): price the guardrail relay model so the outage test can assert the charge The relay model had no price, so every stream cost $0 and the outage test could not tell a charged call from an uncharged one. Both rigs now price it, and the test expects each served stream to cost 9 input and 4 output tokens and the key to be charged for all sixteen. Also notes the skipped batch cost row case in the e2e rules file, next to the other explicit skips. * test: repair four tests that fail for reasons outside the product The OpenAPI docs gate test rebuilds the Rust extension with uv, and the integration lane blocks outbound traffic, so uv could not refresh its PyPI index for maturin. The test now runs uv offline against the cache the dependency install already filled. The response cache test expected a chat reply blocked with empty content to be cached. Since #50057 a reply with no output is never cached, so that case now expects the repeat to reach the upstream and the real answer to be cached. The Gemini cache hit e2e test gave the model 16 tokens, which its thinking can use up, and a reply with no text is not cached. It now allows 512 and checks the first reply has text. The Together cache read e2e test picks the cheapest model with a cache read price. Since #50491 that is a -latest alias, whose target reports no cached tokens. Aliases are now left out of the pick. |
||
|---|---|---|
| .. | ||
| response_cache_case.py | ||
| test_cache_max_messages.py | ||
| test_embedding_file_block_cache.py | ||
| test_in_memory_cache_heap_bound.py | ||
| test_response_cache_chaos.py | ||
| test_response_cache_empty_output.py | ||
| test_response_cache_model_group_key.py | ||
| test_response_cache_stream_replay.py | ||