mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-27 06:13:07 +00:00
dba4fa0e94
* fix(proxy): flush tool discovery queue when use_redis_transaction_buffer is enabled With the Redis transaction buffer on, discovered tools were never written to LiteLLM_ToolTable: the only call to _flush_tool_discovery_queue was on the non-Redis commit path. Each pod's tool queue is never buffered in Redis, so every pod now flushes its own queue on each spend tick, before the leader lock check. Co-authored-by: Noah Nistler <60981020+noahnistler@users.noreply.github.com> * test(proxy): exercise real leader election in the tool discovery flush test The writer's PodLockManager had no Redis in the test, so neither case was ever the leader and the lock-held parameter changed nothing. The fake Redis also had no async_rpush_pipeline, so every tick took the push-failure branch. Wire the fake into the lock manager the way ProxyLogging does in production, back it with real lists, and assert only the lock holder drains the spend buffer. Co-authored-by: Noah Nistler <60981020+noahnistler@users.noreply.github.com> --------- Co-authored-by: Noah Nistler <60981020+noahnistler@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| _support | ||
| base_sdk_tests | ||
| benchmarks | ||
| code_coverage_tests | ||
| documentation_tests | ||
| e2e | ||
| e2e_harness | ||
| fixtures | ||
| harness_e2e | ||
| integration | ||
| rust-python-harness | ||
| test_litellm_rust | ||
| typing | ||
| unit | ||
| windows_tests | ||
| __init__.py | ||
| _fake_openai_endpoint_server.py | ||
| _flush_vcr_cache.py | ||
| _live_test_helpers.py | ||
| _master_key.py | ||
| _openai_record_replay_proxy.py | ||
| _process_helpers.py | ||
| _vcr_conftest_common.py | ||
| _vcr_redis_persister.py | ||
| _wait_helpers.py | ||
| _ws_vcr.py | ||
| AGENTS.md | ||
| capturing_transport.py | ||
| eval_swe_bench.py | ||
| fake_openai_endpoint.py | ||
| gettysburg.wav | ||
| large_text.py | ||
| openai_batch_completions.jsonl | ||
| pyrightconfig.json | ||
| README.MD | ||
| test_logging.conf | ||
| test_rust_python_harness.py | ||
| VCR_TESTING.md | ||
| white_100x100.png | ||
In total litellm runs 1000+ tests
[02/20/2025] Update:
To make it easier to contribute and map what behavior is tested,
we've started mapping the litellm directory in tests/unit
This folder can only run mock tests.