mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-17 09:34:48 +00:00
* fix(messages): load the anthropic beta map only when a filter has a beta to filter Since #52042 the Rust messages route asked Python for the beta map on every azure_ai, Bedrock Invoke and Foundry call while decoding the request, so the first such call on each worker downloaded the remote map even when it sent no anthropic-beta, and the download ran synchronously on the request path. The bridge now installs the map only once Python has loaded it. When a filter first meets a beta and no map is installed, it asks the host to load it on the loader thread and uses the compiled table for that call, as before #52042. * fix(messages): start at most one background beta map load at a time A burst of beta-carrying calls while the first download was still in flight queued one load task per call on the loader thread. A non-blocking lock now lets only one load wait in the queue, and it is released when that load ends. |
||
|---|---|---|
| .. | ||
| host | ||
| messages | ||
| ocr | ||
| trace | ||
| __init__.py | ||
| AGENTS.md | ||
| native_route_wheel_test.py | ||
| stubtest.ini | ||
| test_bindings.py | ||
| test_catalog.py | ||
| test_clickhouse.py | ||
| test_configuration.py | ||
| test_detectors.py | ||
| test_execution.py | ||
| test_failures.py | ||
| test_fork_guard.py | ||
| test_logger.py | ||
| test_public_call.py | ||
| test_runtime.py | ||
| test_token_counter.py | ||
| test_tokenizer.py | ||
| test_verify_linux_native_wheel.py | ||