litellm/litellm-rust/crates/host-python
Yujong Lee 9f337ea9b5 perf(model-cost)!: serve bundled prices at import and refresh them from a Rust thread [11/12]
import litellm installs the bundled map and never touches the network. One Rust thread fetches the remote map after
import and installs it into the bound dict, drops its result when a newer install landed, stays off in a process
reserved for forking and restarts in a forked child that has no remote map yet. The Python retry thread and the
import-complete event are gone

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 09:12:48 -07:00
..
src perf(model-cost)!: serve bundled prices at import and refresh them from a Rust thread [11/12] 2026-10-28 09:12:48 -07:00
tests refactor(rust-bridge): return an unstarted Execution from native entrypoints and drive it in Python (#46299) 2026-10-14 17:50:44 -07:00
AGENTS.md refactor(rust-bridge): return an unstarted Execution from native entrypoints and drive it in Python (#46299) 2026-10-14 17:50:44 -07:00
Cargo.toml refactor(host-python): run the Python driver as one async body (#46235) 2026-10-14 17:19:06 -07:00