litellm/litellm-rust/crates
Yujong Lee 9f337ea9b5 perf(model-cost)!: serve bundled prices at import and refresh them from a Rust thread [11/12]
import litellm installs the bundled map and never touches the network. One Rust thread fetches the remote map after
import and installs it into the bound dict, drops its result when a newer install landed, stays off in a process
reserved for forking and restarts in a forked child that has no remote map yet. The Python retry thread and the
import-complete event are gone

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 09:12:48 -07:00
..
auth refactor(rust): prepare inference and auth foundations for the gateway (#43287) 2026-09-25 23:12:48 -07:00
auth-aws feat(rust): one LitellmParams type for a config and a caller (#45642) 2026-10-09 16:29:45 -07:00
auth-azure refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426) 2026-09-27 14:53:12 -07:00
auth-gcp fix(vertex): report an unreadable credentials file as a read failure (#40173) 2026-10-15 02:03:56 -07:00
auth-types feat(rust): one LitellmParams type for a config and a caller (#45642) 2026-10-09 16:29:45 -07:00
cache refactor(rust): derive strum VariantArray and string conversions (#45434) 2026-10-08 21:24:49 +00:00
cache-azure-blob feat: improve trace ingestion and trace details (#43975) 2026-10-01 13:45:33 -07:00
cache-disk feat(rust): add litellm-db and litellm-db-testing workspace scaffolding (#43504) 2026-09-27 18:48:45 -07:00
cache-gcs feat: improve trace ingestion and trace details (#43975) 2026-10-01 13:45:33 -07:00
cache-memory refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-qdrant-semantic refactor(http): hand out an owned Client and route all providers through the pool (#43245) 2026-09-25 18:31:15 -07:00
cache-redis feat(rust): add redis-client crate for standalone Redis (#48269) 2026-10-26 18:41:46 -07:00
cache-redis-semantic feat(rust): add redis-client crate for standalone Redis (#48269) 2026-10-26 18:41:46 -07:00
cache-response feat(rust): add redis-client crate for standalone Redis (#48269) 2026-10-26 18:41:46 -07:00
cache-s3 refactor(model-cost): fetch and reload the cost map through Rust 2026-10-28 09:10:12 -07:00
cache-testing refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-valkey-semantic feat(rust): add redis-client crate for standalone Redis (#48269) 2026-10-26 18:41:46 -07:00
callbacks-legacy-python refactor(anthropic): rename llms/anthropic/pass_through to llms/anthropic/messages (#48510) 2026-10-27 10:08:25 -07:00
circuit-breaker feat(rust): add circuit-breaker crate and guard redis-client with it (#48277) 2026-10-26 18:41:47 -07:00
config feat(gateway): connect to Redis from config.yaml (#48284) 2026-10-26 18:41:47 -07:00
core-utils fix(http_handler): name the timeout phase and limit that fired instead of "after None seconds" (#48250) 2026-10-26 16:04:33 -07:00
coroutine refactor(rust-bridge): return an unstarted Execution from native entrypoints and drive it in Python (#46299) 2026-10-14 17:50:44 -07:00
cost refactor(cost): price images, search and TTS with the Rust cost core [10/12] 2026-10-28 09:11:43 -07:00
db feat(db): add typed daily end-user spend upsert (#48237) 2026-10-26 17:05:08 -07:00
db-testing feat(rust): add redis-client crate for standalone Redis (#48269) 2026-10-26 18:41:46 -07:00
framer refactor(rust): one stream codec shape per API format (#45996) 2026-10-13 15:30:14 -07:00
gateway feat(gateway): connect to Redis from config.yaml (#48284) 2026-10-26 18:41:47 -07:00
gateway-auth docs(agents): ban semicolons and colons in human-facing text (#45684) 2026-10-09 16:36:32 -07:00
gateway-inference refactor(inference): rename RouteError to Error (#47771) 2026-10-21 07:03:18 -07:00
gateway-management feat(rust): add virtual key storage contracts (#43468) 2026-09-27 19:18:59 -07:00
gateway-mcp test: migrate proxy security, schema migration and MCP legacy tests (#45937) 2026-10-11 16:17:24 -07:00
gateway-ui feat(ui): adopt the new LiteLLM logo and monogram (#43913) 2026-09-30 14:51:06 -07:00
host feat(rust): settle EdenAI Messages reported cost (#45698) 2026-10-12 17:39:08 -07:00
host-http refactor(rust): centralize host execution and compose callbacks (#43515) 2026-09-28 19:20:27 +00:00
host-native docs(agents): ban semicolons and colons in human-facing text (#45684) 2026-10-09 16:36:32 -07:00
host-python perf(model-cost)!: serve bundled prices at import and refresh them from a Rust thread [11/12] 2026-10-28 09:12:48 -07:00
http fix(http): restore the 15s aiohttp keep-alive default in the Python and Rust clients (#46355) 2026-10-14 10:50:11 -07:00
inference refactor(inference): rename RouteError to Error (#47771) 2026-10-21 07:03:18 -07:00
inference-chat refactor(inference): rename RouteError to Error (#47771) 2026-10-21 07:03:18 -07:00
inference-messages refactor(llms): rename model-version transformation files to family names (#48509) 2026-10-26 18:53:16 -07:00
inference-ocr refactor(inference): rename RouteError to Error (#47771) 2026-10-21 07:03:18 -07:00
inference-responses refactor(inference): rename RouteError to Error (#47771) 2026-10-21 07:03:18 -07:00
inference-testing feat(rust): settle EdenAI Messages reported cost (#45698) 2026-10-12 17:39:08 -07:00
inference-transcription refactor(inference): rename RouteError to Error (#47771) 2026-10-21 07:03:18 -07:00
litellm refactor(rust): expand logging and test coverage across gateway and Anthropic messages (#43295) 2026-09-26 08:04:19 +00:00
llms refactor(llms): rename model-version transformation files to family names (#48509) 2026-10-26 18:53:16 -07:00
llms-types fix(azure_ai): forward the thinking-binding-controls beta header to Foundry (#48033) 2026-10-23 16:34:55 -07:00
model-catalog refactor(cost): price images, search and TTS with the Rust cost core [10/12] 2026-10-28 09:11:43 -07:00
model-catalog-refresh refactor(model-cost): fetch and reload the cost map through Rust 2026-10-28 09:10:12 -07:00
python-bridge perf(model-cost)!: serve bundled prices at import and refresh them from a Rust thread [11/12] 2026-10-28 09:12:48 -07:00
python-compat docs(agents): ban semicolons and colons in human-facing text (#45684) 2026-10-09 16:36:32 -07:00
redis-client feat(gateway): connect to Redis from config.yaml (#48284) 2026-10-26 18:41:47 -07:00
redis-testing feat(gateway): connect to Redis from config.yaml (#48284) 2026-10-26 18:41:47 -07:00
router refactor(rust): give Messages configs typed litellm params (#45611) 2026-10-09 16:29:45 -07:00
router-types feat(rust): one LitellmParams type for a config and a caller (#45642) 2026-10-09 16:29:45 -07:00
s3 refactor(model-cost): fetch and reload the cost map through Rust 2026-10-28 09:10:12 -07:00
secrets test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554) 2026-10-09 09:48:10 -07:00
secrets-aws feat: improve trace ingestion and trace details (#43975) 2026-10-01 13:45:33 -07:00
secrets-azure feat: improve trace ingestion and trace details (#43975) 2026-10-01 13:45:33 -07:00
secrets-cyberark feat: improve trace ingestion and trace details (#43975) 2026-10-01 13:45:33 -07:00
secrets-google feat: improve trace ingestion and trace details (#43975) 2026-10-01 13:45:33 -07:00
secrets-hashicorp feat: improve trace ingestion and trace details (#43975) 2026-10-01 13:45:33 -07:00
secrets-types refactor(rust): derive strum VariantArray and string conversions (#45434) 2026-10-08 21:24:49 +00:00
spend-clickhouse feat(rust): add redis-client crate for standalone Redis (#48269) 2026-10-26 18:41:46 -07:00
storage-clickhouse feat(rust): add redis-client crate for standalone Redis (#48269) 2026-10-26 18:41:46 -07:00
testkit refactor(rust): derive strum VariantArray and string conversions (#45434) 2026-10-08 21:24:49 +00:00
token-counter refactor(rust): add shared llms wire type derives (#43730) 2026-09-29 09:19:33 -07:00
token-counter-fast refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426) 2026-09-27 14:53:12 -07:00
token-counter-huggingface refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426) 2026-09-27 14:53:12 -07:00
token-counter-tiktoken refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426) 2026-09-27 14:53:12 -07:00
tracing feat(rust): add structured route lifecycle tracing (#43466) 2026-09-27 19:18:58 -07:00