scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-01 02:02:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 91
litellm/litellm-rust/crates
History
Yujong Lee 9b747bf337 feat(caching): give RedisCache a pub/sub and lease surface and drop raw client reaches 
Add async_publish and async_subscribe to the Python RedisCache, returning a
RedisSubscription that yields RedisMessage values and skips redis-py's
subscribe acks, plus connection_pool_status for the debug endpoint. Cluster
clients raise NotImplementedError, matching the existing skip behaviour.

Move the config sync and auth cache invalidation modules onto that surface
and rewrite the MCP refresh lock onto async_register_script, so no proxy code
reaches into init_async_client or redis_client any more. This defines the
surface a native RedisCache has to match.

On the Rust side add the PubSubCache and MessageStream capability traits and
implement them in cache-redis with a dedicated subscription connection driven
by a reader thread, tested against an in-process RESP server over a real
socket.
2026-09-24 09:19:14 -07:00
..
auth refactor(rust): split auth facade from shared types 2026-09-20 15:45:38 -07:00
auth-aws feat(rust-bridge): add cache and secret migration foundations (#42328) 2026-09-22 03:41:04 +00:00
auth-azure feat(rust-bridge): add cache and secret migration foundations (#42328) 2026-09-22 03:41:04 +00:00
auth-gcp feat(rust-bridge): add cache and secret migration foundations (#42328) 2026-09-22 03:41:04 +00:00
auth-types feat(rust-bridge): add cache and secret migration foundations (#42328) 2026-09-22 03:41:04 +00:00
cache feat(caching): give RedisCache a pub/sub and lease surface and drop raw client reaches 2026-09-24 09:19:14 -07:00
cache-azure-blob refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-disk refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-gcs refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-memory refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-qdrant-semantic refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-redis feat(caching): give RedisCache a pub/sub and lease surface and drop raw client reaches 2026-09-24 09:19:14 -07:00
cache-redis-semantic refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-response refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-s3 refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-testing refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
cache-valkey-semantic refactor(rust): align the cache crates with Python and wire every native backend (#42530) 2026-09-22 13:13:02 -07:00
callbacks-legacy-python style(rust): format renamed callback adapter 2026-09-19 23:08:37 +00:00
core feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
core-utils feat(logger): dispatch Python logging through the Rust diagnostics processor (#42616) 2026-09-22 18:44:15 -07:00
cost feat(rust): add standalone cost calculator (#42604) 2026-09-22 22:50:28 +00:00
framer fix(rust): pin aws-sdk-s3 without relaxing eventstream pins 2026-09-21 20:39:17 +00:00
host refactor(rust): move RouteMachine out of core into litellm-host next to the Machine trait 2026-09-18 15:45:08 -07:00
host-python feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
http fix(rust): preserve HTTP host and TLS error context 2026-09-21 21:32:33 +00:00
llms feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
model-catalog fix(model-catalog): declare above_32k cost fields on ModelInfo (#42856) 2026-09-23 19:40:09 -07:00
python-bridge feat(rust-bridge): extend native dispatch foundation to chat completions, responses, and messages (#42805) 2026-09-23 21:47:27 +00:00
python-compat feat(rust): add python-compat crate for Python data formats (#42510) 2026-09-22 12:16:56 -07:00
secrets feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
secrets-aws feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
secrets-azure feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
secrets-cyberark feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
secrets-google feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
secrets-hashicorp feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
secrets-types feat(secrets): route secret resolution through native Rust backends (#42619) 2026-09-23 08:24:57 -07:00
token-counter feat(tokenizer): preserve Python defaults with opt-in Rust dispatch (#42174) 2026-09-22 04:41:11 +00:00
token-counter-fast feat(tokenizer): preserve Python defaults with opt-in Rust dispatch (#42174) 2026-09-22 04:41:11 +00:00
token-counter-huggingface feat(tokenizer): preserve Python defaults with opt-in Rust dispatch (#42174) 2026-09-22 04:41:11 +00:00
token-counter-tiktoken feat(tokenizer): preserve Python defaults with opt-in Rust dispatch (#42174) 2026-09-22 04:41:11 +00:00
tracing feat(logger): dispatch Python logging through the Rust diagnostics processor (#42616) 2026-09-22 18:44:15 -07:00
types refactor(rust): add types and core-utils crates, unify the provider error 2026-09-17 22:01:14 -07:00