devin-ai-integration[bot] e4190d86a6 refactor(rust): centralize host execution and compose callbacks (#43515) ... * refactor(rust): extract litellm-host-native as the shared Rust host driver Move service and hook dispatch out of host-http into a Driver that owns the machine and Rust handlers, returning at completion or a stream boundary and holding the demand reply until the consumer advances. Move the in-process runner onto the same driver. host-http now layers encoding, SSE, body polling and lifecycle observation over it. host-python keeps driving litellm-host directly Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(rust): interrupt the machine when the in-process stream consumer fails Restores the pre-refactor interruption path for StreamConsumer errors via Driver::fail and ports the generic run lifecycle tests into host-native. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(rust): separate the machine contract from coroutine execution * auth update * refactor(rust): use standard flow control for host requests * style(rust): keep host driver imports formatted * chores * mostly relocation * refactor(rust): separate interceptors from queued observers * refactor(rust): centralize legacy callback mappings and lifecycle * docs: define Python host boundaries and migration plan * refactor: enforce Python host and bridge boundaries * refactor(rust): separate operations from callback composition * refactor(rust): compose SDK policy through call hooks --------- Co-authored-by: Yujong Lee <yujong@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-09-28 19:20:27 +00:00
..
auth	refactor(rust): prepare inference and auth foundations for the gateway (#43287)	2026-09-25 23:12:48 -07:00
auth-aws	refactor(rust): prepare inference and auth foundations for the gateway (#43287)	2026-09-25 23:12:48 -07:00
auth-azure	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
auth-gcp	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
auth-types	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
cache	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-azure-blob	refactor(http): hand out an owned Client and route all providers through the pool (#43245)	2026-09-25 18:31:15 -07:00
cache-disk	feat(rust): add litellm-db and litellm-db-testing workspace scaffolding (#43504)	2026-09-27 18:48:45 -07:00
cache-gcs	refactor(http): hand out an owned Client and route all providers through the pool (#43245)	2026-09-25 18:31:15 -07:00
cache-memory	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-qdrant-semantic	refactor(http): hand out an owned Client and route all providers through the pool (#43245)	2026-09-25 18:31:15 -07:00
cache-redis	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-redis-semantic	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-response	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-s3	refactor(rust): prepare inference and auth foundations for the gateway (#43287)	2026-09-25 23:12:48 -07:00
cache-testing	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-valkey-semantic	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
callbacks-legacy-python	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
config	feat(rust): add the MCP gateway (#43470)	2026-09-27 19:37:41 -07:00
core	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
core-utils	refactor(rust): share call lifecycle across route-owned inference (#43461)	2026-09-27 16:05:30 -07:00
coroutine	refactor(rust): extract the host coroutine into its own crate (#43129)	2026-09-25 04:20:06 +00:00
cost	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
db	feat(rust): add litellm-db and litellm-db-testing workspace scaffolding (#43504)	2026-09-27 18:48:45 -07:00
db-testing	feat(rust): add litellm-db and litellm-db-testing workspace scaffolding (#43504)	2026-09-27 18:48:45 -07:00
framer	refactor(framer): replace Framer trait with tokio-util codecs (#43193)	2026-09-25 12:18:32 -07:00
gateway	feat(rust): add the MCP gateway (#43470)	2026-09-27 19:37:41 -07:00
gateway-auth	feat(rust): add the MCP gateway (#43470)	2026-09-27 19:37:41 -07:00
gateway-inference	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
gateway-management	feat(rust): add virtual key storage contracts (#43468)	2026-09-27 19:18:59 -07:00
gateway-mcp	feat(rust): add the MCP gateway (#43470)	2026-09-27 19:37:41 -07:00
gateway-ui	feat(rust): add gateway UI login and sessions (#43469)	2026-09-27 19:37:41 -07:00
host	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
host-http	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
host-native	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
host-python	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
http	feat(rust): add the MCP gateway (#43470)	2026-09-27 19:37:41 -07:00
litellm	refactor(rust): expand logging and test coverage across gateway and Anthropic messages (#43295)	2026-09-26 08:04:19 +00:00
llms	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
model-catalog	feat(sail): add Sail as a provider with service_tier mapped to its completion window (#42840)	2026-09-26 12:57:48 -07:00
python-bridge	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
python-compat	feat(rust): add python-compat crate for Python data formats (#42510)	2026-09-22 12:16:56 -07:00
router	refactor(rust): expand logging and test coverage across gateway and Anthropic messages (#43295)	2026-09-26 08:04:19 +00:00
secrets	refactor(rust): expand logging and test coverage across gateway and Anthropic messages (#43295)	2026-09-26 08:04:19 +00:00
secrets-aws	refactor(rust): prepare inference and auth foundations for the gateway (#43287)	2026-09-25 23:12:48 -07:00
secrets-azure	refactor(http): hand out an owned Client and route all providers through the pool (#43245)	2026-09-25 18:31:15 -07:00
secrets-cyberark	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
secrets-google	refactor(http): hand out an owned Client and route all providers through the pool (#43245)	2026-09-25 18:31:15 -07:00
secrets-hashicorp	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
secrets-types	refactor(rust): prepare inference and auth foundations for the gateway (#43287)	2026-09-25 23:12:48 -07:00
testkit	refactor(http): hand out an owned Client and route all providers through the pool (#43245)	2026-09-25 18:31:15 -07:00
token-counter	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
token-counter-fast	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
token-counter-huggingface	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
token-counter-tiktoken	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
tracing	feat(rust): add structured route lifecycle tracing (#43466)	2026-09-27 19:18:58 -07:00
types	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00