yujonglee 271b4f0306 refactor(rust): one stream codec shape per API format (#45996) ... Chat Completions, Messages and Responses each get a streaming module with the same three names, event_stream, decode and encode, built on a shared SSE helper in base_llm/sse.rs that owns the [DONE] marker. Callers use the module path instead of vendor-prefixed names. Encoding matches what the Python proxy writes to clients: Messages frames carry an event line, the OpenAI formats are bare data frames. Responses gets one event type for SSE and WebSocket. ResponsesEventType names every event on OpenAI's streaming-events reference, with unknown names riding in Other, and is_terminal and is_failure follow Python's iterator. The framer adds a bulk decode_all and an SseBlockCodec that keeps each event's wire bytes. An event the stream ends inside is dropped, as the SSE spec and the openai SDK's decoder do. ChatCompletionChunk no longer requires id, created or object, since compatible hosts omit them.		2026-10-13 15:30:14 -07:00
..
auth	refactor(rust): prepare inference and auth foundations for the gateway (#43287)	2026-09-25 23:12:48 -07:00
auth-aws	feat(rust): one LitellmParams type for a config and a caller (#45642)	2026-10-09 16:29:45 -07:00
auth-azure	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
auth-gcp	feat(rust): type the Vertex AI connection params and where Python reads them (#45641)	2026-10-09 16:29:44 -07:00
auth-types	feat(rust): one LitellmParams type for a config and a caller (#45642)	2026-10-09 16:29:45 -07:00
cache	refactor(rust): derive strum VariantArray and string conversions (#45434)	2026-10-08 21:24:49 +00:00
cache-azure-blob	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
cache-disk	feat(rust): add litellm-db and litellm-db-testing workspace scaffolding (#43504)	2026-09-27 18:48:45 -07:00
cache-gcs	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
cache-memory	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-qdrant-semantic	refactor(http): hand out an owned Client and route all providers through the pool (#43245)	2026-09-25 18:31:15 -07:00
cache-redis	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-redis-semantic	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-response	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
cache-s3	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
cache-testing	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
cache-valkey-semantic	refactor(rust): align the cache crates with Python and wire every native backend (#42530)	2026-09-22 13:13:02 -07:00
callbacks-legacy-python	feat(rust): settle EdenAI Messages reported cost (#45698)	2026-10-12 17:39:08 -07:00
config	feat(rust): one LitellmParams type for a config and a caller (#45642)	2026-10-09 16:29:45 -07:00
core-utils	feat(rust): settle EdenAI Messages reported cost (#45698)	2026-10-12 17:39:08 -07:00
coroutine	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
cost	fix(cost_calculator): bill ultrafast prompts above 272k at the ultrafast long-context rates (#43764)	2026-09-30 07:32:16 -07:00
db	feat(rust): add litellm-db and litellm-db-testing workspace scaffolding (#43504)	2026-09-27 18:48:45 -07:00
db-testing	feat(rust): add litellm-db and litellm-db-testing workspace scaffolding (#43504)	2026-09-27 18:48:45 -07:00
framer	refactor(rust): one stream codec shape per API format (#45996)	2026-10-13 15:30:14 -07:00
gateway	test: migrate proxy security, schema migration and MCP legacy tests (#45937)	2026-10-11 16:17:24 -07:00
gateway-auth	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
gateway-inference	feat(rust): add native OpenRouter Messages (#45910)	2026-10-11 15:48:50 -07:00
gateway-management	feat(rust): add virtual key storage contracts (#43468)	2026-09-27 19:18:59 -07:00
gateway-mcp	test: migrate proxy security, schema migration and MCP legacy tests (#45937)	2026-10-11 16:17:24 -07:00
gateway-ui	feat(ui): adopt the new LiteLLM logo and monogram (#43913)	2026-09-30 14:51:06 -07:00
host	feat(rust): settle EdenAI Messages reported cost (#45698)	2026-10-12 17:39:08 -07:00
host-http	refactor(rust): centralize host execution and compose callbacks (#43515)	2026-09-28 19:20:27 +00:00
host-native	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
host-python	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
http	feat(rust): add native OpenRouter Messages (#45910)	2026-10-11 15:48:50 -07:00
inference	feat(rust): settle EdenAI Messages reported cost (#45698)	2026-10-12 17:39:08 -07:00
inference-chat	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
inference-messages	refactor(rust): one stream codec shape per API format (#45996)	2026-10-13 15:30:14 -07:00
inference-ocr	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
inference-responses	refactor(rust): one stream codec shape per API format (#45996)	2026-10-13 15:30:14 -07:00
inference-testing	feat(rust): settle EdenAI Messages reported cost (#45698)	2026-10-12 17:39:08 -07:00
inference-transcription	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
litellm	refactor(rust): expand logging and test coverage across gateway and Anthropic messages (#43295)	2026-09-26 08:04:19 +00:00
llms	refactor(rust): one stream codec shape per API format (#45996)	2026-10-13 15:30:14 -07:00
llms-types	refactor(rust): one stream codec shape per API format (#45996)	2026-10-13 15:30:14 -07:00
model-catalog	feat(decisions): accept decisions as a model mode alongside evaluation (#45474)	2026-10-10 19:18:53 -07:00
python-bridge	refactor(rust_bridge): route Python state reads through host modules (#45689)	2026-10-11 14:10:16 -07:00
python-compat	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
router	refactor(rust): give Messages configs typed litellm params (#45611)	2026-10-09 16:29:45 -07:00
router-types	feat(rust): one LitellmParams type for a config and a caller (#45642)	2026-10-09 16:29:45 -07:00
secrets	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
secrets-aws	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
secrets-azure	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
secrets-cyberark	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
secrets-google	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
secrets-hashicorp	feat: improve trace ingestion and trace details (#43975)	2026-10-01 13:45:33 -07:00
secrets-types	refactor(rust): derive strum VariantArray and string conversions (#45434)	2026-10-08 21:24:49 +00:00
spend-clickhouse	refactor(lens): connect LiteLLM to the independent Lens service (#45529)	2026-10-09 16:17:05 -07:00
storage-clickhouse	docs(agents): ban semicolons and colons in human-facing text (#45684)	2026-10-09 16:36:32 -07:00
testkit	refactor(rust): derive strum VariantArray and string conversions (#45434)	2026-10-08 21:24:49 +00:00
token-counter	refactor(rust): add shared llms wire type derives (#43730)	2026-09-29 09:19:33 -07:00
token-counter-fast	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
token-counter-huggingface	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
token-counter-tiktoken	refactor(rust): share anthropic types, request helpers, and streaming contracts across crates (#43426)	2026-09-27 14:53:12 -07:00
tracing	feat(rust): add structured route lifecycle tracing (#43466)	2026-09-27 19:18:58 -07:00