scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-03 02:22:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 80

feat(warm-pool): transports package __init__

Browse source
This commit is contained in:
Ishaan Jaffer 2026-05-06 15:53:12 -07:00
parent cf8f240386
commit 05d9906687
No known key found for this signature in database
1 changed files with 23 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

23
litellm/proxy/agent_session_endpoints/warm_pool/transports/__init__.py Normal file
View file

@ -0,0 +1,23 @@
"""Hydrate transports — how the payload reaches the warm VM.
We chose **SSM RunCommand push** based on B0's 1700ms median warm-attach
latency (LIT-2888). The long-poll alternative is intentionally not shipped
in this PR — it can be added later by implementing the same
``HydrateTransport`` protocol.
Public surface:
- ``HydrateTransport`` — protocol every transport implements
- ``SSMHydrateTransport`` — the production transport
"""
from litellm.proxy.agent_session_endpoints.warm_pool.transports.ssm import (
HydrateTransport,
HydrateTransportError,
SSMHydrateTransport,
)
__all__ = [
"HydrateTransport",
"HydrateTransportError",
"SSMHydrateTransport",
]