mirror of
https://github.com/BerriAI/litellm.git
synced 2026-08-28 05:25:59 +00:00
The gateway image installed --extra proxy/proxy-runtime/extra_proxy/semantic-router but not bedrock-realtime, so aws-sdk-bedrock-runtime was absent. Bedrock Nova Sonic speech-to-speech uses InvokeModelWithBidirectionalStream (which boto3 cannot do) via that package, so realtime requests failed at startup with 'Missing aws_sdk_bedrock_runtime'. Add the extra to both uv sync stages; it is already in uv.lock so --frozen resolves, and the package/marker (python>=3.12) matches the python3.13 image. |
||
|---|---|---|
| .. | ||
| routes | ||
| Dockerfile | ||
| main.py | ||