Kerry Lu 62ce515d15 feat(router): let a deployment set a timeout per service_tier (#47406) ... * feat(router): let a deployment set a timeout per service_tier Adds timeout_by_service_tier and stream_timeout_by_service_tier to a deployment's litellm_params. A request whose service_tier matches a key uses that value in place of the deployment's timeout or stream_timeout. A timeout the client sends still wins and requests without a matching tier are unchanged Co-authored-by: adc77 <amandogra2016@gmail.com> * style(router): sort the request_timeout_resolver import * fix(router): read the service tier maps without the untyped params get * fix(router): look the service tier timeout up through a typed get --------- Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: adc77 <amandogra2016@gmail.com>		2026-10-19 14:27:29 -07:00
..
docker-entrypoint.d	feat(helm): support a separate hostname per component in the componentized deploy (#46360)	2026-10-14 14:56:36 -07:00
litellm-dashboard	feat(router): let a deployment set a timeout per service_tier (#47406)	2026-10-19 14:27:29 -07:00
Dockerfile	feat(helm): support a separate hostname per component in the componentized deploy (#46360)	2026-10-14 14:56:36 -07:00
nginx.conf	feat(helm): support a separate hostname per component in the componentized deploy (#46360)	2026-10-14 14:56:36 -07:00