Sean Marsh Glover
4652c73259
feat(proxy): limit concurrent health checks with health_check_concurrency ( #20584 )
...
* staged first pass
* black
* Update litellm/proxy/health_check.py
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
* simpler
* restore cached logo
* fix tests for perform_health_check max_concurrency arg
* implement pr suggestion
* and the helm chart
* add configureable resources and probes to the deployment in the helm chart
* more helm chart unittests
* move some background healthcheck loggin to debug
---------
Co-authored-by: Sean Glover <sglover@athenahealth.com>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-24 08:16:59 -08:00
Krrish Dholakia
7c2478b70e
docs: replace ghcr link with docker.litellm.ai
2025-12-16 08:35:45 +05:30
Fabian Reinold
c173a4a275
Helm Chart: add ingress-only labels ( #17348 )
...
* feat(helm): add ingress-only labels
* feat(helm): add ingress configuration tests
* chore(helm): bump chart version
2025-12-02 22:30:54 -08:00
Abhinav
b6c26c3365
helm(chart): add optional PodDisruptionBudget for litellm proxy ( #14062 ) ( #14093 )
2025-09-01 12:21:44 -07:00
Const-antine
d3b526041f
better formatting
2025-08-28 13:18:36 -04:00
Const-antine
730e9c90a2
fix formatting
2025-08-28 13:18:33 -04:00
Const-antine
5d973ea06e
update readme
2025-08-28 13:18:26 -04:00
Ishaan Jaff
f498cf4901
Fix - Ensure Helm chart auto generated master keys follow sk-xxxx format ( #13871 )
...
* docs - master key
* fix - auto generate sk-xxx prefixed key
* test master key fix
* fix master key gen
2025-08-21 14:34:21 -07:00
unique-jakub
3edb71e617
allow helm hooks for migrations job ( #13174 )
2025-07-31 21:51:07 -07:00
Gunjan Solanki
f1cc2d544e
feat(helm): Add loadBalancerClass support for LoadBalancer services ( #11064 )
...
* feat(helm): Add loadBalancerClass support for LoadBalancer services
Adds the ability to specify a loadBalancerClass when using LoadBalancer service type.
This enables integration with custom load balancer implementations like Tailscale.
* fixup! feat(helm): Add loadBalancerClass support for LoadBalancer services
2025-05-22 22:45:14 -07:00
Manuel Cañete
44373baeee
feat: make masterkey secret configurable
2025-03-16 12:39:13 +01:00
Krish Dholakia
cc8dd80209
allow configuring httpx hooks for AsyncHTTPHandler ( #6290 ) ( #6415 )
...
* allow configuring httpx hooks for AsyncHTTPHandler (#6290 )
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
* Fixes and minor improvements for Helm Chart (#6402 )
* reckoner hack
* fix default
* add extracontainers option
* revert chart
* fix extracontainers
* fix deployment
* remove init container
* update docs
* add helm lint to deploy step
* change name
* (refactor) prometheus async_log_success_event to be under 100 LOC (#6416 )
* unit testig for prometheus
* unit testing for success metrics
* use 1 helper for _increment_token_metrics
* use helper for _increment_remaining_budget_metrics
* use _increment_remaining_budget_metrics
* use _increment_top_level_request_and_spend_metrics
* use helper for _set_latency_metrics
* remove noqa violation
* fix test prometheus
* test prometheus
* unit testing for all prometheus helper functions
* fix prom unit tests
* fix unit tests prometheus
* fix unit test prom
* (refactor) router - use static methods for client init utils (#6420 )
* use InitalizeOpenAISDKClient
* use InitalizeOpenAISDKClient static method
* fix # noqa: PLR0915
* (code cleanup) remove unused and undocumented logging integrations - litedebugger, berrispend (#6406 )
* code cleanup remove unused and undocumented code files
* fix unused logging integrations cleanup
* update chart version
* add circleci tests
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
* fix: fix linting error
* fix(http_handler.py): fix linting error
---------
Co-authored-by: Alejandro Rodríguez <alejorro70@gmail.com>
Co-authored-by: Robert Brennan <accounts@rbren.io>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
2024-10-24 22:00:24 -07:00
Peter Laß
e8066f13cb
Update litellm helm envconfigmap ( #5872 )
...
* Added the possibility to use ConfigMapRef for env values.
* bumped aapVersion to 1.46.6 and chartVersion to 0.3.0
---------
Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-25 21:43:08 -07:00
Peter Laß
b1ecfe065c
fix #5614 ( #5615 )
...
Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
2024-09-10 09:26:44 -07:00
Ishaan Jaff
089a4f279a
readme - clarify helm is community maintained
2024-08-06 12:37:13 -07:00
ishaan-jaff
54dceea4b0
(fix) releasing litellm helm as "litellm-helm"
2024-03-16 10:06:14 -07:00
Lunik
880213d4a6
✨ Refresh Helm chart structure
...
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 22:59:14 +01:00
Shaun Maher
4d0e369e7a
Authored a Helm chart for LiteLLM. Added GitHub workflows/actions to build and push the helm chart to the ghcr.io OCI registry.
2024-01-25 11:53:59 +11:00