scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-07 02:59:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103

docs Health Check Server

Browse source
This commit is contained in:
Ishaan Jaff 2025-07-25 07:17:26 -07:00
parent 6d3ce76e1c
commit 9c76ccd92c
2 changed files with 8 additions and 5 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
docs/my-website/release_notes/v1.74.7/index.md
View file

@ -48,8 +48,8 @@ pip install litellm==1.74.7.post1
- **Vector Stores** - Support for Vertex RAG Engine, PG Vector, OpenAI & Azure OpenAI Vector Stores.
- **Bulk Editing Users** - Bulk editing users on the UI.
- **Health Check Improvements** - Separate health check app on dedicated port for better Kubernetes liveness probes.
- **New LLM Providers** - Added Moonshot API `moonshot` and `v0` provider support.
- **Health Check Improvements** - Prevent unnecessary pod restarts during high traffic.
- **New LLM Providers** - Added Moonshot AI and Vercel v0 provider support.
---
@ -93,9 +93,11 @@ v1.74.7-stable introduces Bulk Editing Users on the UI. This is useful for:
## Health Check Server
v1.74.7-stable allows you to run a separate health check app using Docker
- Allows health check probe to run even when server is under huge load
- Even while running on a separate ASGI app, if the main app goes unhealthy, the pod goes down killing the health app and notifiying the orchestrator using supervisord
<Image alt="Separate Health App Architecture" img={require('../../img/separate_health_app_architecture.png')} style={{ borderRadius: '8px', marginBottom: '1em', maxWidth: '100%' }} />
This release brings reliability improvements that prevent unnecessary pod restarts during high traffic. Previously, when the main LiteLLM app was busy serving traffic, health endpoints would timeout even when pods were healthy.
Starting with this release, you can run health endpoints on an isolated process with a dedicated port. This ensures liveness and readiness probes remain responsive even when the main LiteLLM app is under heavy load.
[Read More](https://docs.litellm.ai/docs/proxy/prod#10-use-a-separate-health-check-app)

1
litellm/model_prices_and_context_window_backup.json
View file

@ -11130,6 +11130,7 @@
"input_cost_per_token": 1e-06,
"output_cost_per_token": 5e-06,
"litellm_provider": "openrouter",
"source": "https://openrouter.ai/qwen/qwen3-coder",
"mode": "chat",
"supports_tool_choice": true
},