mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-14 23:21:35 +00:00
65b8660c80
Microservice that wraps headroom-ai as a LiteLLM pre_call guardrail. Compresses tool outputs and JSON arrays before they reach the LLM provider using headroom's smart_crusher (JSON dedup + schema compression) and kompress (prose/log compression). Returns compressed structured_messages via the generic guardrail API, which required adding structured_messages support to GenericGuardrailAPIResponse.
12 lines
288 B
YAML
12 lines
288 B
YAML
services:
|
|
- type: web
|
|
name: headroom-guardrail
|
|
runtime: docker
|
|
plan: starter
|
|
dockerfilePath: ./Dockerfile
|
|
envVars:
|
|
- key: HEADROOM_DEFAULT_MODEL
|
|
value: gpt-4o-mini
|
|
- key: GUARDRAIL_API_KEY
|
|
generateValue: true
|
|
healthCheckPath: /health
|