scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-06 02:48:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103

docs: further simplify architecture.md - bullet points only

Browse source 
Co-authored-by: ishaan <ishaan@berri.ai>
This commit is contained in:
Cursor Agent 2026-01-23 02:36:07 +00:00
parent 98ecb337fc
commit fe9951e24f
1 changed files with 6 additions and 29 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

35
docs/my-website/docs/pass_through/architecture.md
View file

@ -40,35 +40,12 @@ sequenceDiagram
## Essential Transformations
### 1. URL Construction
- **Vertex AI**: Regional endpoints (`us-central1-aiplatform.googleapis.com` vs `europe-west1-aiplatform.googleapis.com`)
- **Bedrock**: Region-specific (`bedrock-runtime.{region}.amazonaws.com`)
- **AssemblyAI**: EU vs US (`api.assemblyai.com` vs `api.eu.assemblyai.com`)
### 2. Auth Header Replacement
| Provider | LiteLLM Key → Provider Credential |
|----------|-----------------------------------|
| Vertex AI | `Bearer sk-litellm-*` → `Bearer ya29.oauth-token` |
| Anthropic | `Bearer sk-litellm-*` → `x-api-key: sk-ant-*` |
| Bedrock | `Bearer sk-litellm-*` → AWS SigV4 signed headers |
| Gemini | `Bearer sk-litellm-*` → `?key={api_key}` (query param) |
### 3. Logging (Optional)
- Parse provider-native response to extract usage
- Calculate cost using LiteLLM pricing
- Send to callbacks (Langfuse, etc.)
- **URL Construction** - Build correct provider URL (e.g., regional endpoints for Vertex AI, Bedrock)
- **Auth Header Replacement** - Swap LiteLLM virtual key for actual provider credentials
- **Logging** (optional) - Parse response to extract usage and calculate cost
## What Does NOT Change
- Request body passes through unchanged
- Response body passes through unchanged
- Provider-specific parameters work as documented
## Key Files
| Component | File |
|-----------|------|
| Main handler | `proxy/pass_through_endpoints/pass_through_endpoints.py` |
| Provider routes | `proxy/pass_through_endpoints/llm_passthrough_endpoints.py` |
| Credential router | `proxy/pass_through_endpoints/passthrough_endpoint_router.py` |
| Logging handlers | `proxy/pass_through_endpoints/llm_provider_handlers/` |
- Request body
- Response body
- Provider-specific parameters