scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78
litellm/docs/my-website/docs
History
Ishaan Jaff eb8b74a14e feat(vertex_ai): Vertex AI Gemini Live via unified /realtime endpoint (#22153) 
* feat(vertex_ai): add Vertex AI Gemini Live support via unified /realtime endpoint

Adds VertexAIRealtimeConfig which translates the OpenAI Realtime WebSocket
protocol to Vertex AI BidiGenerateContent. Supports voice in/voice out
(16 kHz mic → 24 kHz speaker) and text in/text out through the proxy's
/realtime endpoint.

Key changes:
- New litellm/llms/vertex_ai/realtime/transformation.py with VertexAIRealtimeConfig
  - Builds correct wss:// URL (regional + global)
  - OAuth2 Bearer token auth (not API key)
  - Full model path (projects/.../publishers/google/models/...)
  - Ignores session.update (Vertex AI only accepts one setup message)
- realtime_api/main.py: vertex_ai branch resolves OAuth token + constructs config
- llm_http_handler.py: auto-sends session setup before bidirectional_forward
- gemini/realtime/transformation.py: fix crashes on empty turnComplete events
- realtime_streaming.py: try/except guard so bad messages don't kill the loop
- proxy_server.py: add missing websockets.exceptions import

* docs: add vertex_realtime to sidebars

* fix: drop unknown event types in Gemini transform; add vertex_ai health check

* fix: propagate UUID fallback IDs from transform_content_done_event to return_additional_content_done_events

* fix: route guardrail backend sends through provider transform; fix str.strip misuse for model prefix

* fix: handle Vertex AI full resource path in session.created; route guardrail block sends through _send_to_backend

* fix: remove unused VertexBase in transformation.py; apply UUID fallback in return_additional_content_done_events
2026-03-03 18:15:28 +05:30
..
adding_provider Merge pull request #21326 from BerriAI/litellm_oss_staging_02_16_2026 2026-02-18 17:47:57 +05:30
anthropic_unified fix: prompt registry 2026-02-18 00:34:54 +05:30
caching feat(semantic-cache): support configurable vector dimensions for Qdrant (#21649) 2026-02-21 00:51:15 -08:00
completion fix: add prompt_cache_key and prompt_cache_retention support for OpenAI 2026-03-03 18:15:05 +05:30
contribute_integration docs(community.md): add new integration partner doc 2025-12-09 18:17:14 -08:00
contributing [Feat] Allow adding OpenAI compatible chat providers using .json + add public ai provider (#17448) 2025-12-04 17:59:25 -08:00
debugging Update local_debugging.md (#8308) 2025-02-06 16:19:32 -08:00
embedding docs: improve Getting Started page and SDK documentation structure (#17614) 2025-12-08 13:05:50 -08:00
extras fix: prompt registry 2026-02-18 00:34:54 +05:30
guides fix: prompt registry 2026-02-18 00:34:54 +05:30
integrations fix: prompt registry 2026-02-18 00:34:54 +05:30
langchain added tags to langchain 2025-09-10 00:32:26 -04:00
observability fix: update calendly on repo 2026-02-23 06:13:59 -08:00
pass_through docs: add Google GenAI SDK tutorial (JS & Python) (#21885) 2026-02-23 09:20:46 -08:00
projects fix: prompt registry 2026-02-18 00:34:54 +05:30
provider_registration docs openai 2025-12-04 18:32:23 -08:00
providers feat(vertex_ai): Vertex AI Gemini Live via unified /realtime endpoint (#22153) 2026-03-03 18:15:28 +05:30
proxy Add Lakera v2 post-call hook and tests (fixed PII masking) (#21783) 2026-03-03 18:15:27 +05:30
search Add duckcukgo in docs 2026-02-18 16:17:39 +05:30
secret_managers fix: update calendly on repo 2026-02-23 06:13:59 -08:00
troubleshoot Update docs/my-website/docs/troubleshoot/rollback.md 2026-02-21 10:40:41 +05:30
tutorials fix(guardrails): prevent presidio crash on non-json responses 2026-03-03 18:15:16 +05:30
vector_stores Add vector store support for ragflow 2025-12-03 15:29:47 +05:30
a2a.md fix: prompt registry 2026-02-18 00:34:54 +05:30
a2a_agent_permissions.md [Docs] A2a - Permission management (#17515) 2025-12-04 17:29:47 -08:00
a2a_cost_tracking.md fix: prompt registry 2026-02-18 00:34:54 +05:30
a2a_invoking_agents.md fix: prompt registry 2026-02-18 00:34:54 +05:30
aiohttp_benchmarks.md docs benchmarks 2025-05-24 17:43:38 -07:00
anthropic_count_tokens.md fix: prompt registry 2026-02-18 00:34:54 +05:30
apply_guardrail.md Implement Bedrock Guardrail apply_guardrail endpoint support (#15892) 2025-10-24 10:24:03 -07:00
assistants.md docs: improve Getting Started page and SDK documentation structure (#17614) 2025-12-08 13:05:50 -08:00
audio_transcription.md Add support of audio transcription for OVHcloud (#17305) 2025-12-01 18:26:39 -08:00
batches.md fix: prompt registry 2026-02-18 00:34:54 +05:30
bedrock_converse.md docs boto3 instructions 2025-10-16 16:34:56 -07:00
bedrock_invoke.md docs boto3 instructions 2025-10-16 16:34:56 -07:00
benchmarks.md docs: tweak benchmarks wording 2026-02-23 09:50:02 -08:00
budget_manager.md docs - use consistent name for LiteLLM proxy server 2024-08-03 12:54:07 -07:00
contact.md docs: update broken Slack invite links to support page (#16546) 2025-11-12 12:41:55 -08:00
container_files.md fix: prompt registry 2026-02-18 00:34:54 +05:30
containers.md [docs] add docs for containers files api + code interpreter on LiteLLM (#17749) 2025-12-09 18:11:28 -08:00
contributing.md docs(ui): add pre-PR checklist to UI contributing guide 2026-02-22 09:50:26 -03:00
data_retention.md fix: prompt registry 2026-02-18 00:34:54 +05:30
data_security.md docs(data_security.md): data_security.md 2025-06-09 17:53:11 -07:00
default_code_snippet.md
enterprise.md fix: update calendly on repo 2026-02-23 06:13:59 -08:00
evals_api.md fix: prompt registry 2026-02-18 00:34:54 +05:30
exception_mapping.md Adds support for returning Azure Content Policy error information when exceptions from Azure OpenAI occur (#16231) 2025-11-08 16:04:36 -08:00
files_endpoints.md Add support for file content download for bedrock batches 2025-12-04 13:27:53 +05:30
fine_tuning.md fix: update calendly on repo 2026-02-23 06:13:59 -08:00
generateContent.md fix: Metadata / Trace ID Missing in S3 Streaming Callbacks 2026-03-03 18:15:16 +05:30
image_edits.md fix: prompt registry 2026-02-18 00:34:54 +05:30
image_generation.md fix: prompt registry 2026-02-18 00:34:54 +05:30
image_variations.md New stable release - release notes (#8148) 2025-01-31 10:02:59 -08:00
index.md fix: prompt registry 2026-02-18 00:34:54 +05:30
interactions.md docs: add Google GenAI SDK tutorial (JS & Python) (#21885) 2026-02-23 09:20:46 -08:00
load_test.md fix: prompt registry 2026-02-18 00:34:54 +05:30
load_test_advanced.md fix: prompt registry 2026-02-18 00:34:54 +05:30
load_test_rpm.md docs: usaged-based routing perf warnings (#14080) 2025-08-29 17:31:12 -07:00
load_test_sdk.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
mcp.md docs: add trailing slash to /mcp endpoint URLs 2026-03-03 18:15:05 +05:30
mcp_control.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_cost.md [MCP Gateway] QA/Fixes - Ensure Team/Key level enforcement works for MCPs (#15305) 2025-10-07 17:34:48 -07:00
mcp_guardrail.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_oauth.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_public_internet.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_semantic_filter.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_troubleshoot.md fix: prompt registry 2026-02-18 00:34:54 +05:30
mcp_usage.md [MCP Gateway] QA/Fixes - Ensure Team/Key level enforcement works for MCPs (#15305) 2025-10-07 17:34:48 -07:00
migration.md
migration_policy.md docs migration policy 2024-08-09 18:06:37 -07:00
moderation.md docs(moderation.md): fix moderation quick start docs 2025-11-07 16:25:08 -08:00
ocr.md [Feat] /ocr - Add VertexAI OCR provider support + cost tracking (#16216) 2025-11-03 15:56:49 -08:00
oidc.md fix: prompt registry 2026-02-18 00:34:54 +05:30
old_guardrails.md Use the -d flag in docs instead of -D (#12179) 2025-06-30 15:25:42 -07:00
projects.md
proxy_api.md Corrected docs updates sept 2025 (#14916) 2025-09-25 15:49:19 -07:00
proxy_auth.md fix: prompt registry 2026-02-18 00:34:54 +05:30
proxy_server.md Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
rag_ingest.md fix: prompt registry 2026-02-18 00:34:54 +05:30
rag_query.md fix: prompt registry 2026-02-18 00:34:54 +05:30
realtime.md feat(realtime): guardrails support for /v1/realtime WebSocket endpoint (#22152) 2026-03-03 18:15:28 +05:30
reasoning_content.md Add support for reasoning and tools viaconfig 2026-02-20 16:22:19 +05:30
rerank.md feat: Add IBM watsonx.ai rerank support (#21303) 2026-02-16 20:12:16 -08:00
response_api.md Update the docs 2026-02-27 16:01:23 +05:30
response_api_compact.md fix: prompt registry 2026-02-18 00:34:54 +05:30
router_architecture.md docs(router_architecture.md): add router architecture docs 2024-11-26 12:54:38 +05:30
routing.md fix: prompt registry 2026-02-18 00:34:54 +05:30
rules.md
scheduler.md docs: usaged-based routing perf warnings (#14080) 2025-08-29 17:31:12 -07:00
sdk_custom_pricing.md organize docs 2024-08-03 12:54:07 -07:00
secret.md fix: update calendly on repo 2026-02-23 06:13:59 -08:00
set_keys.md Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
skills.md [Docs] Claude Skills API (#17052) 2025-11-24 15:32:03 -08:00
text_completion.md Guardrails - Responses API, Image Gen, Text completions, Audio transcriptions, Audio Speech, Rerank, Anthropic Messages API support via the unified apply_guardrails function (#15706) 2025-10-25 13:38:57 -07:00
text_to_speech.md fix: prompt registry 2026-02-18 00:34:54 +05:30
traffic_mirroring.md fix: prompt registry 2026-02-18 00:34:54 +05:30
troubleshoot.md fix: prompt registry 2026-02-18 00:34:54 +05:30
vector_store_files.md fix docs 2025-11-15 16:58:47 -08:00
vertex_batch_passthrough.md Litellm sameer oct staging (#15806) 2025-10-24 12:17:22 -07:00
videos.md [Feat] New Provider - Add RunwayML Provider for video generations (#16505) 2025-11-11 18:48:23 -08:00
wildcard_routing.md Litellm dev 12 28 2024 p2 (#7458) 2024-12-28 19:38:06 -08:00