scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-04 02:31:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 69
litellm/litellm
History
Krish Dholakia f9d0bcc5a1
OpenAI /v1/realtime api support (#6047) 
* feat(azure/realtime): initial working commit for proxy azure openai realtime endpoint support

Adds support for passing /v1/realtime calls via litellm proxy

* feat(realtime_api/main.py): abstraction for handling openai realtime api calls

* feat(router.py): add `arealtime()` endpoint in router for realtime api calls

Allows using `model_list` in proxy for realtime as well

* fix: make realtime api a private function

Structure might change based on feedback. Make that clear to users.

* build(requirements.txt): add websockets to the requirements.txt

* feat(openai/realtime): add openai /v1/realtime api support
2024-10-03 17:11:22 -04:00
..
adapters LiteLLM Minor Fixes & Improvements (09/27/2024) (#5938) 2024-09-27 22:52:57 -07:00
assistants Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
batches Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
deprecated_litellm_server Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
files Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
fine_tuning Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
integrations (contributor PRs) oct 3rd, 2024 (#6034) 2024-10-03 17:12:34 +05:30
litellm_core_utils OpenAI /v1/realtime api support (#6047) 2024-10-03 17:11:22 -04:00
llms OpenAI /v1/realtime api support (#6047) 2024-10-03 17:11:22 -04:00
proxy OpenAI /v1/realtime api support (#6047) 2024-10-03 17:11:22 -04:00
realtime_api OpenAI /v1/realtime api support (#6047) 2024-10-03 17:11:22 -04:00
rerank_api LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
router_strategy Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
router_utils Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
secret_managers Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
types (feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 2024-10-03 23:31:10 +05:30
__init__.py OpenAI /v1/realtime api support (#6047) 2024-10-03 17:11:22 -04:00
_logging.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
_redis.py LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
_service_logger.py [Fix] OTEL - Don't log messages when callback settings disable message logging (#5875) 2024-09-24 18:29:52 -07:00
_version.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
budget_manager.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
caching.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
cost.json store llm costs in budget manager 2023-09-09 19:11:35 -07:00
cost_calculator.py LiteLLM Minor Fixes & Improvements (09/26/2024) (#5925) (#5937) 2024-09-27 17:54:13 -07:00
exceptions.py LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
main.py (feat) add nvidia nim embeddings (#6032) 2024-10-03 17:12:14 +05:30
model_prices_and_context_window_backup.json LiteLLM Minor Fixes & Improvements (09/27/2024) (#5938) 2024-09-27 22:52:57 -07:00
py.typed feature - Types for mypy - #360 2024-05-30 14:14:41 -04:00
requirements.txt Add symlink and only copy in source dir to stay under 50MB compressed limit for Lambdas. 2023-11-22 23:07:33 -05:00
router.py OpenAI /v1/realtime api support (#6047) 2024-10-03 17:11:22 -04:00
scheduler.py feat(scheduler.py): support redis caching for req. prioritization 2024-06-06 14:19:21 -07:00
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py (feat) add nvidia nim embeddings (#6032) 2024-10-03 17:12:14 +05:30