litellm/litellm
Ishaan Jaff 480a8d73c0
[Fix] Perf use only async functions for get cache (#5930)
* use async functions

* fix parallel request limiter use correct user id

* fix getting user_id
2024-09-26 18:39:40 -07:00
..
adapters fix(anthropic_adapter.py): fix sync streaming 2024-08-03 20:52:29 -07:00
assistants [Feat-Proxy] Add Azure Assistants API - Create Assistant, Delete Assistant Support (#5777) 2024-09-18 16:27:33 -07:00
batches use correct type hints for audio transcriptions 2024-09-05 09:12:27 -07:00
deprecated_litellm_server refactor: add black formatting 2023-12-25 14:11:20 +05:30
files fix import error 2024-09-05 10:09:44 -07:00
fine_tuning refactor get_secret 2024-09-03 10:42:12 -07:00
integrations track api key and alias in remaining tokens metric (#5924) 2024-09-26 18:01:03 -07:00
litellm_core_utils [Feat] Improve OTEL Tracking - Require all Redis Cache reads to be logged on OTEL (#5881) 2024-09-25 10:57:08 -07:00
llms LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00
proxy [Fix] Perf use only async functions for get cache (#5930) 2024-09-26 18:39:40 -07:00
rerank_api LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
router_strategy LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
router_utils [Feat-Prometheus] Track exception status on litellm_deployment_failure_responses (#5706) 2024-09-14 18:44:31 -07:00
secret_managers LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00
tests [Fix proxy perf] Use correct cache key when reading from redis cache (#5928) 2024-09-26 18:13:35 -07:00
types LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00
__init__.py LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
_logging.py fix(_logging.py): fix timestamp format for json logs 2024-06-20 15:20:21 -07:00
_redis.py LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
_service_logger.py [Fix] OTEL - Don't log messages when callback settings disable message logging (#5875) 2024-09-24 18:29:52 -07:00
_version.py (fix) ci/cd don't let importing litellm._version block starting proxy 2024-02-01 16:23:16 -08:00
budget_manager.py feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
caching.py [Feat] Improve OTEL Tracking - Require all Redis Cache reads to be logged on OTEL (#5881) 2024-09-25 10:57:08 -07:00
cost.json store llm costs in budget manager 2023-09-09 19:11:35 -07:00
cost_calculator.py LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
exceptions.py LiteLLM Minor Fixes & Improvements (09/21/2024) (#5819) 2024-09-21 18:51:53 -07:00
main.py LiteLLM Minor Fixes & Improvements (09/24/2024) (#5880) 2024-09-25 22:11:57 -07:00
model_prices_and_context_window_backup.json track api key and alias in remaining tokens metric (#5924) 2024-09-26 18:01:03 -07:00
py.typed feature - Types for mypy - #360 2024-05-30 14:14:41 -04:00
requirements.txt Add symlink and only copy in source dir to stay under 50MB compressed limit for Lambdas. 2023-11-22 23:07:33 -05:00
router.py [Feat-Router] Allow setting which environment to use a model on (#5892) 2024-09-25 10:12:06 -07:00
scheduler.py feat(scheduler.py): support redis caching for req. prioritization 2024-06-06 14:19:21 -07:00
timeout.py refactor: add black formatting 2023-12-25 14:11:20 +05:30
utils.py LiteLLM Minor Fixes & Improvements (09/25/2024) (#5893) 2024-09-26 16:41:44 -07:00