litellm/litellm
Ishaan Jaff 5210f97da6 [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)
* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix
2025-08-22 16:18:23 -07:00
..
anthropic_interface [Feat] Allow using litellm.completion with /v1/messages API Spec (use gpt-4, gemini etc with claude code) (#11502) 2025-06-06 20:35:53 -07:00
assistants Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
batch_completion (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batches UI - Support 'batch' model health checks + make 'team-only' model concept clearer (#12770) 2025-07-19 14:30:38 -07:00
caching fix test 2025-08-21 12:10:29 +02:00
completion_extras add support for reasoning_effort minimal (#13401) 2025-08-08 14:34:46 -07:00
endpoints/speech/speech_to_completion_bridge feat(speech/): working gemini tts support via openai's /v1/speech endpoint (#11832) 2025-06-18 10:36:25 -07:00
experimental_mcp_client [MCP Gateway] Litellm mcp client list fail (#13114) 2025-07-30 15:23:19 -07:00
files Litellm Unified File ID output file id support (#10713) 2025-05-10 11:02:09 -07:00
fine_tuning Litellm managed file updates combined (#11040) 2025-05-22 17:20:41 -07:00
google_genai [Bug Fix] Gemini-CLI Integration - ensure tool calling works as expected on generateContent (#13189) 2025-07-31 16:42:57 -07:00
images [Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations (#13735) 2025-08-18 18:26:32 -07:00
integrations Merge pull request #13795 from TomeHirata/feat/predict/mlflow 2025-08-20 22:40:33 -07:00
litellm_core_utils [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895) 2025-08-22 16:18:23 -07:00
llms fix transform - vertex ai partner 2025-08-22 07:22:34 -07:00
passthrough fix application inference profile for pass-through endpoints for bedrock 2025-08-20 01:03:49 -07:00
proxy [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895) 2025-08-22 16:18:23 -07:00
realtime_api [LLM Translation] Fix Realtime API endpoint for no intent (#13476) 2025-08-14 16:24:14 -07:00
rerank_api Add rerank endpoint support for deepinfra 2025-08-20 23:36:05 +05:30
responses [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895) 2025-08-22 16:18:23 -07:00
router_strategy Fix - add safe divide by 0 for most places to prevent crash (#13624) 2025-08-14 11:17:49 -07:00
router_utils fix(litellm_pre_call_utils.py): forward headers by model group at litellm pre call utils level 2025-08-18 21:13:52 -07:00
secret_managers Added handling for pwd protected cert files in AOAI CertificateCredential auth (#12995) 2025-07-28 21:34:54 -07:00
types [Bug Fix] litellm incompatible with newest release of openAI v1.100.0 (#13728) 2025-08-18 18:26:17 -07:00
vector_stores [Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query (#13787) 2025-08-19 15:39:36 -07:00
__init__.py [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895) 2025-08-22 16:18:23 -07:00
_logging.py [Proxy server] Add apscheduler log suppress (#13299) 2025-08-05 15:04:51 -07:00
_redis.py added redis iam auth (#13275) 2025-08-05 10:56:34 -07:00
_service_logger.py [⚡️ Python SDK import] - reduce python sdk import time by .3s (#12140) 2025-06-28 14:57:10 -07:00
_version.py Virtual key based policies in Aim Guardrails (#9499) 2025-04-01 21:57:23 -07:00
budget_manager.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
constants.py [Performance] Use O(1) Set lookups for model routing (#13879) 2025-08-21 22:56:46 -07:00
cost.json store llm costs in budget manager 2023-09-09 19:11:35 -07:00
cost_calculator.py [Feat] New provider - Azure AI Flux Image Generation (#13592) 2025-08-13 17:20:30 -07:00
exceptions.py Anthropic - working mid-stream fallbacks (#13149) 2025-07-31 21:22:49 -07:00
main.py Merge pull request #13783 from philipkiely-baseten/main 2025-08-21 18:34:36 -07:00
model_prices_and_context_window_backup.json build: new pypi build 2025-08-21 23:47:45 -07:00
mypy.ini fix linting errors from ryptography.hazmat.bindings._rust 2025-05-17 16:31:30 -07:00
py.typed feature - Types for mypy - #360 2024-05-30 14:14:41 -04:00
router.py refactor: cleanup 2025-08-18 21:14:38 -07:00
scheduler.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model 2025-08-21 23:18:20 -07:00