litellm/litellm
Ishaan Jaff 5c9f50d584
[AI Gateway] - End User Budgets - Allow pointing max_end_user budget to an id, so the default ID applies to all end users (#16456)
* add _apply_budget_limits_to_end_user_params

* add _apply_budget_limits_to_end_user_params

* add _apply_budget_limits_to_end_user_params

* test_default_budget_applied_to_end_user_without_budget

* docs fix

* fix config
2025-11-11 08:20:13 -08:00
..
anthropic_interface [Feat] Allow using litellm.completion with /v1/messages API Spec (use gpt-4, gemini etc with claude code) (#11502) 2025-06-06 20:35:53 -07:00
assistants Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
batch_completion (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batches [Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits (#16075) 2025-10-29 18:28:52 -07:00
caching fix: Resolve MyPy type checking errors and CI linting (#16277) 2025-11-05 18:36:06 -08:00
completion_extras fix: Resolve MyPy type checking errors and CI linting (#16277) 2025-11-05 18:36:06 -08:00
containers Add E2E Container API Support (#16136) 2025-11-01 14:03:51 -07:00
endpoints/speech/speech_to_completion_bridge fix: fix import errors 2025-09-14 09:32:21 -07:00
experimental_mcp_client fix(client.py): fix rest api tool call 2025-10-09 14:42:04 -07:00
files fix: Convert object to a correct type (#15634) 2025-10-16 21:47:32 -07:00
fine_tuning Litellm managed file updates combined (#11040) 2025-05-22 17:20:41 -07:00
google_genai fix test /generateContent route 2025-10-04 10:49:46 -07:00
images [Feat] Add FAL AI Image Generations on LiteLLM (#16067) 2025-10-29 13:10:51 -07:00
integrations [Bug] Updated spend would not be sent to CloudZero (#16201) 2025-11-10 19:43:15 -08:00
litellm_core_utils fix _transform_usage_objects 2025-11-08 17:29:19 -08:00
llms fix: apply provided timeout value to ClientTimeout.total (#16395) 2025-11-10 19:37:42 -08:00
ocr [Feat] /ocr - Add VertexAI OCR provider support + cost tracking (#16216) 2025-11-03 15:56:49 -08:00
passthrough working - errors from bedrock through pass throughs 2025-10-16 15:40:42 -07:00
proxy [AI Gateway] - End User Budgets - Allow pointing max_end_user budget to an id, so the default ID applies to all end users (#16456) 2025-11-11 08:20:13 -08:00
realtime_api [Fix] OpenAI Realtime API integration fails due to websockets.exceptions.PayloadTooBig error (#15751) 2025-10-20 15:54:14 -07:00
rerank_api [Feat] Add Nvidia NIM Rerank Support (#15152) 2025-10-02 18:58:52 -07:00
responses fix _handle_logging_completed_response 2025-11-07 18:37:34 -08:00
router_strategy fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046) 2025-09-29 15:49:46 -07:00
router_utils parse_jsonl_with_embedded_newlines 2025-11-06 16:05:12 -08:00
search [Bug Fix] Exa Search API - ensure request params are sent to Exa AI (#15855) 2025-10-23 11:56:30 -07:00
secret_managers [Feat] Secret Manager - Hashicorp, add auth via approle (#16374) 2025-11-07 14:39:33 -08:00
types [Fix] Bedrock Knowledge bases - ensure users can access search_results for both stream + non stream response to /chat/completions (#16459) 2025-11-11 08:19:57 -08:00
vector_stores (feat) Azure AI Vector Stores - support "virtual" indexes + create vector store on passthrough API (#16160) 2025-11-01 12:01:32 -07:00
videos Add Vertex and Gemini Videos API with Cost Tracking + UI support (#16323) 2025-11-08 16:03:51 -08:00
__init__.py [AI Gateway] - End User Budgets - Allow pointing max_end_user budget to an id, so the default ID applies to all end users (#16456) 2025-11-11 08:20:13 -08:00
_logging.py [Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983) 2025-08-27 16:16:19 -07:00
_redis.py fix: Apply max_connections configuration to Redis async client (#15797) 2025-10-22 09:19:08 -07:00
_service_logger.py [️ Python SDK import] - reduce python sdk import time by .3s (#12140) 2025-06-28 14:57:10 -07:00
_uuid.py Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941) 2025-09-26 09:14:20 -07:00
_version.py Virtual key based policies in Aim Guardrails (#9499) 2025-04-01 21:57:23 -07:00
budget_manager.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
constants.py Add Vertex and Gemini Videos API with Cost Tracking + UI support (#16323) 2025-11-08 16:03:51 -08:00
cost.json
cost_calculator.py (feat) audio transcription - add gpt-4o-transcribe cost tracking (#16412) 2025-11-08 16:25:57 -08:00
exceptions.py Adds support for returning Azure Content Policy error information when exceptions from Azure OpenAI occur (#16231) 2025-11-08 16:04:36 -08:00
main.py feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model 2025-11-08 16:24:31 -08:00
model_prices_and_context_window_backup.json fix code qa check 2025-11-10 17:42:16 -08:00
mypy.ini fix mypy 2025-09-27 12:21:32 -07:00
py.typed
router.py router fallback for unknown models (#16419) 2025-11-10 19:33:01 -08:00
scheduler.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
timeout.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
utils.py Add Vertex and Gemini Videos API with Cost Tracking + UI support (#16323) 2025-11-08 16:03:51 -08:00