scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-06 02:48:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103
27802 commits 3198 branches 1436 tags 4.5 GiB
Commit graph

292 commits

Author SHA1 Message Date
Ishaan Jaffer
72f8e5f9a3 bump litellm proxy extras 2025-11-26 11:39:09 -08:00
Alexsander Hamir
7c09187daf
downgrade grpcio (#17090) 2025-11-25 19:33:24 -08:00
yuneng-jiang
4b25398afe
[Infra] CI/CD Fixes (#16937) 
* Attempt CI/CD Fix

* Adding test for coverage

* Adding max depth to copilot and vertex

* Fixing mypy lint and docker database

* Fixing UI build issues

* Update playwright test
 2025-11-21 13:58:19 -08:00
superpoussin22
b96179a07a
Upgrade pydantic to version 2.11.0 (#16909) 
Updated pydantic version to 2.11.0 for compatibility.
 2025-11-21 08:52:44 -08:00
YutaSaito
93affcb732
[Feat] mcp resources support (#16800) 
* feat: mcp prompts support

* feat: mcp resources support
 2025-11-20 14:53:44 -08:00
Ishaan Jaffer
95caa2e3de bump openai 2.8.0 2025-11-19 17:47:18 -08:00
Ishaan Jaffer
d389b9dd66 bump litellm enterprise 2025-11-19 16:56:50 -08:00
Ishaan Jaffer
6477740b8c bump proxy extras 2025-11-19 13:23:16 -08:00
Krish Dholakia
586f126395
Prometheus - make OSS (#16689) 
* refactor: remove enterprise license from prometheus metrics

* refactor: complete refactoring imports

* refactor: complete prometheus refactoring

* bump: version 1.80.0 → 1.80.1

* bump: version 1.80.1 → 1.80.2

* build: update litellm lock file

* docs(enterprise.md): cleanup enterprise docs

* docs: more docs cleanup

* docs: doc cleanup

* fix: fix imports

* fix: fix linting error
 2025-11-15 11:06:34 -08:00
Ishaan Jaffer
8439fde7c1 bump litellm-proxy-extras 2025-11-15 09:11:34 -08:00
Ishaan Jaffer
f8c022c8f5 bump new schema 2025-11-14 17:39:54 -08:00
Krish Dholakia
06906534b3
feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model 
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync

* fix: fix base models

* fix: fix usage object
 2025-11-08 16:24:31 -08:00
Krish Dholakia
202eaeb1a2
Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" (#16409) 
This reverts commit c96da44265.
 2025-11-08 15:38:16 -08:00
Krish Dholakia
c96da44265
(feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size 
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync
 2025-11-08 15:30:46 -08:00
Krish Dholakia
bce8a5d6b7
Revert "(feat) audio transcriptions cost tracking (for azure/other non-openai…" (#16402) 
This reverts commit 9a88fe0861.
 2025-11-08 14:24:51 -08:00
Krish Dholakia
9a88fe0861
(feat) audio transcriptions cost tracking (for azure/other non-openai models) + (fix) image generations - accurate cost tracking for dalle3/gpt-image-1 - uses the correct max image quality (#16076) 
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks
 2025-11-08 13:54:37 -08:00
Ishaan Jaffer
ec2749199e bump: version 0.4.2 → 0.4.3 2025-11-08 10:21:47 -08:00
Ishaan Jaffer
9c59d42fc1 bump extras pkg 2025-11-06 19:17:03 -08:00
Krish Dholakia
80440e11a7
Revert "Update MCP version from 1.10.1 to 1.20.0 (#16281)" (#16300) 
This reverts commit 34c12d0131.
 2025-11-05 18:42:34 -08:00
Guan Zheng Huang
34c12d0131
Update MCP version from 1.10.1 to 1.20.0 (#16281) 
* Update MCP version from 1.10.1 to 1.20.0

- Update mcp dependency: 1.10.1 -> 1.20.0 in requirements.txt, pyproject.toml, and CI config
- Update uvicorn dependency: 0.29.0 -> 0.31.1 (required by MCP 1.20.0)
- Update PyJWT constraint to support newer versions required by MCP
- Update all CI pipeline references to MCP 1.20.0
- Add test to verify MCP version and import compatibility

MCP 1.20.0 requires uvicorn >=0.31.1 and PyJWT >=2.10.1.
MCP package remains Python >=3.10 only (no change to version constraint).

* Update poetry.lock for MCP 1.20.0
 2025-11-05 18:34:28 -08:00
Krrish Dholakia
6637beb247 fix: minor fixes + dep updates 2025-11-01 13:45:42 -07:00
Krrish Dholakia
ef7d81865b build: update dependencies 2025-11-01 12:58:39 -07:00
RoniGurvichCycode
eeda5ab84e
requirements update (#16054) 
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2025-10-31 19:18:03 -07:00
dependabot[bot]
1bc88b5fc9
build(deps): bump starlette from 0.47.2 to 0.49.1 (#16027) 
Bumps [starlette](https://github.com/Kludex/starlette) from 0.47.2 to 0.49.1.
- [Release notes](https://github.com/Kludex/starlette/releases)
- [Changelog](https://github.com/Kludex/starlette/blob/main/docs/release-notes.md)
- [Commits](https://github.com/Kludex/starlette/compare/0.47.2...0.49.1)

---
updated-dependencies:
- dependency-name: starlette
  dependency-version: 0.49.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-31 19:13:11 -07:00
Ishaan Jaffer
bd52cb2983 bump proxy extras 2025-10-31 18:19:28 -07:00
Ishaan Jaff
d8ea1665c7
[Feat] - [Backend] Search APIs - Allow storing configured Search APIs in DB (#15862) 
* add LiteLLM_SearchToolsTable

* init SearchToolRegistry

* fix add SearchToolRegistry

* fix add SearchToolRegistry

* fix handling search tool management

* fix search imports

* fix registry

* init search tools in memory

* fix init tools in mem

* fix TypedDict def

* add new SCHEMA

* bump proxy extras

* add LiteLLM_SearchToolsTable_search_tool_name_key

* bump extras with migration

* fix working CRUD Ops

* fix: _init_search_tools_in_db
 2025-10-23 17:57:49 -07:00
Krrish Dholakia
3d7c55516e build: bump version 2025-10-13 14:26:38 -07:00
Ishaan Jaffer
cf994860e2 new DB Build 2025-10-11 08:44:42 -07:00
Achintya Rajan
f72f21b261 Update requirements.txt 2025-10-07 16:18:48 -07:00
Ishaan Jaffer
a1e5c9426f bump to migrations to 0.2.25 2025-10-04 16:16:34 -07:00
Ishaan Jaffer
07e1e0a7ca bump proxy extras migration 2025-10-04 12:38:21 -07:00
Ishaan Jaffer
e61619cdc8 bump pypi 2025-09-26 19:53:27 -07:00
Ishaan Jaffer
03e73c9b7c fix security 2025-09-26 19:31:56 -07:00
Ishaan Jaffer
0769ac2fdd bump litellm-proxy-extras/0.2.21 2025-09-26 18:49:41 -07:00
Ishaan Jaffer
e2e2ae78a4 test fix 2025-09-26 11:48:28 -07:00
Ishaan Jaffer
4a75d042fb fix test 2025-09-26 11:45:52 -07:00
Ishaan Jaff
ea8d0bb7d5 fix: re-add scheduled rotations 2025-09-26 11:40:46 -07:00
Ishaan Jaffer
b1e56c55ad merge 2025-09-24 22:11:37 -07:00
Ishaan Jaff
ded823a3a3
[Feat] Initial support for scheduled key rotations (#14877) 
* add KeyRotationSettings

* add KeyRotationManager

* add key rotation manager

* add KeyRotationManager

* fix _initialize_spend_tracking_background_jobs

* fix add_key_rotation_fields

* fixes

* new fields in schema

* update schema

* fix fixes for init key rotation manager

* fixes for init key rotation manager

* fix KeyRotationManager

* tests for key rotation

* fix key_rotation_settings

* fix KeyRotationManager

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix fixes for init key rotation manager

* ruff check fix

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix _initialize_spend_tracking_background_jobs

* docs fix

* docs auto rotate

* schema fix

* bump proxy extras

* fix config.yml
 2025-09-24 21:37:56 -07:00
Ishaan Jaffer
a0e4707782 Revert "Added missing dependencies (#14706)" 
This reverts commit b33d52c6e1.
 2025-09-24 21:36:57 -07:00
Ishaan Jaffer
98f33843d9 fix: bump litellm-proxy-extras pip 2025-09-19 17:27:29 -07:00
Krrish Dholakia
565eeca92a build(pyproject.toml): bump versions 2025-09-18 19:24:34 -07:00
Alexsander Hamir
b33d52c6e1
Added missing dependencies (#14706) 
* fix: adding dependencies

* fix: added to required

* fix: remove from wrong place

* fix: misspelling
 2025-09-18 19:20:24 -07:00
Ishaan Jaff
06f3991ed0
bump aiohttp==3.12.14 (#14638) 2025-09-17 09:44:39 -07:00
Ishaan Jaff
ac2d349161
[Security] Ensure LiteLLM Images have 0 Critical, High, Medium vulnerabilities with CVSS ≥ 4.0 (#14357) 
* updated scans

* fix scans

* fix litellm_security_tests

* fix

* fix count CVEE

* add readme

* fix Security Scans

* fix: starlette==0.47.2 # starlette fastapi dep

* bump fastapi==0.115.14

* bump 0.116.1
 2025-09-08 16:49:52 -07:00
Ishaan Jaff
49532d6d8b
Revert "[Feat]Cancel upstream on client disconnect (#14295)" (#14304) 
This reverts commit 51de2ebb64.
 2025-09-06 15:29:15 -07:00
katsuhiro muto
51de2ebb64
[Feat]Cancel upstream on client disconnect (#14295) 
* cancel upstream on client disconnect

* add comments

* add test

* set timeout in constraints.py

* Guard against missing 'type' key

* update dependency to fix uvicorn bugs
 2025-09-06 08:58:51 -07:00
Krish Dholakia
682fb697d0
Merge pull request #13969 from dttran-glo/patch-1 
bump `orjson` version to "3.11.2"
 2025-08-26 23:09:57 -07:00
Ishaan Jaff
80d4cc1283
[Perf] Use fastuuid for fast UUID generations - 2.1x Faster (#13992) 
* use fastuuid

* add fastuuid

* add fastuuid==0.12.0
 2025-08-26 19:47:25 -07:00
Duc Tran
e3d947abeb
bump orjson version to "3.11.2" 2025-08-26 23:21:53 +07:00