Commit graph

230 commits

Author SHA1 Message Date
Krish Dholakia
586f126395
Prometheus - make OSS (#16689)
* refactor: remove enterprise license from prometheus metrics

* refactor: complete refactoring imports

* refactor: complete prometheus refactoring

* bump: version 1.80.0 → 1.80.1

* bump: version 1.80.1 → 1.80.2

* build: update litellm lock file

* docs(enterprise.md): cleanup enterprise docs

* docs: more docs cleanup

* docs: doc cleanup

* fix: fix imports

* fix: fix linting error
2025-11-15 11:06:34 -08:00
Krrish Dholakia
70b8641822 build: bump migration 2025-11-15 09:34:50 -08:00
Ishaan Jaffer
a029c88cb9 bump litellm-proxy-extras 2025-11-15 09:11:47 -08:00
Ishaan Jaffer
f8c022c8f5 bump new schema 2025-11-14 17:39:54 -08:00
Krish Dholakia
06906534b3
feat(audio_transcriptions/): calculate duration of audio file for cost calculation + feat (image_generations): cost tracking accuracy improved with output_format, quality, size values fixed per openai model
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync

* fix: fix base models

* fix: fix usage object
2025-11-08 16:24:31 -08:00
Krish Dholakia
202eaeb1a2
Revert "(feat) Audio transcription - cost tracking + (feat) image generation …" (#16409)
This reverts commit c96da44265.
2025-11-08 15:38:16 -08:00
Krish Dholakia
c96da44265
(feat) Audio transcription - cost tracking + (feat) image generation - accurate cost tracking based on output_format/quality/size
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks

* fix: fix aembedding

* fix: fix ruff errors

* fix: modify to catch errors

* fix: test

* fix: loosen test to handle openai lib out of sync
2025-11-08 15:30:46 -08:00
Krish Dholakia
bce8a5d6b7
Revert "(feat) audio transcriptions cost tracking (for azure/other non-openai…" (#16402)
This reverts commit 9a88fe0861.
2025-11-08 14:24:51 -08:00
Krish Dholakia
9a88fe0861
(feat) audio transcriptions cost tracking (for azure/other non-openai models) + (fix) image generations - accurate cost tracking for dalle3/gpt-image-1 - uses the correct max image quality (#16076)
* feat(audio_transcriptions/): calculate duration of audio file for cost calculation

Fixes https://github.com/BerriAI/litellm/issues/11846

Closes https://github.com/BerriAI/litellm/issues/14605

* fix(cost_calculator.py): correctly use base model, when set

Fixes issue where azure base model was being ignored

* feat(cost_calculator.py): fix default cost tracking quality param for image generation

* feat(image_generations/): return output_format, quality, size

aligns response to openai spec and improves cost tracking accuracy

* fix(cost_calculator.py): refactor cost calculation for image generation to use image response instead of hidden params

* build: update build

* fix: fix cost calculation

* build: update poetry lock

* fix: fix ruff checks
2025-11-08 13:54:37 -08:00
Ishaan Jaffer
9b6a4c2650 bump pyproject 2025-11-08 10:24:23 -08:00
Krish Dholakia
80440e11a7
Revert "Update MCP version from 1.10.1 to 1.20.0 (#16281)" (#16300)
This reverts commit 34c12d0131.
2025-11-05 18:42:34 -08:00
Guan Zheng Huang
34c12d0131
Update MCP version from 1.10.1 to 1.20.0 (#16281)
* Update MCP version from 1.10.1 to 1.20.0

- Update mcp dependency: 1.10.1 -> 1.20.0 in requirements.txt, pyproject.toml, and CI config
- Update uvicorn dependency: 0.29.0 -> 0.31.1 (required by MCP 1.20.0)
- Update PyJWT constraint to support newer versions required by MCP
- Update all CI pipeline references to MCP 1.20.0
- Add test to verify MCP version and import compatibility

MCP 1.20.0 requires uvicorn >=0.31.1 and PyJWT >=2.10.1.
MCP package remains Python >=3.10 only (no change to version constraint).

* Update poetry.lock for MCP 1.20.0
2025-11-05 18:34:28 -08:00
Krrish Dholakia
6637beb247 fix: minor fixes + dep updates 2025-11-01 13:45:42 -07:00
Krrish Dholakia
ef7d81865b build: update dependencies 2025-11-01 12:58:39 -07:00
RoniGurvichCycode
eeda5ab84e
requirements update (#16054)
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-10-31 19:18:03 -07:00
Ishaan Jaffer
bd52cb2983 bump proxy extras 2025-10-31 18:19:28 -07:00
Ishaan Jaff
d8ea1665c7
[Feat] - [Backend] Search APIs - Allow storing configured Search APIs in DB (#15862)
* add LiteLLM_SearchToolsTable

* init SearchToolRegistry

* fix add SearchToolRegistry

* fix add SearchToolRegistry

* fix handling search tool management

* fix search imports

* fix registry

* init search tools in memory

* fix init tools in mem

* fix TypedDict def

* add new SCHEMA

* bump proxy extras

* add LiteLLM_SearchToolsTable_search_tool_name_key

* bump extras with migration

* fix working CRUD Ops

* fix: _init_search_tools_in_db
2025-10-23 17:57:49 -07:00
Krrish Dholakia
3d7c55516e build: bump version 2025-10-13 14:26:38 -07:00
Ishaan Jaffer
cf994860e2 new DB Build 2025-10-11 08:44:42 -07:00
Ishaan Jaffer
a1e5c9426f bump to migrations to 0.2.25 2025-10-04 16:16:34 -07:00
Ishaan Jaffer
07e1e0a7ca bump proxy extras migration 2025-10-04 12:38:21 -07:00
Ishaan Jaffer
e61619cdc8 bump pypi 2025-09-26 19:53:27 -07:00
Ishaan Jaffer
0769ac2fdd bump litellm-proxy-extras/0.2.21 2025-09-26 18:49:41 -07:00
Ishaan Jaff
ea8d0bb7d5 fix: re-add scheduled rotations 2025-09-26 11:40:46 -07:00
Alex Shoop
914844122c
Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941)
* always use fastuuid

* rm from proxy extras since its now default

* poetry lock
2025-09-26 09:14:20 -07:00
Arshdeep Singh
3abb66f080 fix: regenerate poetry.lock to resolve line 3773 corruption 2025-09-25 12:21:23 -04:00
Arshdeep Singh
191ff9f938 fix: regenerate poetry.lock from scratch to resolve dependency issues 2025-09-25 12:16:22 -04:00
Arshdeep Singh
771cfd49f0 fix: regenerate poetry.lock to resolve CI dependency issue 2025-09-25 12:16:22 -04:00
Ishaan Jaffer
31e38efc8a Revert "bump v extras"
This reverts commit c4838e730c.
2025-09-24 22:12:13 -07:00
Ishaan Jaffer
b1e56c55ad merge 2025-09-24 22:11:37 -07:00
Ishaan Jaffer
c4838e730c bump v extras 2025-09-24 21:42:05 -07:00
Ishaan Jaff
ded823a3a3
[Feat] Initial support for scheduled key rotations (#14877)
* add KeyRotationSettings

* add KeyRotationManager

* add key rotation manager

* add KeyRotationManager

* fix _initialize_spend_tracking_background_jobs

* fix add_key_rotation_fields

* fixes

* new fields in schema

* update schema

* fix fixes for init key rotation manager

* fixes for init key rotation manager

* fix KeyRotationManager

* tests for key rotation

* fix key_rotation_settings

* fix KeyRotationManager

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix fixes for init key rotation manager

* ruff check fix

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix _initialize_spend_tracking_background_jobs

* docs fix

* docs auto rotate

* schema fix

* bump proxy extras

* fix config.yml
2025-09-24 21:37:56 -07:00
Ishaan Jaff
d9bf6a8c53
Revert "Fix: make pondpond as optional dependency for proxy extras, disab…" (#14880)
This reverts commit e75d8b711e.
2025-09-24 21:34:42 -07:00
Alex Shoop
e75d8b711e
Fix: make pondpond as optional dependency for proxy extras, disable object pooling gracefully (#14863)
* pondpond optional dep proxy extra

* lock
2025-09-24 17:09:30 -07:00
Alex Shoop
65df3550aa poetry lock 2025-09-24 01:25:24 +09:00
Alex Shoop
c51e0fc54e fastuuid optional dependency 2025-09-23 23:55:14 +09:00
Ishaan Jaffer
98f33843d9 fix: bump litellm-proxy-extras pip 2025-09-19 17:27:29 -07:00
Krrish Dholakia
a93d6ce775 build(poetry.lock): git push origin 2025-09-18 19:44:38 -07:00
Krrish Dholakia
565eeca92a build(pyproject.toml): bump versions 2025-09-18 19:24:34 -07:00
Krish Dholakia
d72081113e
Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
2025-09-09 22:35:30 -07:00
Ishaan Jaff
0a78ff718b bump pyproject.toml 2025-09-08 16:59:32 -07:00
Ishaan Jaff
a7c99e1841
Revert "Modify cryptography dependency to latest" (#14358) 2025-09-08 16:58:13 -07:00
Dharamendra Kumar
6c1c647338 Fix conflicts 2025-09-08 11:04:34 -07:00
Dharamendra Kumar
d89af0abb9 Revert "Update poetry.lock"
This reverts commit fa2d3a8971.
2025-09-08 09:02:34 -07:00
Andrew Doan
3f215fcf8f
Merge branch 'main' into cryptography_upgrade 2025-08-28 10:59:51 -04:00
Andrew Doan
530cc75223 Re-generate poetry.lock file 2025-08-28 10:57:46 -04:00
Ishaan Jaff
80d4cc1283
[Perf] Use fastuuid for fast UUID generations - 2.1x Faster (#13992)
* use fastuuid

* add fastuuid

* add fastuuid==0.12.0
2025-08-26 19:47:25 -07:00
Andrew Doan
dac20702f2 Modify cryptography dependency to latest 2025-08-25 13:13:36 -04:00
Ishaan Jaff
58c413d7ab use litellm-proxy-extras==0.2.18 2025-08-23 13:27:26 -07:00
0x-fang
9f17bedb48
bump up boto3 and aioboto3 versions (#13665) 2025-08-15 17:06:08 -07:00