scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-09 03:18:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 109
23610 commits 3347 branches 1448 tags 5 GiB
Commit graph

165 commits

Author SHA1 Message Date
Krrish Dholakia
2d697ca476 build: bump pip 2025-07-28 16:10:19 -07:00
Krish Dholakia
d6423d913d
build: update pip package (#12998) 2025-07-25 16:23:53 -07:00
Ishaan Jaff
b8e404dd95
[Feat] Backend Router - Add Auto-Router powered by semantic-router (#12955) 
* add router.json

* test_router_auto_router

* async_pre_routing_hook

* fixes for auto router

* add async_pre_routing_hook

* add LiteLLMRouterEncoder

* update test auto_router_embedding_model

* add auto_router_embedding_model

* add AutoRouter

* fix async_pre_routing_hook

* update async_pre_routing_hook

* fix auto router

* fix router.json

* working router init

* working embedding encoder

* working auto router

* test_router_auto_router

* test auto router

* add semantic-router as optional for litellm

* add extras

* semantic_router==0.1.10

* ruff fix

* use aiohttp==3.10.11

* python-dotenv==1.0.1

* test auto router

* test_router_auto_router

* semantic_router

* test_is_auto_router_deployment

* fix check

* fix docker build step

* add semantic_router

* Revert "add semantic_router"

This reverts commit 537b672887.
 2025-07-24 18:32:56 -07:00
Ishaan Jaff
99ad24c683
[Feat] LiteLLM x Cloudzero integration - Allow exporting spend to cloudzero (#12908) 
* add cz init

* add DataAnalyzer

* add CZRNGenerator -> LiteLLM resource generator

* add CloudZeroStreamer

* add CBFTransformer

* add cloudzero DB connection

* add config

* add cli.py

* cleanup

* add CloudZeroLogger

* add CloudZeroLogger

* update CloudZeroLogger

* add cloudzero_router to litellm proxy

* add CloudZeroInitRequest

* add cloudzero spend endpoints

* simple dry run endpoint

* refactor dir structure

* add well types CBFRecord

* TestCBFTransformer

* TestCloudZeroStreamer

* ruff fix

* add polars pip + docker requirements.txt

* _group_by_date

* update code qa check

* docs for CZ params
 2025-07-23 13:00:58 -07:00
Ishaan Jaff
96f7eb6f78 bump litellm enterprise version 2025-07-19 10:12:33 -07:00
Krrish Dholakia
075032349f build: update litellm-proxy-extras 2025-07-18 13:18:59 -07:00
Jugal D. Bhatt
a46b9d376f
[Prometheus] Move Prometheus to enterprise folder (#12659) 
* fix tools fetch for keys

* add promethues to enterprise

* remove old prom

* remove old prom

* fix tests

* safe imports

* add if

* fix enterprise test

* rename imports

* added label import

* added label import

* move tests to enterprise

* fix tests

* add log

* build: update versions

---------

Co-authored-by: Krrish Dholakia <krrishdholakia@gmail.com>
 2025-07-18 11:54:47 -07:00
Joseph Laurendi
56eacd0a38
chore(proxy): loosen rich version from ==13.7.1 to >=13.7.1 (#12704) 2025-07-18 09:36:57 -07:00
Brian Caswell
45605f8362
add azure blob cache support (#12587) 
* add support for Azure Blob caching

* add integration tests

* address feedback
 2025-07-15 11:47:38 -07:00
Ishaan Jaff
08ce596c55 bump litellm enterprise pkg 2025-07-12 18:31:52 -07:00
Ishaan Jaff
dbe07adf29 bump litellm proxy extras 2025-07-11 22:09:19 -07:00
Ishaan Jaff
95eaa98b9d bump litellm_proxy_extras-0.2.9 2025-07-09 18:40:00 -07:00
Ishaan Jaff
a37dacb770 bump to litellm-enterprise==0.1.12 2025-07-09 18:35:28 -07:00
Ishaan Jaff
028461a84d bump proxy extras 2025-07-07 21:48:11 -07:00
Ishaan Jaff
312d3602a7 add litellm proxy extras 2025-07-07 21:13:45 -07:00
dependabot[bot]
85bc1065a0
Bump mcp from 1.9.3 to 1.10.0 (#12388) 
Bumps [mcp](https://github.com/modelcontextprotocol/python-sdk) from 1.9.3 to 1.10.0.
- [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases)
- [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md)
- [Commits](https://github.com/modelcontextprotocol/python-sdk/compare/v1.9.3...v1.10.0)

---
updated-dependencies:
- dependency-name: mcp
  dependency-version: 1.10.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-07 18:33:23 -07:00
Ishaan Jaff
1ce71d6d61 bump litellm-enterprise = {version = "0.1.11", optional = true} 2025-07-02 15:00:28 -07:00
Jugal Bhatt
5f47dde7e9 update poetry lock 2025-07-01 14:35:28 -07:00
Ishaan Jaff
a021e7cb9d bump poetry 2025-06-28 21:16:52 -07:00
Krrish Dholakia
23018bd0a2 build(pyproject.toml): bump version 2025-06-26 07:58:29 -07:00
Ishaan Jaff
d4ba4900cf bump litellm enterprise 2025-06-23 19:36:31 -07:00
Ishaan Jaff
94a8ae393c bump litellm-enterprise-0.1.8 2025-06-21 16:00:36 -07:00
Krrish Dholakia
753aeffe73 build: update with new migration file 2025-06-18 23:07:13 -07:00
Krrish Dholakia
39a1fbfb35 build: bump versions 2025-06-18 22:14:40 -07:00
Ishaan Jaff
49b957d14c
fix aiohttp version (#11777) 2025-06-16 17:31:14 -07:00
Ishaan Jaff
02b02c739b
[Feat] MCP - Add support for streamablehttp_client MCP Servers (#11628) 
* feat - add https mcp support

* fixes for MCP http integration

* fix code QA

* bump mcp dep

* test_mcp_server_manager_https_server

* test mcp server https

* fix linting error

* bump mcp in poetry

* fix import streamablehttp_client

* fix streamablehttp_client

* fix streamablehttp_client

* add streamablehttp_client
 2025-06-11 17:09:46 -07:00
Ishaan Jaff
2d0ea74cf4
[Bug Fix] No module named 'diskcache' (#11600) 
* (build) show clear error when disk cache does not exist

* docs disk cache

* add caching to pyproject
 2025-06-10 14:54:11 -07:00
Krrish Dholakia
0273b72b68 build: bump poetry 2025-06-03 21:25:53 -07:00
Ishaan Jaff
afb75dc50c bump: bump litellm enterprise 2025-05-29 20:41:03 -07:00
Ishaan Jaff
9e75409518 bump litellm proxy extras 2025-05-28 18:58:33 -07:00
Krrish Dholakia
95de41d10c build: publish new litellm-proxy-extras file 2025-05-27 17:44:23 -07:00
Ishaan Jaff
1876b3ae35
[Fix] Rollback to httpx==0.27.0 (#11146) 
* fix - fix - use old httpx version

* fix - fix - use old httpx version

* fix: test

* fix: comment
 2025-05-26 10:44:11 -07:00
Krrish Dholakia
d14af20bbd build: bump litellm-enterprise version - cleanup prints 2025-05-24 11:31:42 -07:00
Ishaan Jaff
b3ff337141 bump: 1.70.5 2025-05-23 22:58:07 -07:00
Ishaan Jaff
86cdb8382b
[Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 
* fix: add flag for disabling use_aiohttp_transport

* feat: add _create_async_transport

* feat: fixes for transport

* add httpx-aiohttp

* feat: fixes for transport

* refactor: fixes for transport

* build: fix deps

* fixes: test fixes

* fix: ensure aiohttp does not auto set content type

* test: test fixes

* feat: add LiteLLMAiohttpTransport

* fix: fixes for responses API handling

* test: fixes for responses API handling

* test: fixes for responses API handling

* feat: fixes for transport

* fix: base embedding handler

* test: test_async_http_handler_force_ipv4

* test: fix failing deepeval test

* fix: add YARL for bedrock urls

* fix: issues with transport

* fix: comment out linting issues

* test fix

* test: XAI is unstable

* test: fixes for using respx

* test: XAI fixes

* test: XAI fixes

* test: infinity testing fixes

* docs(config_settings.md): document param

* test: test_openai_image_edit_litellm_sdk

* test: remove deprecated test

* bump respx==0.22.0

* test: test_xai_message_name_filtering

* test: fix anthropic test after bumping httpx

* use n 4 for mapped tests (#11109)

* fix: use 1 session per event loop

* test: test_client_session_helper

* fix: linting error

* fix: resolving GET requests on httpx 0.28.1

* test fixes proxy unit tests

* fix: add ssl verify settings

* fix: proxy unit tests

* fix: refactor

* tests: basic unit tests for aiohttp transports

* tests: fixes xai

---------

Co-authored-by: Krrish Dholakia <krrishdholakia@gmail.com>
 2025-05-23 22:55:35 -07:00
Mayank
8da898c55e
[feature] ConfidentAI logging enabled for proxy and sdk (#10649) 
* async success implemented

* fail async event

* sync events added

* docs added

* docs added

* test added

* style

* test

* .

* lock file genrated due to tenacity change

* mypy errors

* resolved comments

* resolved comments

* resolved comments

* resolved comments

* style

* style

* resolved comments
 2025-05-23 11:40:48 -07:00
Ishaan Jaff
a7a5b22393
[Feat] Add Azure AD certificate-based authentication (#11069) 
* feat: add cert based auth for Azure get_azure_ad_token_provider

* test: tests azure cert auth

* fix update poetry

* fix: fix linting
 2025-05-22 18:05:28 -07:00
Ishaan Jaff
dd4a65b83a
Feat: add MCP to Responses API and bump openai python sdk (#11029) 
* feat: add MCP to responses API

* feat: bump openai version to 1.75.0

* docs MCP + responses API

* fixes: type checking

* fixes: type checking

* build: use latest openai 1.81.0

* fix: linting error

* fix: linting error

* fix: test

* fix: linting errors

* fix: test

* fix: test

* fix: linting

* Revert "fix: linting"

This reverts commit ebb19ff8cb.

* fix: linting
 2025-05-22 07:24:10 -07:00
Ishaan Jaff
7075168939 bump: litellm proxy extras 2025-05-19 15:40:24 -07:00
Ishaan Jaff
22aa33e8b5 bump litellm_enterprise-0.1.4 2025-05-17 17:28:59 -07:00
Krrish Dholakia
2767266db3 build: update poetry lock 2025-05-15 22:07:38 -07:00
Eric Ma
172b30cec1
build(dependencies)📦: Add numpydoc to dependencies in pyproject.toml (#10736) 
* build(dependencies)📦: Add numpydoc to dependencies in pyproject.toml

- Include numpydoc for documentation generation in utils.py.

* Update poetry lock file.

* chore(dependencies)🔧: Update optional dependencies and markers in poetry.lock and pyproject.toml

- Set several packages as optional in poetry.lock.
- Add 'extra == "utils"' marker to various packages in poetry.lock.
- Update numpydoc dependency to be optional in pyproject.toml.
- Add 'utils' extra section in pyproject.toml with numpydoc.
 2025-05-15 21:53:46 -07:00
Ishaan Jaff
19b2d70732 bump litellm_enterprise-0.1.3.tar.gz 2025-05-14 17:55:03 -07:00
Ishaan Jaff
a30c574f9a bump litellm_proxy_extras-0.1.21.tar.gz 2025-05-14 17:53:34 -07:00
Krrish Dholakia
9658d20bc9 build(model_prices_and_context_window.json): update poetry lock 2025-05-12 21:58:15 -07:00
Krish Dholakia
d37cc63250
Add new model provider Novita AI (#7582) (#9527) 
* Add new model provider Novita AI (#7582)

* feat: add new model provider Novita AI

* feat: use deepseek r1 model for examples in Novita AI docs

* fix: fix tests

* fix: fix tests for novita

* fix: fix novita transformation

* ci: fix ci yaml

* fix: fix novita transformation and test (#10056)

---------

Co-authored-by: Jason <ggbbddjm@gmail.com>
 2025-05-12 21:49:30 -07:00
Ishaan Jaff
b1fae09a7c bump litellm enterprise 0.1.2 2025-05-10 17:40:42 -07:00
Ishaan Jaff
4dfa913306 bump litellm proxy extras 2025-05-10 17:38:41 -07:00
Krrish Dholakia
10e80f0742 build(pyproject.toml): publish new litellm-proxy-extras version 2025-05-10 15:24:32 -07:00
Ishaan Jaff
3731ee436a
[Refactor] Use pip package for enterprise/ folder (#10709) 
* init enterprise pip

* init enterprise pip

* init enterprise pip

* test: enterprise pip

* add litellm-enterprise to pip

* litellm ent check

* litellm ent check

* fix import email router

* fix setup_litellm_enterprise_pip

* fix local testing with enterprise pip
 2025-05-09 17:18:48 -07:00