Commit graph

1513 commits

Author SHA1 Message Date
Krish Dholakia
de4f32762a
v1.73.6.rc (#12146)
* fix - using on python 3.9

* [⚡️ Python SDK Import] - 2 second faster import times (#12135)

* speedup - move wb logger to conditional

* fix import path

* docs(index.md): initial pre-release note

* 🧹 Refactor init.py to use a model registry (#12138)

* fix - refactor init to use a registry

* # noqa: PLR0915

* fix import loc

* test whitelisted models

* Revert "🧹 Refactor init.py to use a model registry (#12138)" (#12141)

This reverts commit f93326a214.

* [⚡️ Python SDK import] - reduce python sdk import time by .3s  (#12140)

* use 1 file for KeyManagementSystem

* move key management settings

* fix import locs

* test_proxy_types_not_imported

* test the import loc

* fix import item

* fix imports

* fix import loc

* fix imports

* fix imports

* fix - revert list team changes

* fix for o-series param checks

* bump poetry

* docs(index.md): update release note with cleaner table for updated models

* `/v1/messages` - Remove hardcoded model name on streaming + Tags - enable setting custom header tags (#12131)

* fix(anthropic/experimental_pass_through): use given model name when returning streaming chunks

don't harcode model name on streaming

confusing for user

* fix(anthropic/streaming_iterator.py): remove scope of import

* feat(litellm_logging.py): allow admin to specify additional headers for using as spend tags

Closes https://github.com/BerriAI/litellm/issues/12129

* test(test_litellm_logging.py): add unit tests

* feat(openweb_ui.md): add custom tag tutorial to docs

* docs(cost_tracking.md): add tag based usage UI screenshot

* test: update test

* fix: fix import

* docs - update release notes

* Benefits of using gemini-cli with LiteLLM

* UI QA Fixes - prevent team model reset on model add + return team-only models on /v2/model/info + render team member budget correctly (#12144)

* fix(team_endpoints.py): prevent overwriting current list of team models on new model add

* fix(networking.tsx): fix default proxy base url

* fix(proxy_server.py): include team only models when retrieving all deployments on `/v2/model/info` helper util

ensures team only models are shown to user

* fix(router.py): check model name by team public model name when team id given

Fixes issue where team member could not see team only models when clicking into that team on `Models + Endpoints`

* fix(team_member_view.tsx): fix rendering team member budget, when budget is set

* test: update tests

* test: update unit test

* docs gemini cli x litellm

* docs: index.md

release note cleanup

* docs(index.md): add more hyperlinks to docs

* docs(index.md): add batch api cost tracking to docs

* docs(index.md): update docs

* VertexAI Anthropic - streaming cost tracking w/ prompt caching fixes (#12188)

* fix(rebuild-usage-object---ensure-cache_tokens-is-set): Ensures cache tokens is correctly set

Fixes https://github.com/BerriAI/litellm/issues/12149

* test(test_stream_chunk_builder_utils.py): add unit test to ensure cached tokens is part of stream chunk builder

Ensures standardized values are used

* Fix rendering ui on non-root images (#12226)

* fix(proxy_server.py): only rewrite server_root_path if path set

Fixes UI rendering issue on non-root images

* docs(custom_root_ui.md): clarify custom root path doesn't work on non-root images

* build(pyproject.toml): version rc2

* fix(streaming_handler.py): store finish reason, even if is_finished is false - allows storing early gemini finish reasons (#12250)

Fixes https://github.com/BerriAI/litellm/issues/12249

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-07-02 20:39:38 -07:00
Ishaan Jaff
1897abb147 bump: version 1.73.5 → 1.73.6 2025-06-28 09:20:23 -07:00
Ishaan Jaff
fe8250be18 bump: version 1.73.4 → 1.73.5 2025-06-28 09:19:55 -07:00
Ishaan Jaff
7a5e7f454d bump: version 1.73.3 → 1.73.4 2025-06-27 11:10:14 -07:00
Krrish Dholakia
23018bd0a2 build(pyproject.toml): bump version 2025-06-26 07:58:29 -07:00
Ishaan Jaff
5ebdb58115 bump: version 1.73.2 → 1.73.3 2025-06-25 22:26:59 -07:00
Krrish Dholakia
4598a9bf31 bump: version 1.73.1 → 1.73.2 2025-06-23 22:34:15 -07:00
Ishaan Jaff
d4ba4900cf bump litellm enterprise 2025-06-23 19:36:31 -07:00
Ishaan Jaff
5534387c22 bump: version 1.73.0 → 1.73.1 2025-06-23 19:34:55 -07:00
Ishaan Jaff
1b43ba9426 bump: version 1.72.9 → 1.73.0 2025-06-21 16:45:34 -07:00
Ishaan Jaff
94a8ae393c bump litellm-enterprise-0.1.8 2025-06-21 16:00:36 -07:00
Krrish Dholakia
957df8d38c bump: version 1.72.8 → 1.72.9 2025-06-19 22:35:01 -07:00
Ishaan Jaff
a1abb43319 bump: version 1.72.7 → 1.72.8 2025-06-19 20:44:57 -07:00
Krrish Dholakia
753aeffe73 build: update with new migration file 2025-06-18 23:07:13 -07:00
Krrish Dholakia
39a1fbfb35 build: bump versions 2025-06-18 22:14:40 -07:00
Krrish Dholakia
6fe335ea94 bump: version 1.72.6 → 1.72.7 2025-06-16 22:12:39 -07:00
Ishaan Jaff
49b957d14c
fix aiohttp version (#11777) 2025-06-16 17:31:14 -07:00
Ishaan Jaff
e5893f8904 bump: version 1.72.5 → 1.72.6 2025-06-13 19:05:50 -07:00
Ishaan Jaff
02b02c739b
[Feat] MCP - Add support for streamablehttp_client MCP Servers (#11628)
* feat - add https mcp support

* fixes for MCP http integration

* fix code QA

* bump mcp dep

* test_mcp_server_manager_https_server

* test mcp server https

* fix linting error

* bump mcp in poetry

* fix import streamablehttp_client

* fix streamablehttp_client

* fix streamablehttp_client

* add streamablehttp_client
2025-06-11 17:09:46 -07:00
Krrish Dholakia
0d766808e9 bump: version 1.72.4 → 1.72.5 2025-06-11 08:50:13 -07:00
Ishaan Jaff
3ecda03748 bump: version 1.72.3 → 1.72.4 2025-06-10 17:27:04 -07:00
Ishaan Jaff
2d0ea74cf4
[Bug Fix] No module named 'diskcache' (#11600)
* (build) show clear error when disk cache does not exist

* docs disk cache

* add caching to pyproject
2025-06-10 14:54:11 -07:00
Krrish Dholakia
9f15907697 bump: version 1.72.2 → 1.72.3 2025-06-07 20:50:33 -07:00
Krrish Dholakia
505d2fe0c7 build: bump 2025-06-05 00:08:53 -07:00
Krrish Dholakia
0273b72b68 build: bump poetry 2025-06-03 21:25:53 -07:00
Krrish Dholakia
3f87b8611b bump: version 1.72.0 → 1.72.1 2025-06-02 23:44:22 -07:00
Ishaan Jaff
13dc757873 bump: version 1.71.3 → 1.72.0 2025-05-31 15:54:01 -07:00
Ishaan Jaff
afb75dc50c bump: bump litellm enterprise 2025-05-29 20:41:03 -07:00
Ishaan Jaff
2e5f635803 bump: version 1.71.2 → 1.71.3 2025-05-28 21:39:14 -07:00
Ishaan Jaff
9e75409518 bump litellm proxy extras 2025-05-28 18:58:33 -07:00
Krrish Dholakia
d8415f0c39 bump: version 1.71.1 → 1.71.2 2025-05-28 11:34:16 -07:00
Krrish Dholakia
95de41d10c build: publish new litellm-proxy-extras file 2025-05-27 17:44:23 -07:00
Ishaan Jaff
1876b3ae35
[Fix] Rollback to httpx==0.27.0 (#11146)
* fix - fix - use old httpx version

* fix - fix - use old httpx version

* fix: test

* fix: comment
2025-05-26 10:44:11 -07:00
Krrish Dholakia
d14af20bbd build: bump litellm-enterprise version - cleanup prints 2025-05-24 11:31:42 -07:00
Krrish Dholakia
26dd540a30 bump: version 1.71.0 → 1.71.1 2025-05-24 08:18:27 -07:00
Krrish Dholakia
1257db6335 fix(pyproject.toml): bump litellm version 2025-05-23 23:02:45 -07:00
Krrish Dholakia
2015705012 bump: version 1.70.5 → 1.71.0 2025-05-23 23:01:47 -07:00
Ishaan Jaff
b3ff337141 bump: 1.70.5 2025-05-23 22:58:07 -07:00
Ishaan Jaff
86cdb8382b
[Feat] Use aiohttp transport by default - 97% lower median latency (#11097)
* fix: add flag for disabling use_aiohttp_transport

* feat: add _create_async_transport

* feat: fixes for transport

* add httpx-aiohttp

* feat: fixes for transport

* refactor: fixes for transport

* build: fix deps

* fixes: test fixes

* fix: ensure aiohttp does not auto set content type

* test: test fixes

* feat: add LiteLLMAiohttpTransport

* fix: fixes for responses API handling

* test: fixes for responses API handling

* test: fixes for responses API handling

* feat: fixes for transport

* fix: base embedding handler

* test: test_async_http_handler_force_ipv4

* test: fix failing deepeval test

* fix: add YARL for bedrock urls

* fix: issues with transport

* fix: comment out linting issues

* test fix

* test: XAI is unstable

* test: fixes for using respx

* test: XAI fixes

* test: XAI fixes

* test: infinity testing fixes

* docs(config_settings.md): document param

* test: test_openai_image_edit_litellm_sdk

* test: remove deprecated test

* bump respx==0.22.0

* test: test_xai_message_name_filtering

* test: fix anthropic test after bumping httpx

* use n 4 for mapped tests (#11109)

* fix: use 1 session per event loop

* test: test_client_session_helper

* fix: linting error

* fix: resolving GET requests on httpx 0.28.1

* test fixes proxy unit tests

* fix: add ssl verify settings

* fix: proxy unit tests

* fix: refactor

* tests: basic unit tests for aiohttp transports

* tests: fixes xai

---------

Co-authored-by: Krrish Dholakia <krrishdholakia@gmail.com>
2025-05-23 22:55:35 -07:00
Krrish Dholakia
42c1d932f9 bump: version 0.1.21 → 0.2.0 2025-05-23 21:32:38 -07:00
Krrish Dholakia
856ed51ec1 build(pyproject.toml): add langfuse dev dependency for tests 2025-05-23 12:04:27 -07:00
Ishaan Jaff
a7a5b22393
[Feat] Add Azure AD certificate-based authentication (#11069)
* feat: add cert based auth for Azure get_azure_ad_token_provider

* test: tests azure cert auth

* fix update poetry

* fix: fix linting
2025-05-22 18:05:28 -07:00
Ishaan Jaff
d595c4ef2d bump: version 1.70.3 → 1.70.4 2025-05-22 07:32:35 -07:00
Ishaan Jaff
dd4a65b83a
Feat: add MCP to Responses API and bump openai python sdk (#11029)
* feat: add MCP to responses API

* feat: bump openai version to 1.75.0

* docs MCP + responses API

* fixes: type checking

* fixes: type checking

* build: use latest openai 1.81.0

* fix: linting error

* fix: linting error

* fix: test

* fix: linting errors

* fix: test

* fix: test

* fix: linting

* Revert "fix: linting"

This reverts commit ebb19ff8cb.

* fix: linting
2025-05-22 07:24:10 -07:00
Krrish Dholakia
95fd281a7d bump: version 1.70.2 → 1.70.3 2025-05-20 23:10:44 -07:00
Krrish Dholakia
584660b3cd bump: version 1.70.1 → 1.70.2 2025-05-19 21:03:33 -07:00
Ishaan Jaff
7075168939 bump: litellm proxy extras 2025-05-19 15:40:24 -07:00
Ishaan Jaff
22aa33e8b5 bump litellm_enterprise-0.1.4 2025-05-17 17:28:59 -07:00
Krrish Dholakia
61d7704057 bump: version 1.70.0 → 1.70.1 2025-05-17 09:10:52 -07:00
Ishaan Jaff
8a7fdf3dd5 bump: version 1.69.3 → 1.70.0 2025-05-16 18:38:10 -07:00