Commit graph

26086 commits

Author SHA1 Message Date
Ishaan Jaff
2dd38420a7
[Feat] - Cost Tracking - show input, output, tool call cost breakdown in StandardLoggingPayload (#14921)
* add new CostBreakdown typed dict

* fix CostBreakdown type

* fix fix _store_cost_breakdown_in_logging_obj

* fix CostBreakdown

* test_cost_breakdown_in_standard_logging_payload
2025-09-25 15:48:22 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper (#14903)
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
Ishaan Jaff
ab5fb704c2
[Feat] Logging - datadog callback Log message content w/o sending to datadog (#14909)
* add DatadogInitParams

* fix _get_datadog_params

* test_datadog_message_redaction
2025-09-25 15:46:22 -07:00
Teddy Amkie
be44735de4
Update docs to reflect session management for all models (#14914)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 15:45:13 -07:00
Ishaan Jaff
6916bf15de
Remove 'Useful Links' tab from admin settings UI (#14918)
- Removed 'Useful Links' tab from TabList in admin panel
- Removed corresponding TabPanel containing UsefulLinksManagement component
- Removed unused import for UsefulLinksManagement component
- Fixes issue where useful links section was displaying blank content

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 15:15:46 -07:00
Krish Dholakia
958db9df8c
Merge pull request #14899 from arsh72/fix/presidio-custom-entities-union-type
Fix: Support custom entity types in Presidio guardrail with Union[PiiEntityType, str]
2025-09-25 11:39:11 -07:00
Sameerlite
9d4eb814d4 initial int live api 2025-09-25 22:40:54 +05:30
Arshdeep Singh
cb14bb341d fix: update PresidioAnalyzeRequest type to support Union entities 2025-09-25 13:00:05 -04:00
Arshdeep Singh
471f011ae5 fix: add return type annotation for full mypy compliance 2025-09-25 12:52:12 -04:00
Arshdeep Singh
a9f39396b2 fix: resolve mypy type checking errors for Union type 2025-09-25 12:47:15 -04:00
Arshdeep Singh
8193f56876 fix: remove print statement to pass ruff linting checks 2025-09-25 12:39:49 -04:00
Arshdeep Singh
39683cc3d8 fix: remove unused custom_recognizers variable to pass linting 2025-09-25 12:31:08 -04:00
Arshdeep Singh
8364da014f style: format code with black 2025-09-25 12:23:44 -04:00
Arshdeep Singh
3abb66f080 fix: regenerate poetry.lock to resolve line 3773 corruption 2025-09-25 12:21:23 -04:00
Arshdeep Singh
191ff9f938 fix: regenerate poetry.lock from scratch to resolve dependency issues 2025-09-25 12:16:22 -04:00
Arshdeep Singh
771cfd49f0 fix: regenerate poetry.lock to resolve CI dependency issue 2025-09-25 12:16:22 -04:00
Arshdeep Singh
82ec42993f fix(presidio): enable custom PII entities with Union type 2025-09-25 12:16:22 -04:00
mrFranklin
f717e53d3f doc: update opik integration doc 2025-09-25 16:28:20 +08:00
mrFranklin
7f06b7bb4e doc: update opik integration doc 2025-09-25 16:26:34 +08:00
mrFranklin
dd4fa371fa fix: trace not pass through when trace_id has settled 2025-09-25 15:54:50 +08:00
mrFranklin
f221ce5866 chore: add a comment explaining why update one second to three second 2025-09-25 14:28:49 +08:00
mrFranklin
02a41d76be fix: add default value to pass the opik test 2025-09-25 14:23:00 +08:00
Ishaan Jaffer
31e38efc8a Revert "bump v extras"
This reverts commit c4838e730c.
2025-09-24 22:12:13 -07:00
Ishaan Jaffer
b1e56c55ad merge 2025-09-24 22:11:37 -07:00
Ishaan Jaffer
1585750c1b test fix 2025-09-24 21:45:42 -07:00
Ishaan Jaffer
c4838e730c bump v extras 2025-09-24 21:42:05 -07:00
Ishaan Jaff
ded823a3a3
[Feat] Initial support for scheduled key rotations (#14877)
* add KeyRotationSettings

* add KeyRotationManager

* add key rotation manager

* add KeyRotationManager

* fix _initialize_spend_tracking_background_jobs

* fix add_key_rotation_fields

* fixes

* new fields in schema

* update schema

* fix fixes for init key rotation manager

* fixes for init key rotation manager

* fix KeyRotationManager

* tests for key rotation

* fix key_rotation_settings

* fix KeyRotationManager

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix fixes for init key rotation manager

* ruff check fix

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix _initialize_spend_tracking_background_jobs

* docs fix

* docs auto rotate

* schema fix

* bump proxy extras

* fix config.yml
2025-09-24 21:37:56 -07:00
Ishaan Jaffer
a0e4707782 Revert "Added missing dependencies (#14706)"
This reverts commit b33d52c6e1.
2025-09-24 21:36:57 -07:00
Ishaan Jaffer
ba1cd3f0d2 Revert "feature: generic object pool (#14702)"
This reverts commit 60800698f2.
2025-09-24 21:36:49 -07:00
Ishaan Jaff
d9bf6a8c53
Revert "Fix: make pondpond as optional dependency for proxy extras, disab…" (#14880)
This reverts commit e75d8b711e.
2025-09-24 21:34:42 -07:00
huangyafei
107c45da9d Add gpt-5-codex to OpenRouter cost map 2025-09-25 11:05:56 +08:00
mrFranklin
cdfb32fd16 Merge branch 'main' into feat/improve-opik 2025-09-25 11:05:40 +08:00
huangyafei
1b95940d18 Add gpt-5 to OpenRouter cost map 2025-09-25 11:02:54 +08:00
Alex Shoop
e75d8b711e
Fix: make pondpond as optional dependency for proxy extras, disable object pooling gracefully (#14863)
* pondpond optional dep proxy extra

* lock
2025-09-24 17:09:30 -07:00
Krrish Dholakia
df88b0656e test: update .json 2025-09-24 16:13:51 -07:00
dependabot[bot]
268b66b7ea
Bump tar-fs from 3.0.10 to 3.1.1 in /docs/my-website (#14872)
Bumps [tar-fs](https://github.com/mafintosh/tar-fs) from 3.0.10 to 3.1.1.
- [Commits](https://github.com/mafintosh/tar-fs/compare/v3.0.10...v3.1.1)

---
updated-dependencies:
- dependency-name: tar-fs
  dependency-version: 3.1.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-24 16:13:13 -07:00
Ishaan Jaffer
66a88d3761 fix ci/cd 2025-09-24 11:55:34 -07:00
Copilot
1816176f9d
[Memory Leak Fix] Fix InMemoryCache unbounded growth when TTLs are set (#14869)
* Initial plan

* Fix InMemoryCache unbounded growth issue when TTLs are set

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-09-24 11:54:06 -07:00
Ishaan Jaff
3f5b4c84eb
feat: Add /user/list route to LiteLLMRoutes (#14868)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-09-24 11:21:14 -07:00
Ishaan Jaff
c69bac991b
[Fix] LakeraAI v2 Guardrail - Ensure exception is raised correctly (#14867)
* fix exception lakera

* test lakera ai v2

* ruff fix
2025-09-24 10:55:56 -07:00
Luis Felipe Salazar Ucros
c6cb36186c
Add sambanova deepseek v3.1 and gpt-oss-120b (#14866)
* add sambanova deepseek v3.1 and gpt-oss-120b

* add sambanova deepseek v3.1 and gpt-oss-120b
2025-09-24 10:54:22 -07:00
Mubashir Osmani
0cd91a82d2
Added vertex_ai/qwen models and azure/gpt-5-codex (#14844)
* added qwen models and gpt-5-codex

* fix flaky test

* fix failing test
2025-09-24 10:40:00 -07:00
onlylonly
22eef373eb
feat: New model - Add support for Qwen models family & Deepseek 3.1 to Amazon Bedrock (#14845)
* New model - Add Bedrock deepseek v3.1 model - "deepseek.v3-v1:0"

* New model - Add Bedrock Qwen models - "qwen.qwen3-coder-480b-a35b-v1:0", "qwen.qwen3-235b-a22b-2507-v1:0", "qwen.qwen3-coder-30b-a3b-v1:0", "qwen.qwen3-32b-v1:0"

* fix: add "deepseek.v3-v1:0" in  litellm/model_prices_and_context_window_backup.json
2025-09-24 09:58:23 -07:00
Franklin
e437273ad5
doc: make the README document clearer (#14860)
* Update README.md

* Update README.md
2025-09-24 09:57:21 -07:00
Krish Dholakia
1049c50d6c
Merge pull request #10955 from fabriciojoc/LangfuseUsageDetails
Adding langfuse usage details for cached tokens
2025-09-24 09:24:33 -07:00
Fabrício Ceschin
5eb32e0c24
Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-24 09:43:43 -04:00
mrFranklin
c9b4a6a549 chore: update OpikLogger class for improved configuration handling 2025-09-24 21:15:28 +08:00
oytun.kutrup
410e4956c4
GPT-3.5-Turbo price updated. 2025-09-24 15:32:23 +03:00
shagunb-acn
47d59a372c
Merge branch 'BerriAI:main' into bugfix-14404-image-gen-azure-managed-identity 2025-09-24 16:28:45 +05:30
Shagun Bansal
589c83b88b #14404 BugFix - Add support for Azure AD token-based authorization in image generation request headers definition for Azure 2025-09-24 16:25:44 +05:30