Yuta Saito
695fbf4ec5
feat: hashicorp vault rotate support
2026-01-23 17:32:55 +09:00
Yuta Saito
919033a6d0
fix: include tool arguments in proxy_server_request for spend logs callbacks
2026-01-23 16:36:37 +09:00
YutaSaito
4381e7f98f
Merge pull request #19624 from BerriAI/litellm_test_responses_api_with_mcp_tools
...
[test] Skip anthropic model test when ANTHROPIC_API_KEY is not set
2026-01-23 15:58:19 +09:00
YutaSaito
12bc66aa5b
Merge pull request #19623 from BerriAI/litellm_fix_completions_mcp_output_ordering
...
[fix] completions mcp output ordering
2026-01-23 15:56:02 +09:00
Yuta Saito
1ae9189ff8
test: Skip anthropic model test when ANTHROPIC_API_KEY is not set
2026-01-23 15:50:56 +09:00
Yuta Saito
a06b5ffe24
chore: fix lint error
2026-01-23 15:32:46 +09:00
Yuta Saito
6a60b3d848
test: completions mcp output test
2026-01-23 15:17:14 +09:00
yuneng-jiang
3ad08e999b
adding test
2026-01-22 22:16:08 -08:00
yuneng-jiang
3ee7aab5f2
All Models Backend Search
2026-01-22 22:00:22 -08:00
Yuta Saito
f8ceab94b4
fix: for test
2026-01-23 13:34:07 +09:00
Ishaan Jaff
76fdaa2039
Update README.md
2026-01-22 20:19:57 -08:00
John Greek
26a2c90818
[Fix] Anthropic models on Azure AI cache pricing ( #19532 ) ( #19614 )
2026-01-22 20:00:40 -08:00
Harshit Jain
69c8698e62
fix: pass through endpoints update registry ( #19420 )
...
* fix: pass through endpoints update registry
* add test case, fix lint error and comment to avoid confusion
* fix pass through endpoints test case
2026-01-22 19:57:48 -08:00
Harshit Jain
89ecdc405d
fix: recursive pydantic issue ( #19531 )
2026-01-22 19:56:41 -08:00
Harshit Jain
06a749708d
feat: add datadog cost management support and fix startup callback issue ( #19584 )
2026-01-22 19:52:14 -08:00
Ishaan Jaffer
26d85739f5
docs fix
2026-01-22 19:51:34 -08:00
Ishaan Jaff
c23e4b87dc
[Feat] New LiteLLM Policy engine - create policies to manage guardrails, conditions - permissions per Key, Team ( #19612 )
...
* init PolicyMatcher
* TestPolicyMatcherGetMatchingPolicies
* TestPolicyMatcherGetMatchingPolicies
* feat: init PolicyResolver
* init resolver types
* init policy from config
* inint PolicyValidator
* validate policy
* init Architecture Diagram
* test_add_guardrails_from_policy_engine
* init _init_policy_engine
* test updates
* test fixws
* new attachment config
* simplify types
* TestPolicyResolverInheritance
* fix policy resolver
* fix policies
* fix applied policy
* docs fix
* docs fix
* fix linting + QA checks
* fix linting + QA fixes
* test fixes
2026-01-22 19:49:53 -08:00
Harshit Jain
1d04414f30
feat(datadog): add agent support for LLM Observability ( #19574 )
2026-01-22 19:49:22 -08:00
拐爷&&老拐瘦
3372430d40
Add pricing for volcengine models (deepseek-v3-2, glm-4-7, kimi-k2-thinking) ( #19335 )
...
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-22 19:47:21 -08:00
Ishaan Jaff
e25bd5b167
Update README.md
2026-01-22 19:43:10 -08:00
Cesar Garcia
6cf7bd7c0f
Fix gpt-image-1.5 cost calculation not including output image tokens ( #19515 )
...
Fixes #19508
The cost calculation for gpt-image-1.5 was not including image tokens
from output_tokens_details, causing costs to be underreported
(e.g., $0.046 instead of $0.14).
Root cause: The OpenAI image generation API uses Responses API naming
(input_tokens, output_tokens, output_tokens_details) but the cost
calculator expected Chat Completions API naming (prompt_tokens,
completion_tokens, completion_tokens_details).
Changes:
- convert_dict_to_response.py: Map Responses API fields to Chat
Completions API fields and convert dicts to wrapper objects
- cost_calculator.py: Use usage directly if already transformed,
avoiding double transformation that lost the wrapper objects
- Added test for gpt-image-1.5 output image token cost calculation
2026-01-22 19:42:15 -08:00
Ishaan Jaff
b8399c1977
Update README.md
2026-01-22 19:41:21 -08:00
moh-dev-stack
65e943dc2b
Bugfix/19481 num retries env var type ( #19507 )
...
* Enhance error handling for num_retries in Router class to support string values. Add test case to verify conversion from string to int for deployment num_retries.
* Refactor Router class for improved readability by formatting long lines and enhancing exception handling tests for num_retries. Ensure consistent style in test cases for better maintainability.
* Update exception handling for num_retries in Router class to suppress mypy warnings. Add type ignore comment for clarity in type conversion from string to int.
2026-01-22 19:39:58 -08:00
ruanjiefeng
324f1f4682
add Vertex_AI llm credentials sensitive keywords "vertex_credentials" ( #19551 )
...
* add Vertex_AI llm credentials sensitive keywords "vertex_credentials"
* Update test_litellm_logging.py add test case
2026-01-22 19:38:14 -08:00
jquinter
0622ce3f2c
Fix/nova grounding ( #19598 )
...
* added support for nova grounding for amazon nova model
* added citations support
* added integration tests
* removing test file
* refactor: Use web_search_options for Nova grounding instead of system_tool
---------
Co-authored-by: Juhie <juhiechandra@gmail.com>
Co-authored-by: Juhie <75068056+juhiechandra@users.noreply.github.com>
2026-01-22 19:34:29 -08:00
Sameer Kankute
ebf0beda97
Fix: litellm/tests/test_proxy_server_non_root.py
2026-01-23 08:58:56 +05:30
Harshit Jain
9084c1d1bd
feat(helm): Enable PreStop hook configuration in values.yaml ( #19613 )
2026-01-22 19:28:52 -08:00
Yuta Saito
4164c9ca18
fix: completions mcp output ordering
2026-01-23 12:19:07 +09:00
Ishaan Jaff
066eb7f387
Add OSS Adopters section to README
2026-01-22 18:47:04 -08:00
milan-berri
11ee13a30e
adjust opencode tutorial ( #19605 )
2026-01-22 16:54:46 -08:00
yuneng-jiang
f78fc4e0fe
Fix org all proxy model case
2026-01-22 15:32:10 -08:00
milan-berri
c9516d68d4
add opencode tutorial ( #19602 )
2026-01-22 15:29:19 -08:00
yuneng-jiang
8ae42293c1
Merge pull request #19603 from BerriAI/litellm_cicd_fix_yj_020
...
[Infra] CI/CD - Add retries to Flaky Tests + Add "eos" as a Finish Reason
2026-01-22 15:24:03 -08:00
yuneng-jiang
827ce52d80
Adding retries to flaky tests
2026-01-22 15:21:44 -08:00
yuneng-jiang
f425c80858
Adding EOS to finish reasons
2026-01-22 15:16:44 -08:00
yuneng-jiang
9fe3e420e9
Fixing tests
2026-01-22 15:01:06 -08:00
yuneng-jiang
ca22e08eae
Add reusable model select to update organization page
2026-01-22 14:53:53 -08:00
yuneng-jiang
e03feb7a86
Merge pull request #19595 from BerriAI/litellm_yj_bump_version
...
bump: version 1.81.1 → 1.81.2
2026-01-22 12:36:14 -08:00
yuneng-jiang
d72f548e19
bump: version 1.81.1 → 1.81.2
2026-01-22 12:35:13 -08:00
yuneng-jiang
c78b527104
Merge pull request #19593 from BerriAI/litellm_cicd_fix_yj_018
...
[Infra] CI/CD - Overriding lodash-es with v4.17.23 in docs and UI
2026-01-22 12:23:25 -08:00
yuneng-jiang
3cb47dae44
updating lodash for dashboard
2026-01-22 12:22:04 -08:00
yuneng-jiang
ce586ec3d1
Overriding lodash-es with version 4.17.23 in docs
2026-01-22 12:13:40 -08:00
yuneng-jiang
8582842454
Merge pull request #19590 from BerriAI/litellm_cicd_fix_yj_017
...
[Infra] CI/CD - Fix LLM Translation Tests
2026-01-22 12:03:02 -08:00
yuneng-jiang
4314145570
Merge pull request #19591 from BerriAI/revert-19540-litellm_ui_e2e_internal_viewer_tests
...
Revert "[Infra] UI - E2E Tests: Internal Viewer Sidebar"
2026-01-22 11:56:00 -08:00
yuneng-jiang
a0d47d5e4f
Revert "[Infra] UI - E2E Tests: Internal Viewer Sidebar"
2026-01-22 11:55:05 -08:00
Krrish Dholakia
45a9886798
fix: change oss staging branch name to reflect they're oss
2026-01-22 11:50:27 -08:00
yuneng-jiang
93016771bb
attempt fix translation tests
2026-01-22 11:48:35 -08:00
yuneng-jiang
01f355be7c
Merge pull request #19587 from BerriAI/litellm_cicd_fix_yj_016
...
[Infra] CI/CD - Adding lodash-es to allowlist
2026-01-22 11:46:25 -08:00
yuneng-jiang
5c29eeea30
Merge pull request #19585 from BerriAI/litellm_cicd_fix_yj_015
...
[Infra] CI/CD - Fix Non Root Proxy Tests
2026-01-22 11:31:50 -08:00
yuneng-jiang
3ddc15a081
Adding lodash-es to allowlist
2026-01-22 11:26:04 -08:00
