Commit graph

31779 commits

Author SHA1 Message Date
xqe2011
ca8c2c3938
fix #19620: SSO user roles are not updated for existing users (#19621)
* Fix: SSO user roles are not updated for existing users
Fixes #19620

* Refactor: Remove redundant user_info retrieval in SSOAuthenticationHandler

* Test: add new tests for user creation and updates in get_user_info_from_db
2026-01-23 09:05:29 -08:00
Nikita Timofeev
e63537c6c1 Fix: ensure function content is valid JSON for GigaChat 2026-01-23 15:27:46 +00:00
Sameer Kankute
9894721285
Merge pull request #19548 from BerriAI/litellm_staging_01_22_2026
Litellm staging 01 22 2026
2026-01-23 20:03:11 +05:30
Sameer Kankute
23f7d4f0b0
Merge pull request #19645 from BerriAI/litellm_gigachat_big_fix
Add tool choice mapping for giga chat
2026-01-23 19:52:35 +05:30
Sameer Kankute
a240eb7630
Merge pull request #19649 from BerriAI/litellm_fix_responses_api_logging_eror
Fix: Responses API logging error for StopIteration
2026-01-23 19:51:45 +05:30
Sameer Kankute
fe5fac17b3 Remove f string 2026-01-23 19:50:13 +05:30
Sameer Kankute
a4bf14f6e7 Fix: test_nova_invoke_streaming_chunk_parsing 2026-01-23 19:49:42 +05:30
Sameer Kankute
11b4c456b4 Add documentation 2026-01-23 19:42:59 +05:30
Sameer Kankute
2820a51950 Add otel providers and langfuse for litellm_callback_logging_failures_metric_total 2026-01-23 19:40:15 +05:30
Sameer Kankute
8357d05615 Fix: Responses API logging error for StopIteration 2026-01-23 18:42:33 +05:30
YutaSaito
8ac1d96d90
Merge pull request #19634 from BerriAI/litellm_feat_hashicorp_rotate
[feat] hashicorp vault rotate support
2026-01-23 21:08:55 +09:00
Sameer Kankute
acf5ad1155 Add tool choice mapping for giga chat 2026-01-23 16:29:19 +05:30
YutaSaito
83da74b12c
Merge pull request #19640 from BerriAI/litellm_fix_mcp_completions_spend_logs
[fix] include tool arguments in proxy_server_request for spend logs ca…
2026-01-23 18:45:42 +09:00
Sameer Kankute
12463809bd
Merge pull request #19638 from BerriAI/main
merge main in stagin 1 22 26
2026-01-23 14:54:17 +05:30
Yuta Saito
695fbf4ec5 feat: hashicorp vault rotate support 2026-01-23 17:32:55 +09:00
Yuta Saito
919033a6d0 fix: include tool arguments in proxy_server_request for spend logs callbacks 2026-01-23 16:36:37 +09:00
YutaSaito
4381e7f98f
Merge pull request #19624 from BerriAI/litellm_test_responses_api_with_mcp_tools
[test] Skip anthropic model test when ANTHROPIC_API_KEY is not set
2026-01-23 15:58:19 +09:00
YutaSaito
12bc66aa5b
Merge pull request #19623 from BerriAI/litellm_fix_completions_mcp_output_ordering
[fix] completions mcp output ordering
2026-01-23 15:56:02 +09:00
Yuta Saito
1ae9189ff8 test: Skip anthropic model test when ANTHROPIC_API_KEY is not set 2026-01-23 15:50:56 +09:00
Yuta Saito
a06b5ffe24 chore: fix lint error 2026-01-23 15:32:46 +09:00
Yuta Saito
6a60b3d848 test: completions mcp output test 2026-01-23 15:17:14 +09:00
yuneng-jiang
3ad08e999b adding test 2026-01-22 22:16:08 -08:00
yuneng-jiang
3ee7aab5f2 All Models Backend Search 2026-01-22 22:00:22 -08:00
Yuta Saito
f8ceab94b4 fix: for test 2026-01-23 13:34:07 +09:00
Ishaan Jaff
76fdaa2039
Update README.md 2026-01-22 20:19:57 -08:00
John Greek
26a2c90818
[Fix] Anthropic models on Azure AI cache pricing (#19532) (#19614) 2026-01-22 20:00:40 -08:00
Harshit Jain
69c8698e62
fix: pass through endpoints update registry (#19420)
* fix: pass through endpoints update registry

* add test case, fix lint error and comment to avoid confusion

* fix pass through endpoints test case
2026-01-22 19:57:48 -08:00
Harshit Jain
89ecdc405d
fix: recursive pydantic issue (#19531) 2026-01-22 19:56:41 -08:00
Harshit Jain
06a749708d
feat: add datadog cost management support and fix startup callback issue (#19584) 2026-01-22 19:52:14 -08:00
Ishaan Jaffer
26d85739f5 docs fix 2026-01-22 19:51:34 -08:00
Ishaan Jaff
c23e4b87dc
[Feat] New LiteLLM Policy engine - create policies to manage guardrails, conditions - permissions per Key, Team (#19612)
* init PolicyMatcher

* TestPolicyMatcherGetMatchingPolicies

* TestPolicyMatcherGetMatchingPolicies

* feat: init PolicyResolver

* init resolver types

* init policy from config

* inint PolicyValidator

* validate policy

* init Architecture Diagram

* test_add_guardrails_from_policy_engine

* init _init_policy_engine

* test updates

* test fixws

* new attachment config

* simplify types

* TestPolicyResolverInheritance

* fix policy resolver

* fix policies

* fix applied policy

* docs fix

* docs fix

* fix linting + QA checks

* fix linting + QA fixes

* test fixes
2026-01-22 19:49:53 -08:00
Harshit Jain
1d04414f30
feat(datadog): add agent support for LLM Observability (#19574) 2026-01-22 19:49:22 -08:00
拐爷&&老拐瘦
3372430d40
Add pricing for volcengine models (deepseek-v3-2, glm-4-7, kimi-k2-thinking) (#19335)
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-22 19:47:21 -08:00
Ishaan Jaff
e25bd5b167
Update README.md 2026-01-22 19:43:10 -08:00
Cesar Garcia
6cf7bd7c0f
Fix gpt-image-1.5 cost calculation not including output image tokens (#19515)
Fixes #19508

The cost calculation for gpt-image-1.5 was not including image tokens
from output_tokens_details, causing costs to be underreported
(e.g., $0.046 instead of $0.14).

Root cause: The OpenAI image generation API uses Responses API naming
(input_tokens, output_tokens, output_tokens_details) but the cost
calculator expected Chat Completions API naming (prompt_tokens,
completion_tokens, completion_tokens_details).

Changes:
- convert_dict_to_response.py: Map Responses API fields to Chat
  Completions API fields and convert dicts to wrapper objects
- cost_calculator.py: Use usage directly if already transformed,
  avoiding double transformation that lost the wrapper objects
- Added test for gpt-image-1.5 output image token cost calculation
2026-01-22 19:42:15 -08:00
Ishaan Jaff
b8399c1977
Update README.md 2026-01-22 19:41:21 -08:00
moh-dev-stack
65e943dc2b
Bugfix/19481 num retries env var type (#19507)
* Enhance error handling for num_retries in Router class to support string values. Add test case to verify conversion from string to int for deployment num_retries.

* Refactor Router class for improved readability by formatting long lines and enhancing exception handling tests for num_retries. Ensure consistent style in test cases for better maintainability.

* Update exception handling for num_retries in Router class to suppress mypy warnings. Add type ignore comment for clarity in type conversion from string to int.
2026-01-22 19:39:58 -08:00
ruanjiefeng
324f1f4682
add Vertex_AI llm credentials sensitive keywords "vertex_credentials" (#19551)
* add Vertex_AI  llm credentials sensitive keywords "vertex_credentials"

* Update test_litellm_logging.py add test case
2026-01-22 19:38:14 -08:00
jquinter
0622ce3f2c
Fix/nova grounding (#19598)
* added support for nova grounding for amazon nova model

* added citations support

* added integration tests

* removing test file

* refactor: Use web_search_options for Nova grounding instead of system_tool

---------

Co-authored-by: Juhie <juhiechandra@gmail.com>
Co-authored-by: Juhie <75068056+juhiechandra@users.noreply.github.com>
2026-01-22 19:34:29 -08:00
Sameer Kankute
ebf0beda97 Fix: litellm/tests/test_proxy_server_non_root.py 2026-01-23 08:58:56 +05:30
Harshit Jain
9084c1d1bd
feat(helm): Enable PreStop hook configuration in values.yaml (#19613) 2026-01-22 19:28:52 -08:00
Yuta Saito
4164c9ca18 fix: completions mcp output ordering 2026-01-23 12:19:07 +09:00
Ishaan Jaff
066eb7f387
Add OSS Adopters section to README 2026-01-22 18:47:04 -08:00
milan-berri
11ee13a30e
adjust opencode tutorial (#19605) 2026-01-22 16:54:46 -08:00
yuneng-jiang
f78fc4e0fe Fix org all proxy model case 2026-01-22 15:32:10 -08:00
milan-berri
c9516d68d4
add opencode tutorial (#19602) 2026-01-22 15:29:19 -08:00
yuneng-jiang
8ae42293c1
Merge pull request #19603 from BerriAI/litellm_cicd_fix_yj_020
[Infra] CI/CD - Add retries to Flaky Tests + Add "eos" as a Finish Reason
2026-01-22 15:24:03 -08:00
yuneng-jiang
827ce52d80 Adding retries to flaky tests 2026-01-22 15:21:44 -08:00
yuneng-jiang
f425c80858 Adding EOS to finish reasons 2026-01-22 15:16:44 -08:00
yuneng-jiang
9fe3e420e9 Fixing tests 2026-01-22 15:01:06 -08:00