Commit graph

33299 commits

Author SHA1 Message Date
Yuneng Jiang
8b6a1f8d89
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Security / security (push) Has been cancelled
2026-04-05 00:51:15 -07:00
Shin
990cda80f2 fix(websearch_interception): Convert agentic loop response to streaming format for Claude Code
Fixes #20187 - When using websearch_interception in Bedrock with Claude Code:

1. Output tokens were showing as 0 because the agentic loop response wasn't
   being converted back to streaming format
2. The response from the agentic loop (follow-up request) was returned as a
   non-streaming dict, but Claude Code expects a streaming response

This fix adds streaming format conversion for the agentic loop response when
the original request was streaming (detected via the
websearch_interception_converted_stream flag in logging_obj).

The fix applies to both:
- Anthropic Messages API (_call_agentic_completion_hooks)
- Chat Completions API (_call_agentic_chat_completion_hooks)

The fix ensures:
- Output tokens are correctly included in the message_delta event
- stop_reason is properly preserved
- The response format matches what Claude Code expects

Note: This fix was previously in PR #20631 but was merged to a staging branch
(litellm_oss_staging_02_07_2026) and never made it to main.
2026-02-22 04:31:47 +00:00
Cesar Garcia
b8cef1a4e5
docs: add OpenClaw integration tutorial (#21605)
* docs: add OpenClaw integration tutorial

* docs: simplify OpenClaw proxy start command

* docs: rewrite OpenClaw integration guide for clarity

- Use gpt-5 as default model
- Replace poetry run with standard litellm CLI
- Add prerequisites section and verification step
- Simplify onboarding instructions (table format)
- Move manual config and troubleshooting to bottom
- Add multi-model config (claude-sonnet, gemini-flash)

* docs: fix model name in OpenClaw manual config example

* docs: rewrite OpenClaw integration guide from scratch

Rewrote the guide based on hands-on testing of every command.
Key changes:
- Replace non-existent `openclaw chat` with verified commands
  (dashboard, tui, agent --agent main)
- Add 3 onboarding options: QuickStart, Manual, and non-interactive
- Fix health check (requires Bearer token)
- Remove misleading "Starting from scratch" section
- Use gpt-4o instead of gpt-5 as the example model
- Clarify that API keys can come from export, .env, or any method
- Add config reference section showing openclaw.json structure
- Add real troubleshooting based on issues found during testing
2026-02-21 20:16:27 -08:00
Krish Dholakia
76ccc9e844
Guardrail Policy Versioning (#21862)
* feat: initial commit, adding support for policy versioning on litellm

* fix(policy_registry): support policy versioning

* fix: multiple QA fixes for policy flow builder with guardrail versioning on litellm

* feat: ui improvements

* feat: add prisma migration

* fix: address greptile fixes
2026-02-21 20:14:31 -08:00
不做了睡大觉
41837ef694
fix: enable context-1m-2025-08-07 beta header for vertex_ai provider (#21867)
The context-1m-2025-08-07 beta header was incorrectly set to null for
vertex_ai in anthropic_beta_headers_config.json, causing the header to
be filtered out when users set extra_headers with anthropic-beta:
context-1m-2025-08-07 for Vertex AI requests.

Vertex AI supports the same beta headers as the Anthropic Messages API,
and other providers (bedrock_converse, azure_ai) already have this
header enabled. This fix aligns vertex_ai with the correct behavior.

Fixes #21861

Co-authored-by: stakeswky <stakeswky@users.noreply.github.com>
2026-02-21 20:12:23 -08:00
yuneng-jiang
d6bd917421
Merge pull request #21863 from BerriAI/litellm_yj_docs_feb21_release
[Docs] store_model_in_db Release Docs
2026-02-21 18:12:20 -08:00
yuneng-jiang
5bb52d0202 adding image 2026-02-21 18:09:18 -08:00
yuneng-jiang
ea37f59de4 Merge remote-tracking branch 'origin' into litellm_yj_docs_feb21_release 2026-02-21 18:05:11 -08:00
Ishaan Jaffer
84b572d719 docs 2026-02-21 18:00:38 -08:00
yuneng-jiang
cb4b638958 Merge branch 'doc_yj_feb21' of github.com:BerriAI/litellm into litellm_yj_docs_feb21 2026-02-21 17:58:44 -08:00
yuneng-jiang
5e26891da2 release note docs 2026-02-21 17:58:36 -08:00
Ishaan Jaffer
19f7e881f3 docs fix 2026-02-21 17:53:51 -08:00
Ishaan Jaffer
356eb5a413 docs fix 2026-02-21 17:51:45 -08:00
Ishaan Jaffer
522954fe0d docs fix 2026-02-21 17:47:44 -08:00
Ishaan Jaffer
45bef9ade8 docs fix 2026-02-21 17:46:01 -08:00
Ishaan Jaffer
5e71f6128b docs fix 2026-02-21 17:40:39 -08:00
Ishaan Jaffer
e157f5a8f2 docs fix 2026-02-21 17:35:16 -08:00
Ishaan Jaffer
661c6faac6 docs fix 2026-02-21 17:28:04 -08:00
Ishaan Jaffer
efebd37183 docs fix 2026-02-21 17:28:04 -08:00
yuneng-jiang
6228148963
Merge pull request #21857 from BerriAI/litellm_yj_docs_feb21
[Doc] Server Root Path Regression Incident Doc#21853
2026-02-21 17:26:43 -08:00
yuneng-jiang
386a8fbd5b
Merge branch 'main' into litellm_yj_docs_feb21 2026-02-21 17:21:35 -08:00
Ishaan Jaffer
7e567a5352 ui new build 2026-02-21 17:16:10 -08:00
Ishaan Jaffer
67a64266ef fix rendering 2026-02-21 17:15:18 -08:00
yuneng-jiang
823bb023df
Merge branch 'main' into litellm_yj_docs_feb21 2026-02-21 17:12:28 -08:00
Ishaan Jaffer
44f69038de UI new build 2026-02-21 17:00:45 -08:00
Ishaan Jaffer
52294029a0 test_vertex_ai_gemini_2_5_pro_streaming 2026-02-21 16:59:22 -08:00
Ishaan Jaffer
2270a3aaf3 Revert "Merge pull request #21140 from BerriAI/litellm_perf_user_api_key_auth"
This reverts commit 0e1db3f7e4, reversing
changes made to 7e2d6f2355.
2026-02-21 16:57:42 -08:00
milan-berri
5390469c1b
fix: replace Zapier webhook with Google Form for survey submission (#21621)
* Replace Zapier webhook with Google Form for survey submission

* Add back error logging for survey submission debugging

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2026-02-21 16:55:59 -08:00
Ishaan Jaffer
ab032c292c docs fix 2026-02-21 16:36:22 -08:00
yuneng-jiang
a3238a4563
Merge branch 'main' into doc_yj_feb21 2026-02-21 16:35:28 -08:00
ryan-crabbe
0e1db3f7e4
Merge pull request #21140 from BerriAI/litellm_perf_user_api_key_auth
perf: optimize user_api_key_auth
2026-02-21 16:23:54 -08:00
yuneng-jiang
79a55ff164
Merge branch 'main' into doc_yj_feb21 2026-02-21 16:06:15 -08:00
ryan-crabbe
ce22524ac5
Merge branch 'main' into litellm_perf_user_api_key_auth 2026-02-21 16:05:33 -08:00
yuneng-jiang
241141d70b Merge branch 'doc_yj_feb21' of github.com:BerriAI/litellm into doc_yj_feb21 2026-02-21 16:05:27 -08:00
yuneng-jiang
aefc7c14f6 Merge remote-tracking branch 'origin' into doc_yj_feb21 2026-02-21 16:05:07 -08:00
Ishaan Jaffer
7e2d6f2355 ui fix 2026-02-21 16:05:03 -08:00
yuneng-jiang
70fd2aa219 fixing syntax 2026-02-21 16:04:42 -08:00
Ryan Crabbe
643c9b6c04 Merge remote-tracking branch 'origin/main' into litellm_perf_user_api_key_auth 2026-02-21 16:03:31 -08:00
yuneng-jiang
2e8d942d17
Merge branch 'main' into doc_yj_feb21 2026-02-21 16:00:46 -08:00
yuneng-jiang
153bf1d856 server root path regression doc 2026-02-21 15:57:06 -08:00
Ishaan Jaffer
d31d5b8486 fix failing tests 2026-02-21 15:48:26 -08:00
Ishaan Jaffer
775fb79260 fix 2026-02-21 15:45:03 -08:00
Ishaan Jaffer
26ea29afd3 test_get_usage_as_dict 2026-02-21 15:39:06 -08:00
Ishaan Jaffer
a58232ac5b fix prisma 2026-02-21 15:35:50 -08:00
Krish Dholakia
1f7eeb274c
Agent Builder - improve rejected response detection based on agent response (#21850)
* fix: feat: add litellm_system_prompt support

* feat: support new 'litellm_agent' model provider

* feat: ui/ - new agent builder ui

* fix(anthropic/chat/transformation.py): normalize max_tokens if decimal

* feat(agentbuilderview.tsx): run compliance datasets against litellm agent

* feat: new response rejection detector

* fix: multiple fixes

* feat: add mcp tools support to agent builder

create an agent with access to llm's + mcp servers
2026-02-21 15:34:42 -08:00
Krish Dholakia
9fc6fd647c
Agent Builder - support new experimental agent builder, to ensure agents pass compliance checks (#21817)
* fix: feat: add litellm_system_prompt support

* feat: support new 'litellm_agent' model provider

* feat: ui/ - new agent builder ui

* fix(anthropic/chat/transformation.py): normalize max_tokens if decimal

* feat(agentbuilderview.tsx): run compliance datasets against litellm agent
2026-02-21 15:32:47 -08:00
Ishaan Jaffer
2acc93e451 BUMP 2026-02-21 15:28:18 -08:00
Ishaan Jaff
bab4127cae
fix(tests): fix flaky test_use_prisma_db_push_flag_behavior (#21849)
Replace Click CliRunner with standalone_mode=False to avoid
"I/O operation on closed file" errors caused by Click's stream
isolation in CI environments.
2026-02-21 15:23:55 -08:00
Ishaan Jaff
f74a1c94df
test(router): add coverage tests for _is_complexity_router_deployment and init_complexity_router_deployment (#21848) 2026-02-21 15:21:10 -08:00
Ishaan Jaff
6dc9823926
docs(release-notes): update v1.81.14 - split guardrail sections, add eval results, fix key highlights and section placement (#21847) 2026-02-21 15:18:46 -08:00