Commit graph

29199 commits

Author SHA1 Message Date
Andrew Truong
1879623502
feat: Basic Weave OTEL integration (#17439)
* test

* testfix
2025-12-03 21:26:22 -08:00
Haiyi
06d42fbd30
Fix: Skip empty text blocks in Anthropic system messages (#17442)
When translating system messages for the Anthropic API, empty text
content blocks cause the error "messages: text content blocks must be
non-empty". This fix skips empty string content and empty text blocks
in list content to prevent this error.

Fixes issue with Vertex AI Anthropic API calls.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude <noreply@anthropic.com>
2025-12-03 21:25:06 -08:00
Devaj Mody
a6ce118989
fix(openai): add clear error message for empty LLM endpoint responses (#17445)
Fixes #17209

  - Add validation after response.parse() to detect empty/invalid responses
  - Raise clear OpenAIError with actionable message
  - Add 3 unit tests
2025-12-03 21:23:09 -08:00
codgician
adfbb1c308
docs: document responses and embedding api for github copilot (#17456) 2025-12-03 21:22:08 -08:00
yuneng-jiang
636f26d8a1 e2e changes 2025-12-03 21:21:27 -08:00
Krish Dholakia
32013f63a0
Guardrail API - support tool call checks on OpenAI /chat/completions, OpenAI /responses, Anthropic /v1/messages (#17459)
* fix(unified_guardrail.py): correctly map a v1/messages call to the anthropic unified guardrail

* fix: add more rigorous call type checks

* fix(anthropic_endpoints/endpoints.py): initialize logging object at the beginning of endpoint

ensures call id + trace id are emitted to guardrail api

* feat(anthropic/chat/guardrail_translation): support streaming guardrails

sample on every 5 chunks

* fix(openai/chat/guardrail_translation): support openai streaming guardrails

* fix: initial commit fixing output guardrails for responses api

* feat(openai/responses/guardrail_translation): handler.py - fix output checks on responses api

* fix(openai/responses/guardrail_translation/handler.py): ensure responses api guardrails work on streaming

* test: update tests

* test: update tests

* fix: support multiple kinds of input to the guardrail api

* feat(guardrail_translation/handler.py): support extracting tool calls from openai chat completions for guardrail api's

* feat(generic_guardrail_api.py): support extracting + returning modified tool calls on generic_guardrails_api

allows guardrail api to analyze tool call being sent to provider - to run any analysis on it

* fix(guardrails.py): support anthropic /v1/messages tool calls

* feat(responses_api/): extract tool calls for guardrail processing

* docs(generic_guardrail_api.md): document tools param support

* docs: generic_guardrail_api.md

improve documentation
2025-12-03 21:20:39 -08:00
yuneng-jiang
a4341ccf83 ci/cd changes for debugging 2025-12-03 21:00:49 -08:00
Krish Dholakia
be0530a6b3
fix(unified_guardrail.py): correctly map a v1/messages call to the anthropic unified guardrail (#17424)
* fix(unified_guardrail.py): correctly map a v1/messages call to the anthropic unified guardrail

* fix: add more rigorous call type checks

* fix(anthropic_endpoints/endpoints.py): initialize logging object at the beginning of endpoint

ensures call id + trace id are emitted to guardrail api

* feat(anthropic/chat/guardrail_translation): support streaming guardrails

sample on every 5 chunks

* fix(openai/chat/guardrail_translation): support openai streaming guardrails

* fix: initial commit fixing output guardrails for responses api

* feat(openai/responses/guardrail_translation): handler.py - fix output checks on responses api

* fix(openai/responses/guardrail_translation/handler.py): ensure responses api guardrails work on streaming

* test: update tests

* test: update tests

* test: update tests

* fix(bedrock_guardrails.py): fix post call streaming iterator logic

* fix: fix return

* fix(bedrock_guardrails.py): fix
2025-12-03 20:54:56 -08:00
Sameer Kankute
2072dcefa8 Map output_tokens_details of responses API to completion_tokens_details 2025-12-04 10:20:45 +05:30
yuneng-jiang
3de84b3f8b e2e tests 2025-12-03 20:34:41 -08:00
Xander Song
a711b63b06
fix: clean arize-phoenix traces (#16611)
* fix

* clean

* clean

* clean

* clean

* clean

* lint
2025-12-03 19:50:20 -08:00
Ishaan Jaff
607d517c01
Revert "Bump mcp from 1.10.1 to 1.23.0 in /.circleci (#17363)" (#17457)
This reverts commit 462d423d86.
2025-12-03 19:44:24 -08:00
Ishaan Jaffer
8a824b7c17 fix mypy linting 2025-12-03 19:43:29 -08:00
Ishaan Jaffer
92cca5d515 test_cyberark_write_and_read_secret 2025-12-03 19:43:29 -08:00
Ishaan Jaffer
e7f066ea7d test_hosted_vllm_full_workflow 2025-12-03 19:43:29 -08:00
Sameer Kankute
50fc30644e
Merge pull request #17311 from Chesars/fix/azure-gpt5.1-reasoning-effort-none
Fix: Allow reasoning_effort='none' for Azure gpt-5.1 models
2025-12-04 09:08:32 +05:30
Ishaan Jaff
b96657a083
[Feat] UI - Agent Gateway - allow testing agents on UI (#17455)
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation

* add a2a invocation i cost calc

* test_a2a_logging_payload

* update invoke_agent_a2a

* test_invoke_agent_a2a_adds_litellm_data

* add A2a agent

* fix endpoints on A2a

* UI allow testing a2a endpoints
2025-12-03 18:57:57 -08:00
Ishaan Jaff
e4f954b354
[Docs] Agent Gateway (#17454)
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation

* add a2a invocation i cost calc

* test_a2a_logging_payload

* update invoke_agent_a2a

* test_invoke_agent_a2a_adds_litellm_data

* add A2a agent

* fix endpoints on A2a

* UI allow testing a2a endpoints

* add agent imgs

* add a2a as an endpoint

* add a2a

* docs a2a invoke

* docs a2a

* docs A2a invoke
2025-12-03 18:57:41 -08:00
Ishaan Jaff
585aee2ae4
[Feat] Agent Gateway - Allow tracking request / response in "Logs" Page (#17449)
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation

* add a2a invocation i cost calc

* test_a2a_logging_payload

* update invoke_agent_a2a

* test_invoke_agent_a2a_adds_litellm_data

* add A2a agent
2025-12-03 18:57:18 -08:00
Ishaan Jaff
4370f6fb74
[Feat] Agent Gateway - Allow invoking agents through AI Gateway (#17440)
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation
2025-12-03 18:54:55 -08:00
Ishaan Jaff
f035984dd7
fix: cyberark allow setting ssl verfiy to false (#17433) 2025-12-03 18:54:31 -08:00
Xianzong Xie
540f14ef51 feat: improve polling via cache feature
- Add 150ms batched updates instead of per-event updates for better performance
- Handle response.output_text.delta events for text accumulation
- Add response.in_progress event handling for status updates
- Add response.completed event handling with reasoning, tools, tool_choice
- Remove unused output_item parameter from update_state
- Remove response.done event type (not valid in OpenAI spec)
- Remove documentation files
- Add comprehensive unit tests for ResponsePollingHandler

Committed-By-Agent: cursor
2025-12-03 18:37:28 -08:00
Xianzong Xie
fc30b92167 add polling via cache feature 2025-12-03 18:37:28 -08:00
yuneng-jiang
e29acb2f64
Merge pull request #16850 from BerriAI/litellm_user_info_404
[Fix] Return 404 when a user is not found on /user/info
2025-12-03 17:15:55 -08:00
yuneng-jiang
224c012e14
Merge pull request #17383 from BerriAI/litellm_vertex_api_base
[Fix] Change labeling around Vertex Fields
2025-12-03 17:14:14 -08:00
yuneng-jiang
d215576477 Add auto redirect to SSO to new login page 2025-12-03 17:07:12 -08:00
yuneng-jiang
73824c278a
Merge pull request #17443 from BerriAI/litellm_v2_login
[Feature] New Login Page
2025-12-03 16:23:47 -08:00
yuneng-jiang
c5670839b6
Merge pull request #17399 from BerriAI/litellm_ui_config_add_sso
[Feature] Add auto_redirect_to_sso to UI Config
2025-12-03 15:59:06 -08:00
yuneng-jiang
37c598441f Change is_sso_configured to auto_redirect_to_sso 2025-12-03 15:48:50 -08:00
yuneng-jiang
8a1cf104e0 Merge remote-tracking branch 'origin' into litellm_ui_config_add_sso 2025-12-03 15:36:33 -08:00
yuneng-jiang
ee63105e16
Merge pull request #17446 from BerriAI/litellm_ui_e2e_cicd_fix
[Fix] Change e2e test to look for Virtual Keys instead of API Keys
2025-12-03 15:35:22 -08:00
yuneng-jiang
de4b79851f Change e2e test to look for Virtual Keys instead of API Keys 2025-12-03 15:26:25 -08:00
dependabot[bot]
462d423d86
Bump mcp from 1.10.1 to 1.23.0 in /.circleci (#17363)
Bumps [mcp](https://github.com/modelcontextprotocol/python-sdk) from 1.10.1 to 1.23.0.
- [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases)
- [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md)
- [Commits](https://github.com/modelcontextprotocol/python-sdk/compare/v1.10.1...v1.23.0)

---
updated-dependencies:
- dependency-name: mcp
  dependency-version: 1.23.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-03 15:19:34 -08:00
yuneng-jiang
43da0793d3 Fixed typo 2025-12-03 15:13:19 -08:00
yuneng-jiang
b14b4a7112 New login screen using v2/login 2025-12-03 15:05:29 -08:00
Ishaan Jaff
100cfc11ac
[Bug Fix] Parallel Request Limiter with /messages (#17426)
* fix: use standard_logging_object for parallel request limiter

* fix test parallel request limtier
2025-12-03 14:13:28 -08:00
Ishaan Jaffer
9b3d8302cf docs fix stable 2025-12-03 14:12:50 -08:00
yuneng-jiang
5f43e7a2d2 New login page WIP 2025-12-03 13:18:33 -08:00
yuneng-jiang
9bb292f478 V2 login route 2025-12-03 12:41:45 -08:00
yuneng-jiang
8aa939dd67
Merge pull request #17317 from BerriAI/litellm_ui_cred_refresh
[Feature] Delete Credential Enhancements
2025-12-03 12:20:55 -08:00
yuneng-jiang
857614d586
Merge pull request #17436 from BerriAI/litellm_ui_model_page_scrollbars
[Fix] Remove second scrollbar when sidebar is expanded + tooltip z index
2025-12-03 12:20:00 -08:00
yuneng-jiang
9783f0ff6c Remove second scrollbar when sidebar is expanded + tooltip z index 2025-12-03 12:14:48 -08:00
Alexsander Hamir
56328e6535
[Refactor#2] litellm/init – Lazy-load utils to reduce memory + import time (#17171)
* fix: lazy load utils.py imports

Lazy-load most functions and response types from utils.py to avoid loading
tiktoken and other heavy dependencies at import time. This significantly
reduces memory usage when importing completion from litellm.
2025-12-03 11:40:16 -08:00
yuneng-jiang
dcb7552b79
Merge pull request #17379 from BerriAI/litellm_login_route_refactor
[Refactor] /login route
2025-12-03 11:32:16 -08:00
Felipe Garé
82a8134d7a
fixing optional parameter default value (#17434) 2025-12-03 11:24:32 -08:00
yuneng-jiang
8df8a7ef95 Merge remote-tracking branch 'origin' into litellm_ui_cred_refresh 2025-12-03 11:04:09 -08:00
yuneng-jiang
cc92fdf90f Merge remote-tracking branch 'origin' into litellm_ui_callback_fix 2025-12-03 11:02:59 -08:00
yuneng-jiang
457840afed Merge remote-tracking branch 'origin' into litellm_user_info_404 2025-12-03 11:02:23 -08:00
yuneng-jiang
e6620fcdad Ruff checks 2025-12-03 11:01:10 -08:00
Felipe Garé
5ecebe2a57
adding status parameter as optinal for FileObject (#17431) 2025-12-03 11:00:18 -08:00