Commit graph

40072 commits

Author SHA1 Message Date
Yuneng Jiang
310d61ba70
[Fix] Replace cast with proper typing for reasoning_items
Add reasoning_items field to ChatCompletionAssistantMessage TypedDict
and extract a typed _get_reasoning_items helper instead of using cast.
Also widen _reasoning_item_to_response_input to accept ChatCompletionReasoningItem.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 11:33:26 -07:00
Yuneng Jiang
868468db14
[Test] Mock DeepInfra completion tests to avoid real API calls
The DeepInfra tests were making real API calls and failing with AuthenticationError.
Mock the HTTP layer to verify request shape instead.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 11:07:34 -07:00
Yuneng Jiang
0f785f988b
[Fix] Add missing user_api_key_project_alias to failed-response PagerDuty event
The hanging-response constructor was fixed but the sibling failed-response
constructor at line 104 was still missing this field.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 11:07:04 -07:00
Yuneng Jiang
f08d281641
[Fix] Resolve mypy type errors across 3 files
Add missing `user_api_key_project_alias` key to SpendLogsMetadata and
PagerDutyInternalEvent constructors, and cast `reasoning_items` to list
for safe iteration in responses transformation.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 10:56:54 -07:00
Yuneng Jiang
92e7aaa001
[Refactor] Extract helper methods in guardrail handlers to fix PLR0915
Ruff flagged `process_output_streaming_response` (A2A) and
`process_output_response` (Anthropic) for exceeding 50 statements.
Extract inline logic into private helpers to bring both under the limit.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 10:41:45 -07:00
Krrish Dholakia
a278933f18 docs: cleanup 2026-03-30 09:41:09 -07:00
Krrish Dholakia
c154d5668b
Merge pull request #24792 from BerriAI/ossf-scorecord
adopt OpenSSF Scorecard (https://scorecard.dev/)
2026-03-30 09:37:34 -07:00
Krrish Dholakia
1eaf8ed2d5
Merge pull request #24800 from BerriAI/litellm_vanta_announcement
Litellm vanta announcement
2026-03-30 09:27:55 -07:00
Krrish Dholakia
0128925281 docs: cleanup image 2026-03-30 09:26:46 -07:00
Krrish Dholakia
bc89ad28ab docs: cleanup 2026-03-30 09:19:48 -07:00
Krrish Dholakia
5671baaadf fix: fix setup wizard 2026-03-30 09:06:31 -07:00
Krrish Dholakia
05134fc70b
Create scorecard.yml 2026-03-30 07:47:06 -07:00
Krrish Dholakia
58120537af
Merge pull request #24756 from BerriAI/litellm_/pensive-sinoussi
[Fix] Remove NLP_CLOUD_API_KEY requirement from test_exceptions
2026-03-28 22:04:49 -07:00
Krrish Dholakia
a671083596
Merge pull request #24755 from BerriAI/litellm_test_cleanup
Litellm test cleanup
2026-03-28 22:04:26 -07:00
Krrish Dholakia
85cc7bc433 refactor: make unit test 2026-03-28 21:44:46 -07:00
Krrish Dholakia
1ba109079d test: update tests 2026-03-28 21:22:04 -07:00
Krrish Dholakia
9e070143fb test: update key names 2026-03-28 21:13:16 -07:00
Krrish Dholakia
25f2baad71 test: cleanup dead tests 2026-03-28 20:49:02 -07:00
Yuneng Jiang
14095ee144
[Fix] Remove NLP_CLOUD_API_KEY requirement from test_exceptions.py
The test only needs a bad key to verify AuthenticationError handling.
No other tests use this env var, and it's not provisioned in CI.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-28 20:38:54 -07:00
Krrish Dholakia
a92b31a636 test: remove dead tests 2026-03-28 20:36:08 -07:00
Krrish Dholakia
fe379fd738 test: rename env var 2026-03-28 20:27:39 -07:00
Krrish Dholakia
0fef88d67c test: remove dead tests 2026-03-28 20:23:44 -07:00
yuneng-jiang
c27114470e
Merge pull request #24754 from BerriAI/litellm_gha_p3b
[Infra] Remove CircleCI jobs now covered by GitHub Actions
2026-03-28 20:23:27 -07:00
Krrish Dholakia
1fb677702d test: update to new vertex ai keys 2026-03-28 20:19:05 -07:00
Krrish Dholakia
92db2df2f6
Merge pull request #23794 from ndgigliotti/feat/bedrock-structured-output-cost-json
Bedrock: move native structured output model list to cost JSON, add Sonnet 4.6
2026-03-28 20:04:47 -07:00
Krrish Dholakia
ce26dd4101 test: update tests 2026-03-28 19:42:14 -07:00
Krrish Dholakia
cdcab8a243 refactor: cleanup deprecated models 2026-03-28 19:39:11 -07:00
Krrish Dholakia
bc829d51f2 test: test 2026-03-28 19:17:38 -07:00
Yuneng Jiang
7aec9101f5
[Infra] Remove CircleCI jobs now covered by GitHub Actions
Removes 10 CircleCI jobs that are fully duplicated by GHA workflows:
- caching_unit_tests → test-unit-caching-redis.yml
- litellm_security_tests → test-unit-security.yml
- litellm_proxy_unit_testing_{key_generation,part1,part2} → test-unit-proxy-db.yml + test-unit-proxy-legacy.yml
- litellm_mapped_tests_{llms,core,litellm_core_utils,mcps,integrations} → test-unit-*.yml workflows

Also cleans up upload-coverage requires and workflow entries.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-28 19:06:48 -07:00
Krrish Dholakia
a41ba7bb6a test: update test 2026-03-28 19:01:55 -07:00
Krrish Dholakia
bee1607248 test: update test apis 2026-03-28 18:57:27 -07:00
Krrish Dholakia
564ad3195b test: update testing 2026-03-28 18:42:55 -07:00
Krrish Dholakia
5cd8ca2365 refactor: refactor testing 2026-03-28 18:39:32 -07:00
Krrish Dholakia
6df995d0d1 refactor: dead test cleanup 2026-03-28 18:27:25 -07:00
Krrish Dholakia
44b03e6138 fix: fix azure tests 2026-03-28 18:19:41 -07:00
Krrish Dholakia
c75fb3650a fix: fix azure audio test 2026-03-28 18:14:01 -07:00
Krrish Dholakia
b63b43fe09 docs: add faq to docs 2026-03-28 18:14:01 -07:00
ryan-crabbe-berri
93d8b7f75a
Merge pull request #24750 from BerriAI/litellm_chore-migrate-tremor
chore(ui): migrate Tremor components, fix log filters, access group models, substring key search
2026-03-28 17:51:14 -07:00
Ryan Crabbe
fdad43b6dd
style: use not team_object.models consistently for empty-list checks 2026-03-28 17:45:37 -07:00
Krrish Dholakia
bc33cf662f
Merge pull request #24449 from J-Byron/feat/prometheus-org-budget-metrics
Feat/prometheus org budget metrics
2026-03-28 17:32:17 -07:00
Ryan Crabbe
191bb9504d
chore(ui): migrate Tremor Text/Badge to antd Tag and native spans in logging_settings_view
Replace Tremor Text with native <span> elements (with block class where
stacking is needed) and Tremor Badge with antd Tag. All Tailwind classes
preserved. Gray badge default mapped to undefined (antd Tag default).
2026-03-28 16:59:19 -07:00
ryan-crabbe-berri
8fb27c697c
Merge pull request #24746 from BerriAI/litellm_feat-substring-key-filters
feat: support substring search for user_id and key_alias on /key/list
2026-03-28 16:57:11 -07:00
Ryan Crabbe
a59acc8f8a
[Fix] Derive use_substring_matching from role, not auto-set path
Substring matching for user_id and key_alias on /key/list is now gated
by caller role (admin only) rather than by whether user_id was auto-set.
This closes the gap where a non-admin explicitly passing their own
user_id still got contains-based filtering, which could surface keys
belonging to other users with overlapping IDs.

Adds three unit tests covering the substring, exact-match, and default
code paths in _build_key_filter_conditions. Restores the existing
member-team test to assert exact matching as a security regression guard.
2026-03-28 16:50:09 -07:00
ryan-crabbe-berri
77ad1ab530
Merge pull request #24745 from BerriAI/litellm_fix-logs-filtering
Fix logs page showing unfiltered results when filter matches zero rows
2026-03-28 16:24:09 -07:00
Ryan Crabbe
8a2186a654
[Fix] Reset page to 1 on filter reset and use pageSize param in fallbacks
Add setCurrentPage(1) to handleFilterReset in the hook so page resets
regardless of which component consumes it. Replace hardcoded page_size: 50
in empty-state fallbacks with the pageSize parameter for consistency.
2026-03-28 16:19:03 -07:00
ryan-crabbe-berri
9c59d5ee1b
Merge pull request #24747 from BerriAI/litellm_docs-high-availability
docs: Improve HA control plane diagram clarity
2026-03-28 16:11:12 -07:00
Ryan Crabbe
9284395c1d
[Fix] Hide connector label on mobile, remove stale master key mention
Hide .connectorBranchLabeled on ≤768px so the "UI management only"
label doesn't render without its branch lines. Also remove "master key"
from doc text since the diagram intentionally omits that box.
2026-03-28 15:51:44 -07:00
Ryan Crabbe
d332c5b541
[Docs] Improve high availability control plane diagram clarity
Show each worker's DB and Redis as prominent infra boxes instead of
small chips, and clarify that the control plane is admin UI only —
not a router.
2026-03-28 15:29:02 -07:00
yuneng-jiang
40d4e79a00
Merge pull request #24742 from BerriAI/litellm_gha_p3
[Infra] Add unit test workflows for Postgres, Redis, and security suites
2026-03-28 14:54:20 -07:00
Ryan Crabbe
65df501f15
Simplify substring search — remove admin-only gating
Substring matching for user_id and key_alias now applies unconditionally.
The admin-only flag was unnecessary since user_ids are typically UUIDs/emails
where substring collisions are not a practical concern. Updated existing test
to assert the new filter structure.
2026-03-28 14:50:31 -07:00