Commit graph

29995 commits

Author SHA1 Message Date
Yuneng Jiang
650fabdbae
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Security / security (push) Has been cancelled
2026-04-05 00:00:11 -07:00
Ishaan Jaffer
59346feedd fix: sync common_utils with main for compatibility 2026-02-18 11:28:50 -08:00
Ishaan Jaff
0b339b4d7e Add Claude Sonnet 4.6 pricing (#21395)
Cherry-picked: e267948d07
2026-02-18 11:28:46 -08:00
Varun Chawla
3bf3a8440d Fix Bedrock Claude Opus 4.6 model ID format (#20671)
Remove incorrect `:0` suffix from regional Bedrock model identifiers:
- us.anthropic.claude-opus-4-6-v1:0 → us.anthropic.claude-opus-4-6-v1
- au.anthropic.claude-opus-4-6-v1:0 (duplicate removed)

The `:0` suffix is invalid for Bedrock inference profile ARNs and causes
"The provided model identifier is invalid" errors when calling the model.

Fixes #20562
2026-02-18 11:26:25 -08:00
Simon Sadedin
c0e9d9112b [Feat] add au version of claude-opus-4-6 to model cost map (#20566)
Notes: General support for Opus 4.6 was added in #20506 however
it omitted the AU (australian) specific instance profile used
in Bedrock. This change only adds the the au id. It is copied
from the US model settings which is consistent with past
additions of this regional model profile.
2026-02-18 11:26:20 -08:00
Sameer Kankute
2abdfc0743 Merge pull request #20733 from BerriAI/litellm_v1_messages_claude_4_6
Cherry-picked: 169e50ce35
2026-02-18 11:26:07 -08:00
Sameer Kankute
cfe7c0fd3a Merge pull request #20551 from BerriAI/litellm_opus_4.6_thinking
Cherry-picked: 6fccaa6584
2026-02-18 11:23:50 -08:00
Ishaan Jaffer
2962afbff6 [Fix] - Reliability fix OOMs with image url handling#19257 2026-02-18 10:55:10 -08:00
Alexsander Hamir
c6e358222c Fix in-flight request termination on SIGTERM when health-check runs in a separate process (#19427) 2026-02-18 10:51:30 -08:00
yuneng-jiang
769d24dedc
Merge pull request #19285 from BerriAI/query_stable_fix
Merge pull request #19045 from dominicfeliton/main
2026-01-17 11:36:19 -08:00
yuneng-jiang
ab547c322d Merge pull request #19045 from dominicfeliton/main
fix: model hub client side exception
2026-01-17 11:34:38 -08:00
Ishaan Jaff
17c8d8d109 fix include proxy/prisma_migration.py in non root (#18971) 2026-01-12 08:13:21 -08:00
Marco Vinciguerra
c82d74587d
Add ScrapeGraph MCP server configuration (#18923) 2026-01-11 21:57:46 +05:30
Ishaan Jaffer
7aee1fcb81 OCR test fixes 2026-01-11 08:00:31 -08:00
Ishaan Jaffer
080982e157 1.80.15 2026-01-10 17:50:13 -08:00
Ishaan Jaffer
f36e898cce bump: version 1.80.14 → 1.80.15 2026-01-10 17:49:46 -08:00
Alexsander Hamir
624c9420b9
perf release notes (#18915) 2026-01-10 16:41:54 -08:00
yuneng-jiang
9bcd6b7bc5
Merge pull request #18914 from BerriAI/ui_build_jan10
[Infra] Building UI
2026-01-10 15:49:15 -08:00
yuneng-jiang
c781bcfabb building ui 2026-01-10 15:46:55 -08:00
Ishaan Jaffer
34383ce97b fix route_request 2026-01-10 15:45:55 -08:00
yuneng-jiang
ecaa449f56
Merge pull request #18913 from BerriAI/endpoint_usage_docs
[Docs] Endpoint Usage Docs
2026-01-10 15:43:30 -08:00
yuneng-jiang
039e11cbe5 Endpoint activity writeup 2026-01-10 15:42:20 -08:00
yuneng-jiang
489a4730ab Merge remote-tracking branch 'origin' into endpoint_usage_docs 2026-01-10 15:41:46 -08:00
yuneng-jiang
728c5297cf
Merge pull request #18911 from BerriAI/litellm_ui_endpoint_usage_trend
[Fix] UI - Endpoint Activity Trend X-Axis and Time Range
2026-01-10 15:31:57 -08:00
Ishaan Jaffer
f1d516f0ae test fixes 2026-01-10 15:15:41 -08:00
yuneng-jiang
ef74f5edb1 fixing test 2026-01-10 15:15:27 -08:00
yuneng-jiang
0b34bfa14c Flipping x axis and removing time range picker 2026-01-10 15:14:17 -08:00
yuneng-jiang
dcae3d569f Flipping x axis and removing time range picker 2026-01-10 15:13:43 -08:00
Ishaan Jaffer
1ebe979eee test_manus_responses_api_with_file_upload 2026-01-10 15:12:00 -08:00
Ishaan Jaffer
58bc308d47 docs levo ai 2026-01-10 15:07:58 -08:00
Ishaan Jaffer
451d240a41 fix 2026-01-10 15:05:38 -08:00
Ishaan Jaffer
64d029bce7 docs fix 2026-01-10 15:04:06 -08:00
Ishaan Jaffer
a4758ab532 QA release notes 2026-01-10 14:57:16 -08:00
Ishaan Jaffer
17995c5192 rc1 writeup 2026-01-10 14:51:56 -08:00
Ishaan Jaffer
9b4f3308fc docs fix 2026-01-10 14:45:55 -08:00
Shivam Rawat
ab37a9872c
fixed _organization_max_budget_check so tests works (#18908) 2026-01-10 14:26:08 -08:00
akraines
7e6d0d7691
fix: Support batch requests with comma-separated models in validate_model_access (#18909)
This fixes a breaking change where batch completion requests with comma-separated
model strings (e.g., 'gpt-3.5-turbo,fake-openai-endpoint') were failing validation.

The validate_model_access function now:
- Detects comma-separated model strings
- Validates each model individually
- Provides clear error messages for inaccessible models in batch requests
- Maintains backward compatibility for single model validation

Fixes test_batch_chat_completions test failure.
2026-01-10 14:23:45 -08:00
Ishaan Jaffer
46cbf673b6 fix code QA 2026-01-10 14:16:55 -08:00
Ishaan Jaffer
3223554905 bump 2026-01-10 14:15:28 -08:00
Ishaan Jaffer
abeec38ada fix manus 2026-01-10 14:14:40 -08:00
Ishaan Jaffer
6a9041e67d Revert "aws fix base"
This reverts commit 225f411abc.
2026-01-10 14:08:11 -08:00
Ishaan Jaffer
f37ccca19c docs fix 2026-01-10 14:04:47 -08:00
Ishaan Jaffer
69aaad5e69 Revert "added extraction of top level metadata for custom lables in prometheus callbacks (#18087)"
This reverts commit 14a4a9c031.
2026-01-10 14:00:54 -08:00
Ishaan Jaffer
6b7f114847 test_lists_with_sensitive_keys_are_masked 2026-01-10 13:55:11 -08:00
Ishaan Jaffer
35c636ba97 test_health_check_not_called_when_disabled 2026-01-10 13:55:11 -08:00
Ishaan Jaff
b1c122056f
Revert "fix: Improve error messages and validation for wildcard routing with multiple credentials" (#18907) 2026-01-10 13:49:43 -08:00
Ishaan Jaffer
ff8e9aeb5c Revert "Add support for Vertex AI API keys"
This reverts commit ad501048f3.
2026-01-10 13:39:49 -08:00
Ishaan Jaff
c0cf8bc27d
[Feat] Manus FILES API - Add File upload, get, delete, list (#18904)
* add MANUS get response

* init TwoStepFileUploadRequest

* init TwoStepFileUploadConfig

* add async_create_file to handle 2 step uploads

* init ManusFilesConfig

* add add get_provider_files_config MANUS

* fix validate_environment

* test_manus_files_api_e2e_all_methods

* aws fix base

* init files API MANUS

* test_manus_responses_api_with_file_upload

* mypy lint fixes

* fix BedrockFilesConfig

* manus docs

* docs manus

* mypy lint

* add add fix resposne api utils MANUS
2026-01-10 13:27:54 -08:00
Ishaan Jaffer
3c3ed3bcfb fix resposne api utils 2026-01-10 13:25:31 -08:00
Ishaan Jaffer
e3fe02148d _mask_sequence 2026-01-10 13:20:43 -08:00