scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-08-28 05:25:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9
29709 commits 3745 branches 1395 tags 3.9 GiB
Commit graph

29709 commits

This branch
This branch
All branches
Author SHA1 Message Date
Yuneng Jiang
b7a37eb7ac
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Details
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Details
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Details
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Details
Unit Tests: Security / security (push) Has been cancelled
Details
2026-04-05 00:02:07 -07:00
Ishaan Jaffer
8e30295ca8 grpcio 2026-01-07 13:19:07 +05:30
Ishaan Jaffer
708481b962 use DEFAULT_A2A_AGENT_TIMEOUT 2026-01-07 12:59:54 +05:30
Ishaan Jaffer
7e21080a7e fix DEFAULT_A2A_AGENT_TIMEOUT 2026-01-07 12:59:02 +05:30
yuneng-jiang
a912665a86
Merge pull request #18682 from BerriAI/litellm_ui_e2e_admin_settings 
[Infra] UI - E2E Test: Can View Admin Setting Page
 2026-01-06 23:25:28 -08:00
yuneng-jiang
f143a16e9b
Merge pull request #18742 from BerriAI/litellm_ui_unit_test_coverage_05 
[Infra] UI - Adding Unit Test for Coverage
 2026-01-06 23:18:29 -08:00
yuneng-jiang
6fd7b1cf56 Adding unit tests for coverage 2026-01-06 22:46:06 -08:00
YutaSaito
9dd9f9fc43
Merge pull request #18738 from BerriAI/litellm_feat_allow_arize_project_name 
[feat] allow configuring arize project name for OpenTelemetry service name
 2026-01-07 15:01:28 +09:00
Yuta Saito
e5be160ae0 docs: sets ARIZE_PROJECT_NAME 2026-01-07 14:27:16 +09:00
Yuta Saito
1d16a8526e feat: allow configuring project name for OpenTelemetry service name 2026-01-07 14:20:10 +09:00
yuneng-jiang
7dca991a5f
Merge pull request #18736 from BerriAI/litellm_ui_team_settings_budget_duration 
[Feature] UI - Reusable Duration Select + Team Update Member Budget Duration
 2026-01-06 18:24:45 -08:00
yuneng-jiang
4d7ed62456
Merge pull request #18735 from BerriAI/litellm_fs_team_member_budget_duration 
[Feature] Allow editing team_member_budget_duration in /team/update
 2026-01-06 18:24:34 -08:00
yuneng-jiang
8b3782b06a Reusable Duration Select and update team member budget UI 2026-01-06 18:15:16 -08:00
yuneng-jiang
2a6f2a3fb8 add team member budget duration in team/update 2026-01-06 17:43:17 -08:00
yuneng-jiang
6078f4687e
Merge pull request #18732 from BerriAI/litellm_ui_build_fix_3 
[Infra] Fixing UI Build
 2026-01-06 17:22:34 -08:00
yuneng-jiang
ae7df51e69 Fixing e2e 2026-01-06 17:06:48 -08:00
yuneng-jiang
8878b43466 Adding timeout for flaky test 2026-01-06 16:56:54 -08:00
YutaSaito
c6b1e0512f
Merge pull request #18726 from gkarthi-signoz/main 
[Docs]: Adding SigNoz integration to observability docs
 2026-01-07 09:47:18 +09:00
yuneng-jiang
874e8d1a6e Fixing build 2026-01-06 16:33:08 -08:00
Goutham Karthi
2865b17988 adding signoz integration to observability docs 2026-01-06 15:29:44 -08:00
Alexsander Hamir
bb4c01ffa0
Add LITELLM_DISABLE_LAZY_LOADING env var to fix VCR cassette creation issue (#18725) 2026-01-06 14:49:11 -08:00
Otavio Brito
18ca6b2add
Handle not supported region for vertex ai count tokens - v1/messages/count_tokens (#18665) 
* Handle not supported region for vertex ai count tokens

* add unit test
 2026-01-07 00:05:00 +05:30
Lundin Matthews
762345172c
Add LlamaGate as a new provider (#18673) 
Adds LlamaGate (https://llamagate.dev) as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 17 models across categories:
  - General purpose (Llama 3.1/3.2, Mistral, Qwen, Dolphin)
  - Reasoning (DeepSeek R1, OpenThinker)
  - Code (Qwen Coder, DeepSeek Coder, CodeLlama)
  - Vision (Qwen VL, LLaVA, Gemma 3)
  - Embeddings (Nomic, Qwen3 Embedding)

Provider details:
- Base URL: https://api.llamagate.dev/v1
- Auth: Bearer token via LLAMAGATE_API_KEY
- Pricing: $0.02-$0.55 per 1M tokens
- All models are open-weights
 2026-01-07 00:00:30 +05:30
Lize Cai
fe9b05e23e
Add header for SAP AI Core Tracking (#18714) 
Signed-off-by: Lize Cai <lize.cai@sap.com>
 2026-01-06 23:59:02 +05:30
Rohit Ravikant Rane
a7c39ccc12
fix(router): correct num_retries tracking in retry logic (#18712) 
* fix(router): correct num_retries tracking in retry logic

- Fix off-by-one error in num_retries attribute when retries exhausted
- Correct remaining_retries calculation
- Add comprehensive tests for retry tracking edge cases

Fixes incorrect retry count in error messages and logging

* chore: trigger CI re-run

* chore: trigger CI tests again
 2026-01-06 23:58:41 +05:30
Kazuki Matsumaru
26bdf7b7a8
Remove redundant comments about setting litellm.callbacks (#18711) 
- Removed duplicate comment in test_router_endpoints.py
- Removed duplicate comment in logging.md
- Kept clearer comment: 'Set litellm.callbacks = [proxy_handler_instance] on the proxy'
 2026-01-06 23:58:01 +05:30
Isaac Reis
a17757159c
add amazon.nova-2-multimodal-embeddings-v1:0 to model_prices_and_context_window.json (#18710) 2026-01-06 23:57:35 +05:30
Pascal Bro
cac2a8d158
Fix/gcs cache docs missing for proxy mode (#13328) 
* fixed issues with gcs cache to verify functionality

* restore changes

* Fix capitalization of 'S3 Bucket Cache'

---------

Co-authored-by: Nelson Alfonso <45660392+Dashing-Nelson@users.noreply.github.com>
 2026-01-06 23:49:08 +05:30
Kris Xia
5e00a49e7f
fix(streaming): normalize status code extraction to prevent 4xx errors from triggering mid-stream fallback (#18698) 
在流式处理错误时，添加状态码标准化逻辑，确保 4xx 客户端错误直接抛出而不是被包装成 MidStreamFallbackError。

- 新增 _normalize_status_code 函数用于从异常对象提取状态码
- 优先从异常的 status_code 属性获取，其次从 response.status_code 获取
- 当映射异常或原始异常的状态码在 400-499 范围内时，直接抛出映射异常
- 添加单元测试验证 Vertex AI 400 错误正确抛出为 BadRequestError
- 确保流式处理中的客户端错误能够正确传播，而不会触发回退机制
 2026-01-06 23:41:23 +05:30
Ishaan Jaff
69aa111fdd
[UI] - Feat add request provider form on UI (#18704) 
* add request provider form

* fix link to github

* add button

* fix link
 2026-01-06 18:54:57 +05:30
Sameer Kankute
ce0f71fbe9
Merge pull request #18706 from BerriAI/litellm_fix_reasoning_summary_default 
[Bug] fix model map
 2026-01-06 18:31:33 +05:30
Sameer Kankute
0cd92e895f fix model map 2026-01-06 18:14:00 +05:30
Sameer Kankute
e3cbd5ff56
Merge pull request #18705 from BerriAI/litellm_fix_reasoning_summary_default 
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
 2026-01-06 18:05:55 +05:30
Sameer Kankute
1c177a576b Add the LITELLM_REASONING_AUTO_SUMMARY in doc 2026-01-06 18:04:09 +05:30
Sameer Kankute
353769d2ac
Merge pull request #18688 from BerriAI/litellm_fix_reasoning_summary_default 
[Fix] Put automatic reasoning summary inclusion behind feat flag
 2026-01-06 17:56:40 +05:30
Sameer Kankute
aca656f036
Merge pull request #18702 from BerriAI/litellm_fix_mapped_test_3 
fix: remove display name
 2026-01-06 16:35:24 +05:30
Sameer Kankute
ffc462465d fix: remove display name 2026-01-06 16:31:07 +05:30
Ishaan Jaff
76eda472be
[Feat] New API Endpoint - Responses API (v1/responses/compact) (#18697) 
* init transform_compact_response_api_request

* init acompact_responses

* init async_compact_response_api_handler in llm http handler

* init transform_compact_response_api_request for openai

* init acompact_responses

* fix acompact_responses

* add OAI Compact API

* docs responses API Compact

* code qa checks

* test_openai_compact_responses_api

* fix mypy linting
 2026-01-06 16:24:04 +05:30
Sameer Kankute
2e668d1dfe
Merge pull request #18701 from BerriAI/revert-17330-add-model-metadata 
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries"
 2026-01-06 15:30:19 +05:30
Sameer Kankute
2baec27657
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries" 2026-01-06 15:29:42 +05:30
Sameer Kankute
eb0193a8a5
Merge pull request #18695 from BerriAI/litellm_fix_mapped_test_060126 
Fix mapped test 060126
 2026-01-06 15:05:19 +05:30
Sameer Kankute
84b24ad030 fix:mypy mcp management 2026-01-06 14:48:31 +05:30
Sameer Kankute
15a28c7fe2 fix:test_api_error_handling 2026-01-06 14:44:34 +05:30
Sameer Kankute
0d050dc0ea fix:test_anthropic_beta_header 2026-01-06 14:28:30 +05:30
Sameer Kankute
8aff258a93 fix: test_databricks_embeddings[True] 2026-01-06 14:20:30 +05:30
Sameer Kankute
386ea1354a fix: async def test_bedrock_apply_guardrail_blocked() 2026-01-06 14:15:06 +05:30
Sameer Kankute
9c795a2baa fix: test_all_models_have_display_name 2026-01-06 14:09:43 +05:30
Sameer Kankute
a087df365e fix: test_aaamodel_prices_and_context_window_json_is_valid 2026-01-06 14:04:09 +05:30
Sameer Kankute
865c7a2215 fix: test_update_ui_settings_allowlisted_value 2026-01-06 13:58:37 +05:30
Sameer Kankute
9d59d3eef6 fix: test_secret_manager_failure_does_not_block_email 2026-01-06 13:58:15 +05:30