scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-08 22:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78
29721 commits 4150 branches 1402 tags 2.2 GiB
Commit graph

29721 commits

This branch
This branch
All branches
Author SHA1 Message Date
Yuneng Jiang
404310e8ee
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Details
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Details
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Details
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Details
Unit Tests: Security / security (push) Has been cancelled
Details
2026-04-05 01:00:27 -07:00
Krrish Dholakia
7d04c8d19a test: add new test 2026-01-07 17:35:57 +05:30
Krrish Dholakia
04c278febe docs: add more tests + improve coverage 2026-01-07 17:33:43 +05:30
Krrish Dholakia
09484dff33 docs: document all endpoints in .json and add consistency checks against docs + providers.json 2026-01-07 16:56:41 +05:30
Ishaan Jaffer
a5332a6d51 fix code qa check 2026-01-07 14:54:00 +05:30
Ishaan Jaffer
676e362d43 bump extrs 2026-01-07 14:40:30 +05:30
Ishaan Jaffer
ee2b51b2d0 test_openai_image_edit_cost_tracking 2026-01-07 14:36:50 +05:30
Ishaan Jaffer
bab43ee9dd fix list keys 2026-01-07 14:34:37 +05:30
Ishaan Jaffer
38ccfb4234 test_completion_claude_3_function_call_with_otel 2026-01-07 14:22:54 +05:30
Ishaan Jaffer
fa1b387237 test_routing_strategy_init 2026-01-07 14:21:03 +05:30
Ishaan Jaffer
3530218930 fix aupload_container_file 2026-01-07 14:19:36 +05:30
Ishaan Jaffer
b7798b7f7c fix metadata.cost_breakdown 2026-01-07 14:17:08 +05:30
Ishaan Jaff
b5d74722ba
Revert "Litellm fixes a2a sdk (#18748)" (#18752) 
This reverts commit 1661707492.
 2026-01-07 14:04:10 +05:30
Ishaan Jaff
1f141f0dbb
[Feat] Litellm new endpoint add container file upload (#18743) 
* init upload_container_file

* init upload_container_file

* _prepare_multipart_file_upload

* fix upload_container_file

* aupload_container_file, upload_container_file

* register_container_file_endpoints
 2026-01-07 13:36:55 +05:30
Ishaan Jaff
861dac1c8d
[Fix] A2a endpoint - fix timeout (#18747) 
* fix DEFAULT_A2A_AGENT_TIMEOUT

* use DEFAULT_A2A_AGENT_TIMEOUT

* grpcio
 2026-01-07 13:31:53 +05:30
Ishaan Jaff
1661707492
Litellm fixes a2a sdk (#18748) 
* add a2a SDK to req

* fix
 2026-01-07 13:31:45 +05:30
yuneng-jiang
a912665a86
Merge pull request #18682 from BerriAI/litellm_ui_e2e_admin_settings 
[Infra] UI - E2E Test: Can View Admin Setting Page
 2026-01-06 23:25:28 -08:00
yuneng-jiang
f143a16e9b
Merge pull request #18742 from BerriAI/litellm_ui_unit_test_coverage_05 
[Infra] UI - Adding Unit Test for Coverage
 2026-01-06 23:18:29 -08:00
yuneng-jiang
6fd7b1cf56 Adding unit tests for coverage 2026-01-06 22:46:06 -08:00
YutaSaito
9dd9f9fc43
Merge pull request #18738 from BerriAI/litellm_feat_allow_arize_project_name 
[feat] allow configuring arize project name for OpenTelemetry service name
 2026-01-07 15:01:28 +09:00
Yuta Saito
e5be160ae0 docs: sets ARIZE_PROJECT_NAME 2026-01-07 14:27:16 +09:00
Yuta Saito
1d16a8526e feat: allow configuring project name for OpenTelemetry service name 2026-01-07 14:20:10 +09:00
yuneng-jiang
7dca991a5f
Merge pull request #18736 from BerriAI/litellm_ui_team_settings_budget_duration 
[Feature] UI - Reusable Duration Select + Team Update Member Budget Duration
 2026-01-06 18:24:45 -08:00
yuneng-jiang
4d7ed62456
Merge pull request #18735 from BerriAI/litellm_fs_team_member_budget_duration 
[Feature] Allow editing team_member_budget_duration in /team/update
 2026-01-06 18:24:34 -08:00
yuneng-jiang
8b3782b06a Reusable Duration Select and update team member budget UI 2026-01-06 18:15:16 -08:00
yuneng-jiang
2a6f2a3fb8 add team member budget duration in team/update 2026-01-06 17:43:17 -08:00
yuneng-jiang
6078f4687e
Merge pull request #18732 from BerriAI/litellm_ui_build_fix_3 
[Infra] Fixing UI Build
 2026-01-06 17:22:34 -08:00
yuneng-jiang
ae7df51e69 Fixing e2e 2026-01-06 17:06:48 -08:00
yuneng-jiang
8878b43466 Adding timeout for flaky test 2026-01-06 16:56:54 -08:00
YutaSaito
c6b1e0512f
Merge pull request #18726 from gkarthi-signoz/main 
[Docs]: Adding SigNoz integration to observability docs
 2026-01-07 09:47:18 +09:00
yuneng-jiang
874e8d1a6e Fixing build 2026-01-06 16:33:08 -08:00
Goutham Karthi
2865b17988 adding signoz integration to observability docs 2026-01-06 15:29:44 -08:00
Alexsander Hamir
bb4c01ffa0
Add LITELLM_DISABLE_LAZY_LOADING env var to fix VCR cassette creation issue (#18725) 2026-01-06 14:49:11 -08:00
Otavio Brito
18ca6b2add
Handle not supported region for vertex ai count tokens - v1/messages/count_tokens (#18665) 
* Handle not supported region for vertex ai count tokens

* add unit test
 2026-01-07 00:05:00 +05:30
Lundin Matthews
762345172c
Add LlamaGate as a new provider (#18673) 
Adds LlamaGate (https://llamagate.dev) as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 17 models across categories:
  - General purpose (Llama 3.1/3.2, Mistral, Qwen, Dolphin)
  - Reasoning (DeepSeek R1, OpenThinker)
  - Code (Qwen Coder, DeepSeek Coder, CodeLlama)
  - Vision (Qwen VL, LLaVA, Gemma 3)
  - Embeddings (Nomic, Qwen3 Embedding)

Provider details:
- Base URL: https://api.llamagate.dev/v1
- Auth: Bearer token via LLAMAGATE_API_KEY
- Pricing: $0.02-$0.55 per 1M tokens
- All models are open-weights
 2026-01-07 00:00:30 +05:30
Lize Cai
fe9b05e23e
Add header for SAP AI Core Tracking (#18714) 
Signed-off-by: Lize Cai <lize.cai@sap.com>
 2026-01-06 23:59:02 +05:30
Rohit Ravikant Rane
a7c39ccc12
fix(router): correct num_retries tracking in retry logic (#18712) 
* fix(router): correct num_retries tracking in retry logic

- Fix off-by-one error in num_retries attribute when retries exhausted
- Correct remaining_retries calculation
- Add comprehensive tests for retry tracking edge cases

Fixes incorrect retry count in error messages and logging

* chore: trigger CI re-run

* chore: trigger CI tests again
 2026-01-06 23:58:41 +05:30
Kazuki Matsumaru
26bdf7b7a8
Remove redundant comments about setting litellm.callbacks (#18711) 
- Removed duplicate comment in test_router_endpoints.py
- Removed duplicate comment in logging.md
- Kept clearer comment: 'Set litellm.callbacks = [proxy_handler_instance] on the proxy'
 2026-01-06 23:58:01 +05:30
Isaac Reis
a17757159c
add amazon.nova-2-multimodal-embeddings-v1:0 to model_prices_and_context_window.json (#18710) 2026-01-06 23:57:35 +05:30
Pascal Bro
cac2a8d158
Fix/gcs cache docs missing for proxy mode (#13328) 
* fixed issues with gcs cache to verify functionality

* restore changes

* Fix capitalization of 'S3 Bucket Cache'

---------

Co-authored-by: Nelson Alfonso <45660392+Dashing-Nelson@users.noreply.github.com>
 2026-01-06 23:49:08 +05:30
Kris Xia
5e00a49e7f
fix(streaming): normalize status code extraction to prevent 4xx errors from triggering mid-stream fallback (#18698) 
在流式处理错误时，添加状态码标准化逻辑，确保 4xx 客户端错误直接抛出而不是被包装成 MidStreamFallbackError。

- 新增 _normalize_status_code 函数用于从异常对象提取状态码
- 优先从异常的 status_code 属性获取，其次从 response.status_code 获取
- 当映射异常或原始异常的状态码在 400-499 范围内时，直接抛出映射异常
- 添加单元测试验证 Vertex AI 400 错误正确抛出为 BadRequestError
- 确保流式处理中的客户端错误能够正确传播，而不会触发回退机制
 2026-01-06 23:41:23 +05:30
Ishaan Jaff
69aa111fdd
[UI] - Feat add request provider form on UI (#18704) 
* add request provider form

* fix link to github

* add button

* fix link
 2026-01-06 18:54:57 +05:30
Sameer Kankute
ce0f71fbe9
Merge pull request #18706 from BerriAI/litellm_fix_reasoning_summary_default 
[Bug] fix model map
 2026-01-06 18:31:33 +05:30
Sameer Kankute
0cd92e895f fix model map 2026-01-06 18:14:00 +05:30
Sameer Kankute
e3cbd5ff56
Merge pull request #18705 from BerriAI/litellm_fix_reasoning_summary_default 
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
 2026-01-06 18:05:55 +05:30
Sameer Kankute
1c177a576b Add the LITELLM_REASONING_AUTO_SUMMARY in doc 2026-01-06 18:04:09 +05:30
Sameer Kankute
353769d2ac
Merge pull request #18688 from BerriAI/litellm_fix_reasoning_summary_default 
[Fix] Put automatic reasoning summary inclusion behind feat flag
 2026-01-06 17:56:40 +05:30
Sameer Kankute
aca656f036
Merge pull request #18702 from BerriAI/litellm_fix_mapped_test_3 
fix: remove display name
 2026-01-06 16:35:24 +05:30
Sameer Kankute
ffc462465d fix: remove display name 2026-01-06 16:31:07 +05:30
Ishaan Jaff
76eda472be
[Feat] New API Endpoint - Responses API (v1/responses/compact) (#18697) 
* init transform_compact_response_api_request

* init acompact_responses

* init async_compact_response_api_handler in llm http handler

* init transform_compact_response_api_request for openai

* init acompact_responses

* fix acompact_responses

* add OAI Compact API

* docs responses API Compact

* code qa checks

* test_openai_compact_responses_api

* fix mypy linting
 2026-01-06 16:24:04 +05:30