scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 100
29199 commits 2338 branches 1407 tags 2.6 GiB
Commit graph

29199 commits

This branch
This branch
All branches
Author SHA1 Message Date
Xianzong Xie
56cbdde64d remove file 2025-12-04 17:53:51 -08:00
Xianzong Xie
a8a38778a3 fix: resolve provider from router for polling_via_cache 
- Fix bug where model names without slash (e.g., 'gpt-5') couldn't
  match providers in polling_via_cache list
- Look up model in llm_router.model_name_to_deployment_indices
- Check ALL deployments for matching provider (supports load balancing)
- Check custom_llm_provider first, then extract from model string
- Add comprehensive tests for provider resolution logic

Committed-By-Agent: cursor
 2025-12-04 17:47:30 -08:00
Ishaan Jaff
fadfbb13d3
[Docs] A2a - Permission management (#17515) 
* docs add a2a gateway + mcp gateway

* docs a2a permissions

* docs a2a permission

* docs

* docs a2a

* docs a2a

* add new img

* docs agent permissions
 2025-12-04 17:29:47 -08:00
yuneng-jiang
de8f0a3409 Ensure fresh data to prevent race condition in scim v2 2025-12-04 17:04:59 -08:00
Ishaan Jaffer
dfe3124335 UI new build 2025-12-04 16:34:59 -08:00
Ishaan Jaffer
5cc1a5031b fix invoke_agent_a2a 2025-12-04 16:32:15 -08:00
Ishaan Jaff
575e769bff
[Feat] UI - Agent Gateway - set allowed agents by key, team (#17511) 
* init schema.prisma

* init LiteLLM_ObjectPermissionTable with agents and agent_access_groups

* TestAgentRequestHandler

* refatctor agent list

* add AgentRequestHandler

* fix agent access controls by key/team

* feat - new migration for LiteLLM_AgentsTable

* fix add LiteLLM_ObjectPermissionBase with agent and agent groups

* add agent routes to llm api routes

* add agent routes as llm route

* add AgentPermissionsProps

* add agents on team/key create

* add agent selector on team/key

* add agent selector on key edit /info

* add AgentPermissions

* docs list + invoke agents
 2025-12-04 16:31:17 -08:00
Ishaan Jaff
8f592088ed
[Feat] Agent Access Control - Enforce Allowed agents by key, team + add agent access groups on backend (#17502) 
* init schema.prisma

* init LiteLLM_ObjectPermissionTable with agents and agent_access_groups

* TestAgentRequestHandler

* refatctor agent list

* add AgentRequestHandler

* fix agent access controls by key/team

* feat - new migration for LiteLLM_AgentsTable

* fix add LiteLLM_ObjectPermissionBase with agent and agent groups

* add agent routes to llm api routes

* add agent routes as llm route
 2025-12-04 16:31:00 -08:00
yuneng-jiang
5a2e89a49e Customer Usage UI 2025-12-04 15:13:17 -08:00
Ishaan Jaff
e3116da653
feat: Add /global/spend/tags to admin viewer routes (#17501) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
 2025-12-04 14:43:33 -08:00
Ishaan Jaffer
c6e26a20b1 refactor invoke 2025-12-04 14:21:01 -08:00
Raghav Jhavar
72eb4c3a1c
🆕 feat: support routing to only websearch supported deployments (#17500) 
* support routing to only websearch supported deployments

* add docs
 2025-12-04 14:18:20 -08:00
Xianzong Xie
748bb6d5f5 test: add tests for all ResponsesAPIResponse fields 
- Add test_update_state_with_all_responses_api_fields to verify all fields
- Add test_update_state_preserves_existing_fields to verify partial updates

Committed-By-Agent: cursor
 2025-12-04 14:15:06 -08:00
Anas AbdelR
2abcc77944
fix: resolve ruff lint errors (#17490) 
Fixed 20 of 22 lint errors:

- batches/batch_utils.py: Added missing model_name parameter to functions
- integrations/custom_guardrail.py: Removed unused Tuple import
- llms/custom_httpx/http_handler.py: Removed unused AIOHTTP_NEEDS_CLEANUP_CLOSED import
- llms/anthropic/chat/guardrail_translation/handler.py: Prefixed unused variable with underscore
- llms/openai/responses/guardrail_translation/handler.py: Removed duplicate BaseModel import, prefixed unused variable
- llms/pass_through/guardrail_translation/handler.py: Prefixed unused variables with underscore
- proxy/guardrails/guardrail_hooks/generic_guardrail_api/generic_guardrail_api.py: Removed unused List and Tuple imports
- proxy/hooks/parallel_request_limiter_v3.py: Removed unused import

Remaining 2 errors are PLR0915 (too many statements) which require refactoring.
 2025-12-04 14:12:57 -08:00
Xianzong Xie
9a0a37fffa feat: extract all ResponsesAPIResponse fields from response.completed 
- Add support for all ResponsesAPIResponse fields in update_state
- Extract model, instructions, temperature, top_p, max_output_tokens,
  previous_response_id, text, truncation, parallel_tool_calls, user,
  store, and incomplete_details from response.completed event
- Pass all fields to final update_state call

Committed-By-Agent: cursor
 2025-12-04 14:11:13 -08:00
Yannay Hammer
2627f0d519
Fix aim security guardrail tests (#17499) 2025-12-04 13:29:20 -08:00
yuneng-jiang
b12ccb1a7a Publish proxy extras 2025-12-04 13:11:20 -08:00
yuneng-jiang
1834377950 Adding migration 2025-12-04 12:57:06 -08:00
yuneng-jiang
5439f03bfc bump: version 0.4.9 → 0.4.10 2025-12-04 12:56:43 -08:00
yuneng-jiang
2e65c464ad Adding tests 2025-12-04 12:36:15 -08:00
yuneng-jiang
562afb208d v0 customer usage, pending tests + extras version bump 2025-12-04 12:30:08 -08:00
Krrish Dholakia
5aeba81538 docs(multi_tenant_architecture.md): add new architecture doc 2025-12-04 11:13:50 -08:00
Ishaan Jaff
8ee8cad4f1
feat - new model amazon.titan-image-generator-v2:0 (#17488) 2025-12-04 09:26:55 -08:00
Sameer Kankute
31f1bf0539
Merge pull request #17485 from BerriAI/litellm_ragflow_test_fix 
fix: test_default_api_base for ragfow
 2025-12-04 21:57:18 +05:30
Sameer Kankute
f2c0029939
Merge pull request #17470 from BerriAI/litellm_batches_bedrock_content 
Add support for file content download for bedrock batches
 2025-12-04 21:57:04 +05:30
Sameer Kankute
5b4542304d
Merge pull request #17461 from BerriAI/litellm_qwen2_imported_model_support 
Add support for bedrock qwen 2 imported model
 2025-12-04 21:56:22 +05:30
Sameer Kankute
1bd4050921
Merge pull request #17458 from BerriAI/litellm_map_output_tokens_details 
Map output_tokens_details of responses API to completion_tokens_details
 2025-12-04 21:55:21 +05:30
Sameer Kankute
6751badf3a fix: test_default_api_base for ragfow 2025-12-04 21:49:33 +05:30
Sameer Kankute
46ebf425d5 Fix : test_vertexai_model_garden_model_completion 2025-12-04 21:41:02 +05:30
Sameer Kankute
edd392b50d Add support for file content download for bedrock batches 2025-12-04 13:27:53 +05:30
yuneng-jiang
94b944e8ec
Merge pull request #17465 from BerriAI/litellm_ui_model_page_perf_2 
[Infra] UI - Change Credentials to use React Query
 2025-12-03 23:53:40 -08:00
yuneng-jiang
ad86dfbf7d
Merge pull request #17451 from BerriAI/litellm_new_login_page_sso_changes 
[Feature] Add Auto Redirect to SSO to New Login Page
 2025-12-03 23:53:21 -08:00
yuneng-jiang
5496e622c1 Unit tests 2025-12-03 23:46:09 -08:00
yuneng-jiang
59b32c28a8 Change selector in test 2025-12-03 23:37:15 -08:00
yuneng-jiang
0483336c53 change test to follow other logins 2025-12-03 23:21:09 -08:00
yuneng-jiang
19dc5d750c Adding waits 2025-12-03 23:10:32 -08:00
Xianzong Xie
1c3c12bb1b refactor: move background_streaming_task to separate module 
- Create new background_streaming.py in response_polling/
- Update endpoints.py to import from new location
- Update __init__.py to export background_streaming_task
- Add tests for module imports and structure

Committed-By-Agent: cursor
 2025-12-03 22:50:26 -08:00
yuneng-jiang
45a9723467 view_user_info debugging 2025-12-03 22:20:04 -08:00
yuneng-jiang
b8190c6b6d resolving build issues 2025-12-03 22:15:19 -08:00
yuneng-jiang
7519a3e30b Change credentials to use react-query 2025-12-03 22:08:41 -08:00
Krish Dholakia
dc7c2b9b05
Update docs to link agent hub (#17462) 
* Docs: Add AI Hub agent registry documentation

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Update AI Hub link in A2A documentation

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-12-03 21:59:45 -08:00
Xianzong Xie
c464af4c15 chore: add noqa for PLR0915 in _background_streaming_task 
Committed-By-Agent: cursor
 2025-12-03 21:57:56 -08:00
yuneng-jiang
c634c08818 Find inputs by placeholder 2025-12-03 21:51:45 -08:00
Xianzong Xie
2c252c9e92 chore: remove unused asyncio import from polling_handler 
Committed-By-Agent: cursor
 2025-12-03 21:42:02 -08:00
Xianzong Xie
901252fb78 chore: remove unused imports and variables 
- Remove unused typing imports (Any, Dict)
- Remove unused output_index variable
- Fix comment to reflect actual key structure (item_id, content_index)

Committed-By-Agent: cursor
 2025-12-03 21:39:49 -08:00
Sameer Kankute
4710e772be Add support for bedrock qwen 2 imported model 2025-12-04 11:08:57 +05:30
Daniel Klein
3134fc825b
fix: make bedrock converse messages respect modify_params as expected (#17427) 2025-12-03 21:34:50 -08:00
Cesar Garcia
664b384dce
fix(pricing): add missing Moonshot turbo models and fix incorrect pricing (#17432) 
Fixes #17417

- Add moonshot/kimi-k2-turbo-preview ($1.15/$8.00 input/output)
- Add moonshot/kimi-k2-thinking-turbo ($1.15/$8.00 input/output)
- Add moonshot/kimi-k2-0905-preview ($0.60/$2.50 input/output, 262K context)
- Fix moonshot/kimi-thinking-preview pricing ($30/$30 -> $0.60/$2.50)
- Fix wandb/moonshotai/Kimi-K2-Instruct absurd pricing ($135K/$400K -> $0.60/$2.50)
 2025-12-03 21:31:49 -08:00
Cesar Garcia
b05f6d3cfd
fix(groq): check supports_response_schema before using json_tool_call workaround (#17438) 
Fixes issue where LiteLLM used the json_tool_call workaround for all Groq
models, even those that support native json_schema (e.g., gpt-oss-120b,
llama-4, kimi-k2). This caused errors when users passed their own tools
alongside structured outputs.

Changes:
- Check `supports_response_schema()` before using the workaround
- Only use json_tool_call workaround for models without native support
- Add clear error message when using workaround with user-provided tools
- Update model config to set `supports_response_schema: false` for models
  that don't support native json_schema
- Add unit tests for structured output handling
 2025-12-03 21:31:13 -08:00
Cesar Garcia
6d831ffff4
fix(ocr): add missing ocr and aocr to CallTypes enum (#17435) 
Add `ocr` and `aocr` entries to the CallTypes enum to fix the
ValueError that occurs when using the /v1/ocr endpoint with
guardrails enabled.

The OCR endpoint uses route_type="aocr", but the CallTypes enum
was missing these values, causing guardrail hooks to fail when
trying to instantiate CallTypes("aocr").

Fixes #17381
 2025-12-03 21:28:13 -08:00