Commit graph

26247 commits

Author SHA1 Message Date
Krish Dholakia
6bb34e5168
Merge pull request #15252 from BerriAI/litellm_view_key_pagination_calls_fix
(perf) fix: Replaces bloated key list calls with lean key aliases endpoint
2025-10-06 19:51:26 -07:00
Krish Dholakia
3f6717bfd8
Merge pull request #15250 from BerriAI/litellm_next_turbopack_for_dev
Adds turbopack to the npm run dev command in UI to build faster during development
2025-10-06 19:50:41 -07:00
Teddy Amkie
1ad4ef267d
Add GPT-5 Pro model configuration and documentation (#15258)
- Added gpt-5-pro entry to model_prices_and_context_window.json with complete specifications
- Mode: responses (Responses API only)
- Pricing: $15.00 input / $120.00 output (Standard), $7.50 input / $60.00 output (Batch)
- Context: 400,000 input tokens, 272,000 output tokens
- Endpoints: /v1/batch, /v1/responses only
- Features: Web Search, Function Calling, Vision, PDF Input, Prompt Caching, Reasoning
- No streaming support, no Code Interpreter, no Computer Use

- Added gpt-5-pro to supported models list in docs/my-website/src/pages/completion/supported.md
- Added gpt-5-pro to OpenAI provider documentation in docs/my-website/docs/providers/openai.md
- Added comprehensive GPT-5 Pro Special Notes section with usage examples and limitations
2025-10-06 19:43:40 -07:00
Achintya Rajan
eed19fb4ab slight improvement for Sidebar2 2025-10-06 19:36:40 -07:00
Ishaan Jaff
1d468a59f3
[MCP Gateway] Fine-grained Database Object Storage Control (#15255)
* add supported_db_objects

* add _should_load_db_object

* add docs on storing MCP objects in DB

* test_should_load_db_object_with_supported_db_objects

* type fix
2025-10-06 19:31:44 -07:00
Achintya Rajan
6529ed4d62 hidden dashboard routing, dev and build env files 2025-10-06 19:21:34 -07:00
Ishaan Jaff
930f88078e
[MCP Gateway] Backend - Allow storing allowed tools by team/key (#15243)
* add mcp_tool_permissions column to LiteLLM_ObjectPermissionTable

* add mcp_tool_permissions

* add LiteLLM_ObjectPermissionTable

* test key/team mgmt

* fix code QA check

* fix check_tool_permission_for_key_team

* test_key_tool_permission_allows_permitted_tool

* test_list_tools_filters_by_key_team_permissions

* fix _get_tools_from_mcp_servers

* fix logger.debug

* fix check_tool_permission_for_key_team

* fix: filter_tools_by_key_team_permissions

* fix _get_team_object_permission

* fix _set_object_permission

* fix handle_update_object_permission_common

* fix add allowed tools to keys

* test add key/team level tool permissions for MCPs
2025-10-06 18:49:32 -07:00
Krrish Dholakia
7f88a3f9c6 fix(mcp/): add ssl certificate settings for mcp clients
respect ca bundle path for mcp calls
2025-10-06 18:36:05 -07:00
Alexsander Hamir
9aa2dc2e8e
[Refactor] Utils: extract inner function from client (#15234)
* fix: remove func definition from inside client

It makes the function bigger and harder to understand, I left just the wrappers.

* fix: test_arouter_test_team_model failure

- Added fallback to the model_name to index functionality.
2025-10-06 18:30:01 -07:00
Achintya Rajan
264f1cded1
Merge branch 'main' into litellm_view_key_pagination_calls_fix 2025-10-06 18:10:57 -07:00
Krrish Dholakia
5336fcc000 fix(azure/responses): always remove status
unsupported parameter
2025-10-06 18:08:57 -07:00
=
ee00490c24 Update package.json 2025-10-06 18:05:48 -07:00
Achintya Rajan
19f0c498e5 Update general_settings.tsx 2025-10-06 17:52:13 -07:00
Krrish Dholakia
fbf7ca17ba docs(security_encryption_faq.md): answers common questions about data at rest vs. in transit 2025-10-06 17:34:10 -07:00
Ishaan Jaff
4c9bd3e0de
[MCP Gateway] UI - Select allowed tools for Key, Teams (#15241)
* fix: MCPServerSelectorProps

* Tool Permissions

* Teams: tool permissions

* Add MCP team level permissions

* fix MCP tool permissions

* allow selecting MCP tools for Keys, teams

* fix: add mcp tool level permissions by key, team

* MCP Tool permissions test
2025-10-06 14:37:43 -07:00
Achintya Rajan
b1f3553ae4 Update networking.tsx 2025-10-06 14:28:12 -07:00
Achintya Rajan
00f61b214c more window guards 2025-10-06 14:17:02 -07:00
Achintya Rajan
cee408c0c0 diagnosing next build issue 2025-10-06 14:03:53 -07:00
Krrish Dholakia
6f671d2bea feat(llm_passthrough_endpoints.py): working streaming on azure passthrough via router 2025-10-06 13:56:30 -07:00
Krrish Dholakia
d7aab1d5de test: add unit tests 2025-10-06 13:53:36 -07:00
Krrish Dholakia
6177b23ebf feat(azure/passthrough): working azure passthrough with router models for openai calls
Fixes issue where azure passthrough could not work with workload identity + litellm model name
2025-10-06 13:44:10 -07:00
Krrish Dholakia
7a61526b7b feat(azure/): partially working passthrough flow via router
allows azure passthrough to work for litellm models
2025-10-06 13:35:00 -07:00
Achintya Rajan
f4d9e4869a renamed (console), added use clients 2025-10-06 13:33:38 -07:00
Ishaan Jaffer
a56069b722 UI: new build 2025-10-06 13:16:52 -07:00
Sameer Kankute
cd25782359
fix passing headers for gemini (#15231) 2025-10-06 12:59:19 -07:00
Achintya Rajan
715c4999a2 global feature flag state for app 2025-10-06 12:57:16 -07:00
Krrish Dholakia
6f2b753a5d feat(llm_passthrough_endpoints.py): add router model support on azure passthrough 2025-10-06 12:51:41 -07:00
Gal Bloch
27c64c90dc
feat: Add 25 new Watson X foundation models (#15219)
Added comprehensive Watson X model support including:
- IBM Granite models (granite-4-h-small, granite-3-3-8b-instruct, granite-guardian variants, granite-vision, granite-ttm time series models)
- Meta Llama models (llama-3-2-1b/3b/11b-vision/90b-vision, llama-3-3-70b, llama-4-maverick-17b, llama-guard-3-11b-vision)
- Mistral models (mistral-medium-2505, mistral-small-2503, pixtral-12b-2409)
- Additional models (BigScience mt0-xxl-13b, Google flan-t5-xl-3b, OpenAI gpt-oss-120b, SDAIA allam-1-13b-instruct, Core42 jais-13b-chat)

All models include proper pricing, token limits, and capability flags (function calling, vision support, etc.) based on IBM Watson X documentation.
2025-10-06 12:33:05 -07:00
=
53ee3e2634 refactoredUI feature flag 2025-10-06 10:43:42 -07:00
=
3f53d6b7ad Moved KeyInfoView to refactored folder, added deprecation notice 2025-10-06 10:43:34 -07:00
Achintya Rajan
03804cb1d2 preliminary virtual-keys refactor
simplifies handleCreate function for CreateKeyModal

moved hooks, components, files where I want them

moved virtual-key page to (console) for common layout

added layout for refactored console file structure, sidebar

wired teams to refactored components

fixing type issue

wired new top level hook useAuthorized

Adds routing to unrefactored pages

Update leftnav.tsx

Update useAuthorized.ts

useAuthorized in virtual-keys/page and deprecation notices

prelim VirtualKeyViewPage, removed old comment

Delete page.tsx
2025-10-06 10:43:26 -07:00
Alexsander Hamir
ddb90c9ad7
[Fix] - Router: add model_name index for O(1) deployment lookups (#15113)
* perf(router): add model_name index for O(1) deployment lookups

Add model_name_to_deployment_indices mapping to optimize _get_all_deployments()
from O(n) to O(1) + O(k) lookups.

- Add model_name_to_deployment_indices: Dict[str, List[int]]
- Add _build_model_name_index() to build/maintain the index
- Update _add_model_to_list_and_index_map() to maintain both indices
- Refactor to use idx = len(self.model_list) before append (cleaner)
- Optimize _get_all_deployments() to use index instead of linear scan

* test(router): add test coverage for _build_model_name_index

Add single comprehensive test for _build_model_name_index() function to fix
code coverage CI failure.

The test verifies:
- Index correctly maps model_name to deployment indices
- Handles multiple deployments per model_name
- Clears and rebuilds index correctly

Fixes: CI code coverage error for _build_model_name_index
2025-10-06 08:14:11 -07:00
Otavio Brito
b2a734c1f8 fix ttl tests 2025-10-06 09:30:23 -03:00
Krish Dholakia
9383ffccd6
Merge pull request #15221 from jatorre/feat/snowflake-tools-clean
feat(snowflake): add function calling support for Snowflake Cortex REST API
2025-10-05 22:20:44 -07:00
Krish Dholakia
30d24fa44c
Merge pull request #15215 from ARajan1084/prettier-support
Added prettier to autoformat frontend
2025-10-05 22:02:37 -07:00
Otavio Brito
251d56ba5e update docs 2025-10-05 23:47:24 -03:00
Otavio Brito
80edf70206 fix import 2025-10-05 20:59:51 -03:00
Otavio Brito
acf8ec5b3c add context caching support for vertex ai 2025-10-05 20:55:18 -03:00
Javier de la Torre
df232a71f1 feat(snowflake): add function calling support for Snowflake Cortex REST API
Add support for function calling (tools) with Snowflake Cortex models that support it (e.g., Claude 3.5 Sonnet).

Changes:
- Add 'tools' and 'tool_choice' to supported OpenAI parameters
- Implement request transformation: OpenAI function format → Snowflake tool_spec format
- Implement response transformation: Snowflake content_list with tool_use → OpenAI tool_calls
- Add tool_choice transformation: OpenAI nested format → Snowflake array format

Request transformation:
- Transform tools from nested {"type": "function", "function": {...}} to Snowflake's {"tool_spec": {"type": "generic", "name": "...", "input_schema": {...}}}
- Transform tool_choice from {"type": "function", "function": {"name": "..."}} to {"type": "tool", "name": ["..."]}

Response transformation:
- Parse Snowflake's content_list array containing tool_use objects
- Extract tool calls with tool_use_id, name, and input
- Convert to OpenAI's tool_calls format with proper JSON serialization

Testing:
- Add 7 unit tests covering request/response transformations
- Add integration test for Responses API with tool calling
- All tests passing

Fixes issue #15218

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-05 13:08:33 +02:00
Ishaan Jaffer
b348a26bdc docs fix 2025-10-04 18:32:45 -07:00
Ishaan Jaffer
b2dd50dd3e docs key rotations 2025-10-04 18:29:01 -07:00
=
5197268a58 added and ran prettier autoformatter 2025-10-04 18:19:48 -07:00
Ishaan Jaffer
e58c2c5c3e docs fix 2025-10-04 18:13:08 -07:00
Ishaan Jaffer
163416c683 docs fix 2025-10-04 18:12:47 -07:00
Ishaan Jaffer
6cf1806d3b docs fix 2025-10-04 18:12:20 -07:00
Ishaan Jaffer
bd2559e65e docs fix 2025-10-04 18:11:58 -07:00
Ishaan Jaffer
525b86687c fix 1.77.7 stable 2025-10-04 18:11:01 -07:00
Ishaan Jaffer
4e88e21266 docs fix 2025-10-04 18:04:11 -07:00
Ishaan Jaffer
93022361e6 docs fix 2025-10-04 18:03:04 -07:00
Ishaan Jaffer
d12da2e56e docs fix 2025-10-04 18:02:04 -07:00