Commit graph

26388 commits

Author SHA1 Message Date
Achintya Rajan
264f1cded1
Merge branch 'main' into litellm_view_key_pagination_calls_fix 2025-10-06 18:10:57 -07:00
Krrish Dholakia
5336fcc000 fix(azure/responses): always remove status
unsupported parameter
2025-10-06 18:08:57 -07:00
=
ee00490c24 Update package.json 2025-10-06 18:05:48 -07:00
Achintya Rajan
19f0c498e5 Update general_settings.tsx 2025-10-06 17:52:13 -07:00
Krrish Dholakia
fbf7ca17ba docs(security_encryption_faq.md): answers common questions about data at rest vs. in transit 2025-10-06 17:34:10 -07:00
Ishaan Jaff
4c9bd3e0de
[MCP Gateway] UI - Select allowed tools for Key, Teams (#15241)
* fix: MCPServerSelectorProps

* Tool Permissions

* Teams: tool permissions

* Add MCP team level permissions

* fix MCP tool permissions

* allow selecting MCP tools for Keys, teams

* fix: add mcp tool level permissions by key, team

* MCP Tool permissions test
2025-10-06 14:37:43 -07:00
Achintya Rajan
b1f3553ae4 Update networking.tsx 2025-10-06 14:28:12 -07:00
Achintya Rajan
00f61b214c more window guards 2025-10-06 14:17:02 -07:00
Achintya Rajan
cee408c0c0 diagnosing next build issue 2025-10-06 14:03:53 -07:00
Krrish Dholakia
6f671d2bea feat(llm_passthrough_endpoints.py): working streaming on azure passthrough via router 2025-10-06 13:56:30 -07:00
Krrish Dholakia
d7aab1d5de test: add unit tests 2025-10-06 13:53:36 -07:00
Krrish Dholakia
6177b23ebf feat(azure/passthrough): working azure passthrough with router models for openai calls
Fixes issue where azure passthrough could not work with workload identity + litellm model name
2025-10-06 13:44:10 -07:00
Krrish Dholakia
7a61526b7b feat(azure/): partially working passthrough flow via router
allows azure passthrough to work for litellm models
2025-10-06 13:35:00 -07:00
Achintya Rajan
f4d9e4869a renamed (console), added use clients 2025-10-06 13:33:38 -07:00
Ishaan Jaffer
a56069b722 UI: new build 2025-10-06 13:16:52 -07:00
Sameer Kankute
cd25782359
fix passing headers for gemini (#15231) 2025-10-06 12:59:19 -07:00
Achintya Rajan
715c4999a2 global feature flag state for app 2025-10-06 12:57:16 -07:00
Krrish Dholakia
6f2b753a5d feat(llm_passthrough_endpoints.py): add router model support on azure passthrough 2025-10-06 12:51:41 -07:00
Gal Bloch
27c64c90dc
feat: Add 25 new Watson X foundation models (#15219)
Added comprehensive Watson X model support including:
- IBM Granite models (granite-4-h-small, granite-3-3-8b-instruct, granite-guardian variants, granite-vision, granite-ttm time series models)
- Meta Llama models (llama-3-2-1b/3b/11b-vision/90b-vision, llama-3-3-70b, llama-4-maverick-17b, llama-guard-3-11b-vision)
- Mistral models (mistral-medium-2505, mistral-small-2503, pixtral-12b-2409)
- Additional models (BigScience mt0-xxl-13b, Google flan-t5-xl-3b, OpenAI gpt-oss-120b, SDAIA allam-1-13b-instruct, Core42 jais-13b-chat)

All models include proper pricing, token limits, and capability flags (function calling, vision support, etc.) based on IBM Watson X documentation.
2025-10-06 12:33:05 -07:00
=
53ee3e2634 refactoredUI feature flag 2025-10-06 10:43:42 -07:00
=
3f53d6b7ad Moved KeyInfoView to refactored folder, added deprecation notice 2025-10-06 10:43:34 -07:00
Achintya Rajan
03804cb1d2 preliminary virtual-keys refactor
simplifies handleCreate function for CreateKeyModal

moved hooks, components, files where I want them

moved virtual-key page to (console) for common layout

added layout for refactored console file structure, sidebar

wired teams to refactored components

fixing type issue

wired new top level hook useAuthorized

Adds routing to unrefactored pages

Update leftnav.tsx

Update useAuthorized.ts

useAuthorized in virtual-keys/page and deprecation notices

prelim VirtualKeyViewPage, removed old comment

Delete page.tsx
2025-10-06 10:43:26 -07:00
Alexsander Hamir
ddb90c9ad7
[Fix] - Router: add model_name index for O(1) deployment lookups (#15113)
* perf(router): add model_name index for O(1) deployment lookups

Add model_name_to_deployment_indices mapping to optimize _get_all_deployments()
from O(n) to O(1) + O(k) lookups.

- Add model_name_to_deployment_indices: Dict[str, List[int]]
- Add _build_model_name_index() to build/maintain the index
- Update _add_model_to_list_and_index_map() to maintain both indices
- Refactor to use idx = len(self.model_list) before append (cleaner)
- Optimize _get_all_deployments() to use index instead of linear scan

* test(router): add test coverage for _build_model_name_index

Add single comprehensive test for _build_model_name_index() function to fix
code coverage CI failure.

The test verifies:
- Index correctly maps model_name to deployment indices
- Handles multiple deployments per model_name
- Clears and rebuilds index correctly

Fixes: CI code coverage error for _build_model_name_index
2025-10-06 08:14:11 -07:00
Otavio Brito
b2a734c1f8 fix ttl tests 2025-10-06 09:30:23 -03:00
Krish Dholakia
9383ffccd6
Merge pull request #15221 from jatorre/feat/snowflake-tools-clean
feat(snowflake): add function calling support for Snowflake Cortex REST API
2025-10-05 22:20:44 -07:00
Krish Dholakia
30d24fa44c
Merge pull request #15215 from ARajan1084/prettier-support
Added prettier to autoformat frontend
2025-10-05 22:02:37 -07:00
Otavio Brito
251d56ba5e update docs 2025-10-05 23:47:24 -03:00
Otavio Brito
80edf70206 fix import 2025-10-05 20:59:51 -03:00
Otavio Brito
acf8ec5b3c add context caching support for vertex ai 2025-10-05 20:55:18 -03:00
Javier de la Torre
df232a71f1 feat(snowflake): add function calling support for Snowflake Cortex REST API
Add support for function calling (tools) with Snowflake Cortex models that support it (e.g., Claude 3.5 Sonnet).

Changes:
- Add 'tools' and 'tool_choice' to supported OpenAI parameters
- Implement request transformation: OpenAI function format → Snowflake tool_spec format
- Implement response transformation: Snowflake content_list with tool_use → OpenAI tool_calls
- Add tool_choice transformation: OpenAI nested format → Snowflake array format

Request transformation:
- Transform tools from nested {"type": "function", "function": {...}} to Snowflake's {"tool_spec": {"type": "generic", "name": "...", "input_schema": {...}}}
- Transform tool_choice from {"type": "function", "function": {"name": "..."}} to {"type": "tool", "name": ["..."]}

Response transformation:
- Parse Snowflake's content_list array containing tool_use objects
- Extract tool calls with tool_use_id, name, and input
- Convert to OpenAI's tool_calls format with proper JSON serialization

Testing:
- Add 7 unit tests covering request/response transformations
- Add integration test for Responses API with tool calling
- All tests passing

Fixes issue #15218

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-05 13:08:33 +02:00
Ishaan Jaffer
b348a26bdc docs fix 2025-10-04 18:32:45 -07:00
Ishaan Jaffer
b2dd50dd3e docs key rotations 2025-10-04 18:29:01 -07:00
=
5197268a58 added and ran prettier autoformatter 2025-10-04 18:19:48 -07:00
Ishaan Jaffer
e58c2c5c3e docs fix 2025-10-04 18:13:08 -07:00
Ishaan Jaffer
163416c683 docs fix 2025-10-04 18:12:47 -07:00
Ishaan Jaffer
6cf1806d3b docs fix 2025-10-04 18:12:20 -07:00
Ishaan Jaffer
bd2559e65e docs fix 2025-10-04 18:11:58 -07:00
Ishaan Jaffer
525b86687c fix 1.77.7 stable 2025-10-04 18:11:01 -07:00
Ishaan Jaffer
4e88e21266 docs fix 2025-10-04 18:04:11 -07:00
Ishaan Jaffer
93022361e6 docs fix 2025-10-04 18:03:04 -07:00
Ishaan Jaffer
d12da2e56e docs fix 2025-10-04 18:02:04 -07:00
Alexsander Hamir
9d6c06dc7a
doc: perf update (#15211) 2025-10-04 17:59:08 -07:00
Ishaan Jaffer
02cb7a4c3b docs fix 2025-10-04 17:29:06 -07:00
Yuta Saito
ba0dcfc001 feat: add Global Cross-Region Sonnet 4 2025-10-05 09:25:39 +09:00
Ishaan Jaffer
8c495590b1 doc improvement 2025-10-04 17:21:41 -07:00
Ishaan Jaffer
553801c7b4 docs 2025-10-04 17:21:00 -07:00
Yuta Saito
9a1c0145da feat: add Global Cross-Region Inference 2025-10-05 09:20:17 +09:00
Krrish Dholakia
b7ca138a8d docs(prometheus.md): fix 2025-10-04 16:23:54 -07:00
Krrish Dholakia
98d709d351 fix(key_management_endpoints.py): retain error check when non proxy admin is trying to update key belonging to a different user 2025-10-04 16:22:35 -07:00
Ishaan Jaffer
97e00f694c fix azure assistants test 2025-10-04 16:18:14 -07:00