Commit graph

4703 commits

Author SHA1 Message Date
Ishaan Jaffer
4621a23a89 add litellm logo jpg 2025-11-07 15:36:49 -08:00
yuneng-jiang
5fb0940b9b
[Feature] UI - Surface SSO Create errors on create flow (#16369)
* Surface backend SSO issues on create SSO flow

* Remove unused import

* Fix flaky test
2025-11-07 14:44:50 -08:00
yuneng-jiang
99a8a304c1
[Fix] UI - Revert Changes for Test Key Multiple Model Select (#16372)
* Revert "Initial changes for supporting prompts to multiple models"

This reverts commit 0d8dee4401.

* Add test for the single model select
2025-11-07 13:39:17 -08:00
yuneng-jiang
92bc7db594
Remove encoding_format in api calls for test key embedding models (#16367) 2025-11-07 10:58:30 -08:00
yuneng-jiang
0a90283fec
Change usage page to have a parent date picker (#16264) 2025-11-07 10:00:37 -08:00
yuneng-jiang
29e8d857f7
Fix SSO Proxy Base URL input validation and remove normalizing / (#16332) 2025-11-06 19:24:05 -08:00
Ishaan Jaff
bdc4969526
[Feat] UI - Allow configuring LiteLLM Custom Guardrail (#16339)
* add ContentFilterAction

* store pre-built regex patterns

* add v0 of content filter guard

* add _filter_messages

* test content filter guard

* init ContentFilterGuardrail

* fix ContentFilterGuardrail enums

* rename folder

* fix litellm_content_filter

* refactor content filter guard

* test content filter

* add streaming for ContentFilterGuardrail

* test_streaming_hook_mask

* add litellm_content_filter

* docs show litellm content filter

* docs litellm content filter

* fix lnting

* use ENUM for PrebuiltPatternName

* fix validate_blocked_words_file

* add validateBlockedWordsFile

* LitellmContentFilterGuardrailConfigModel

* add get_config_model

* add litellm content filter

* refactored ui

* fix config

* tests for new components
2025-11-06 16:03:55 -08:00
yuneng-jiang
b5956e0595
Add Azure AD Token field to Add Model Azure and make API Key not required (#16331) 2025-11-06 09:52:39 -08:00
yuneng-jiang
b1be6185ac
[Feature] UI - Include Model Access Group Models on Team Models Table (#16298)
* All Models Page Allow Filtering By Model Access Group

* Fix tests from main merge
2025-11-05 18:23:50 -08:00
yuneng-jiang
f1191578ae
[Fix] UI - Fixed Label for vLLM in Model Create Flow (#16285)
* Fixed Label for vLLM

* Make vLLM api key not required
2025-11-05 16:03:01 -08:00
Ishaan Jaffer
5b658ce1eb ui fix 2025-11-04 17:58:51 -08:00
yuneng-jiang
2b0aea87c0
[Feature] UI - Initial changes for supporting prompts to multiple models (#16223)
* Initial changes for supporting prompts to multiple models

* Additional tests to prevent regressions

* Resolve merge conflicts

* Fixing E2E build issues
2025-11-04 16:02:19 -08:00
yuneng-jiang
2ed95e216c
[Feature] UI - Tag Usage Top Model Table View and Label Fix (#16249)
* Tag Usage Top Model Table View and Label Fix

* Removed unused state
2025-11-04 14:24:43 -08:00
yuneng-jiang
4d756a62d9
Prevent trailing slash in sso proxy base url input (#16244) 2025-11-04 14:22:50 -08:00
yuneng-jiang
615f76de88
[Feature] UI - Litellm test key audio (#16251)
* Add audio/transcriptions and audio/speech to Test key UI

* Removed unused import in test

* Fixed voice parameter not being passed in
2025-11-04 14:21:26 -08:00
YutaSaito
8e27b6c0b4
[MCP] configure static mcp header (#16179)
* feat: configure extra mcp headers in ui

* doc: static header

* build: add new migration file

* chore: add missing image file

* fix: test
2025-11-03 21:06:36 -08:00
YutaSaito
6ed76ff809
feat: change guardrail_information to list type (#16127)
* feat: change guardrail_information to list type to support displaying multiple guardrails

* fix: add missing commit and revert auto-format changes in utils.py

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-11-02 09:47:49 -08:00
yuneng-jiang
e336434b27
[Feature] UI - Guardrail Info Page Show PII Config (#16164)
* Guardrail info page fix

* Make the Configurations more readable and render in a table
2025-11-02 09:05:00 -08:00
yuneng-jiang
48822c2fa2
[Feature] UI - Add Model Existing Credentials Improvement (#16166)
* Model Settings UI Improvement

* Doc changes from Anthropic SDK to Passthrough

* Tests
2025-11-02 09:04:36 -08:00
yuneng-jiang
feea17181c
Delete Team Member with friction (#16167) 2025-11-02 09:04:00 -08:00
steve-gore-snapdocs
ef2000bfb7
Remove minimum validation for cache control injection index (#16149) 2025-11-01 13:22:24 -07:00
yuneng-jiang
31a4ab4780
Building UI (#16158) 2025-11-01 09:26:52 -07:00
Ishaan Jaffer
2cd57540a4 fix test fixes 2025-10-31 18:31:00 -07:00
Ishaan Jaffer
e6c9df230f fix linting 2025-10-31 18:26:22 -07:00
Ishaan Jaffer
159db27d5c fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
Ishaan Jaffer
d90f1696c3 UI new build 2025-10-31 18:11:41 -07:00
Ishaan Jaff
c59a0c9681
[Feat] UI - Allow setting cache settings on UI (#16143)
* add LiteLLM_CacheConfig

* add CacheSettingsField

* add UI cache saver

* feat add cache_settings_router

* fix schema

* fix ssl_check_hostname

* refactor into utils

* add groups for field names

* add test_connection in base cache

* add test_connection inredis and redis cluster

* feat _decrypt_db_variables

* add cache settings endpoints

* test_test_cache_connection_calls_cache_test_connection_with_params

* fix: add switch_on_llm_response_caching

* feat use CacheSettingsManager

* feat use CacheSettingsManager

* TestCacheSettingsManager

* fix update_config

* Cache Field test
2025-10-31 17:43:59 -07:00
yuneng-jiang
725671395a
[Feature] UI - Config Guardrails should not be editable and guardrail info fix (#16142)
* UI Config Guardrails should not be editable and guardrails info definition location fix

* Remove unused import

* Added literals for guardrail definition location
2025-10-31 16:29:24 -07:00
yuneng-jiang
cf0d84c789
[Feature] UI - Add Tags to update model (#16140)
* Add Tags to update model

* Test Key Page Tag Selector
2025-10-31 16:28:46 -07:00
yuneng-jiang
dd053e1d12
[Feature] UI - Add tags in model creation (#16138)
* Add tags in model creation

* Removing unused import in test
2025-10-31 16:26:30 -07:00
Ishaan Jaff
b6312e68f0
[Feat] UI + Management - Allow setting all routing strategies, tag filtering on UI (#16139)
* add ROUTER_SETTINGS_FIELDS

* feat: add router_settings_router on proxy

* add RouterSettingsField

* update RouterSettingsResponse

* add ROUTER_SETTINGS_FIELDS

* add getRouterSettingsCall

* add UI friendly name

* fix router settings

* fix get descriptions

* fix toggles /refator

* fix refactor

* fix refactor

* fix ROUTING_STRATEGY_DESCRIPTIONS

* fix fields
2025-10-31 11:29:37 -07:00
yuneng-jiang
b9850accaa
Circle CI e2e test fix (#16100) 2025-10-30 09:54:46 -07:00
yuneng-jiang
1b234108c0
[Feature] UI - Add Key Type Select in Key Settings (#16034)
* Add Key Type Select in Key Settings

* Frontend changes to fully support editing key type in key settings
2025-10-29 18:41:44 -07:00
yuneng-jiang
cd6d6cfdb5
Test Key UI Embeddings (#16065) 2025-10-29 18:40:19 -07:00
yuneng-jiang
5c71455d22
Validation for Proxy Base URL in SSO Settings (#16082) 2025-10-29 18:39:59 -07:00
Ishaan Jaff
99feefd614
[Feat] Add FAL AI Image Generations on LiteLLM (#16067)
* add fal-ai provider

* fix image_generation_handler

* init FalAIImageGenerationConfig

* init cost_calculator

* init FAL AI

* TestFAL_AI_ImageGeneration

* fix load_custom_provider_entrypoints

* TestFAL_AI_ImageGeneration

* add imagen4 transform FAL AI

* add FAL AI imagen 4 transform

* BaseImageGenTest

* test_fal_ai_image_generation_basic

* add BRIA + Recraft img gen

* add recraft + BRIA

* test_fal_ai_image_generation_basic

* tests for flux PRO v11

* Add FAL AI SD

* test FAL AI SD

* docs FAL AI

* docs fal ai

* Using Model-Specific Parameters

* add fal ai model prices

* add fall_ai JPG logo

* ui fixes FAL AI

* fix linting

* fix linting

* fix bedrock test_get_request_body_stability3

* test_custom_llm_provider_entrypoint
2025-10-29 13:10:51 -07:00
Ishaan Jaff
95dd216150
[UI] Feature - Add Apply Guardrail Testing Playground (#16030)
* add applyGuardrail endpoints

* v0 testing apply guard

* fix: use tabs

* move apply guardrails endpoint

* fix apply_guardrail

* fix applyGuardrail

* fix apply guardrail for bedrock

* test guard endpoints

* add tooltip for enter button

* refactor

* add guardrail test

* tests guardrails selector

* TestNomaApplyGuardrail
2025-10-28 16:41:17 -07:00
yuneng-jiang
12de66dad6
Config Models should not be editable (#16020) 2025-10-28 15:27:10 -07:00
yuneng-jiang
43af45ab88
Key Already Exist Error Notification (#15993) 2025-10-27 18:00:38 -07:00
yuneng-jiang
64167b7e34
Remove limit from admin UI numerical input fix (#15991) 2025-10-27 17:20:58 -07:00
yuneng-jiang
4ed9c7d7f2
[Feat] UI - Changed API Base from Select to Input in New LLM Credentials (#15987)
* Changed API Base from Select to Input

* Added Tests
2025-10-27 15:46:04 -07:00
Krish Dholakia
ddacaf6c32
(feat) Organizations: allow org admins to create teams on UI + (feat) IBM Guardrails (#15924)
* fix(oldteams.tsx): allow org admin to create team on ui

* fix(oldteams.tsx): show org admin a dropdown of allowed orgs for team creation

* docs(access_control.md): cleanup doc

* feat(ibm_guardrails/): initial commit adding support for ibm guardrails on litellm

allows user to use self-hosted ibm guardrails

* feat(ibm_detector.py): working detector

* docs(ibm_guardrails.md): document new ibm guardrails

* fix: fix linting errors
2025-10-25 11:13:39 -07:00
Ishaan Jaffer
79258d55f5 ui fix 2025-10-25 11:01:42 -07:00
Ishaan Jaffer
6dee76c580 UI fix linting errors 2025-10-24 14:36:55 -07:00
Ishaan Jaff
5de912375c
[Feat] UI - Add logos for search providers (#15872)
* add LiteLLM_SearchToolsTable

* init SearchToolRegistry

* fix add SearchToolRegistry

* fix add SearchToolRegistry

* fix handling search tool management

* fix search imports

* fix registry

* init search tools in memory

* fix init tools in mem

* fix TypedDict def

* add new SCHEMA

* bump proxy extras

* add LiteLLM_SearchToolsTable_search_tool_name_key

* bump extras with migration

* fix working CRUD Ops

* fix: _init_search_tools_in_db

* add UI friendly name for search providers

* add ui friendly name for search providers

* add providers available

* working layout

* better layout

* clean add search tool

* update_router_search_tools

* fix remove in memory registry, since router is in mem store

* allow testing search tool connection

* clean create search tool

* add test_search_tool_connection

* fix: _init_search_tools_in_db

* add searchToolQueryCall

* fix icon

* clean tester

* add parallel ai logo

* add exa ai logo

* add google PSE logo

* add tavily logo

* add dataforseo + perplexity

* add parallel ai logo

* UI show logos for search
2025-10-23 18:00:40 -07:00
Ishaan Jaff
fc9aba279e
[Feat] UI - Search Tools, allow adding search tools on UI + testing search (#15871)
* add LiteLLM_SearchToolsTable

* init SearchToolRegistry

* fix add SearchToolRegistry

* fix add SearchToolRegistry

* fix handling search tool management

* fix search imports

* fix registry

* init search tools in memory

* fix init tools in mem

* fix TypedDict def

* add new SCHEMA

* bump proxy extras

* add LiteLLM_SearchToolsTable_search_tool_name_key

* bump extras with migration

* fix working CRUD Ops

* fix: _init_search_tools_in_db

* add UI friendly name for search providers

* add ui friendly name for search providers

* add providers available

* working layout

* better layout

* clean add search tool

* update_router_search_tools

* fix remove in memory registry, since router is in mem store

* allow testing search tool connection

* clean create search tool

* add test_search_tool_connection

* fix: _init_search_tools_in_db

* add searchToolQueryCall

* fix icon

* clean tester
2025-10-23 17:59:29 -07:00
Krish Dholakia
e0c4baf66f
fix(ui/): fix routing for custom server root path (#15701)
* fix(ui/): fix routing for custom server root path

* fix: fix eslint errors
2025-10-23 13:59:29 -07:00
Krish Dholakia
29a97784e7
(feat) Passthrough - set auth on passthrough endpoints, on the UI (#15778)
* fix(add_pass_through.tsx): allow setting 'auth' to true for passthrough endpoints on the UI

* fix: working update auth on passthrough endpoints + show auth on passthrough table
2025-10-21 23:26:43 -07:00
Ishaan Jaff
9135e748a0
[Feat ] /ocr - Add mode + Health check support for OCR models (#15767)
* get_mode_handlers

* use get_mode_handlers

* test_ahealth_check_ocr

* Add OCR mode to test models

* docs OCR Health Checks

* fix connection endpoint
2025-10-21 16:58:37 -07:00
yuneng-jiang
8d1d400d32
litellm_Key Settings Max Budget Removal Error Fix (#15669)
* Key Settings Max Budget Removal Fix

* Add responses mode to health check

* test fix

* Key Settings Max Budget Removal Error Fix

---------

Co-authored-by: Sameer Kankute <sameer@berri.ai>
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
2025-10-17 19:41:29 -07:00