Commit graph

2651 commits

Author SHA1 Message Date
yuneng-jiang
e26875b8ed
[Fix] UI - Test Key Page Revert Model To Single Select (#16390)
* Test Key Single Select

* fix build issues
2025-11-08 09:08:32 -08:00
YutaSaito
6eb74bd62a
Feat/persist mcp credentials in db (#16308)
* feat: persist mcp credentials in db

* feat: remove Auth Value field from MCP Tool Testing Playground

* fix: test
2025-11-07 19:22:49 -08:00
Ishaan Jaff
f1534c1650
Revert "[Fix] UI - Revert Changes for Test Key Multiple Model Select (#16372)" (#16386)
This reverts commit 99a8a304c1.
2025-11-07 18:24:01 -08:00
Ishaan Jaffer
4dcbfbbb89 ui fix linting 2025-11-07 18:20:31 -08:00
Ishaan Jaff
a978680714
[UI] Guardrails - allow updating guardrails through UI. Ensure litellm_params actually get updated in memory (#16384)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns

* fix edit and view

* fix backend handling

* fix CF ui edit

* fix init

* add _has_guardrail_params_changed

* fix sync_guardrail_from_db

* fix _has_guardrail_params_changed

* fix patch_guardrail

* add unsaved change check

* fix ContentFilterManager
2025-11-07 18:15:59 -08:00
Ishaan Jaff
674d4b4cab
[Feat] Guardrails - LiteLLM Content Filter, Allow Viewing/Editing Content Filter Settings (#16383)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns

* fix edit and view

* fix backend handling

* fix CF ui edit

* fix init
2025-11-07 18:15:09 -08:00
Ishaan Jaff
ca229fe030
[Feat] LiteLLM Guardrail - UI Fix, ensure you can see UI Friendly name for PII Patterns (#16382)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns
2025-11-07 18:14:58 -08:00
Ishaan Jaffer
5b5122125c guardrailLogoMap fix 2025-11-07 15:37:01 -08:00
Ishaan Jaffer
4621a23a89 add litellm logo jpg 2025-11-07 15:36:49 -08:00
yuneng-jiang
5fb0940b9b
[Feature] UI - Surface SSO Create errors on create flow (#16369)
* Surface backend SSO issues on create SSO flow

* Remove unused import

* Fix flaky test
2025-11-07 14:44:50 -08:00
yuneng-jiang
99a8a304c1
[Fix] UI - Revert Changes for Test Key Multiple Model Select (#16372)
* Revert "Initial changes for supporting prompts to multiple models"

This reverts commit 0d8dee4401.

* Add test for the single model select
2025-11-07 13:39:17 -08:00
yuneng-jiang
92bc7db594
Remove encoding_format in api calls for test key embedding models (#16367) 2025-11-07 10:58:30 -08:00
yuneng-jiang
0a90283fec
Change usage page to have a parent date picker (#16264) 2025-11-07 10:00:37 -08:00
yuneng-jiang
29e8d857f7
Fix SSO Proxy Base URL input validation and remove normalizing / (#16332) 2025-11-06 19:24:05 -08:00
Ishaan Jaff
bdc4969526
[Feat] UI - Allow configuring LiteLLM Custom Guardrail (#16339)
* add ContentFilterAction

* store pre-built regex patterns

* add v0 of content filter guard

* add _filter_messages

* test content filter guard

* init ContentFilterGuardrail

* fix ContentFilterGuardrail enums

* rename folder

* fix litellm_content_filter

* refactor content filter guard

* test content filter

* add streaming for ContentFilterGuardrail

* test_streaming_hook_mask

* add litellm_content_filter

* docs show litellm content filter

* docs litellm content filter

* fix lnting

* use ENUM for PrebuiltPatternName

* fix validate_blocked_words_file

* add validateBlockedWordsFile

* LitellmContentFilterGuardrailConfigModel

* add get_config_model

* add litellm content filter

* refactored ui

* fix config

* tests for new components
2025-11-06 16:03:55 -08:00
yuneng-jiang
b5956e0595
Add Azure AD Token field to Add Model Azure and make API Key not required (#16331) 2025-11-06 09:52:39 -08:00
yuneng-jiang
b1be6185ac
[Feature] UI - Include Model Access Group Models on Team Models Table (#16298)
* All Models Page Allow Filtering By Model Access Group

* Fix tests from main merge
2025-11-05 18:23:50 -08:00
yuneng-jiang
f1191578ae
[Fix] UI - Fixed Label for vLLM in Model Create Flow (#16285)
* Fixed Label for vLLM

* Make vLLM api key not required
2025-11-05 16:03:01 -08:00
Ishaan Jaffer
5b658ce1eb ui fix 2025-11-04 17:58:51 -08:00
yuneng-jiang
2b0aea87c0
[Feature] UI - Initial changes for supporting prompts to multiple models (#16223)
* Initial changes for supporting prompts to multiple models

* Additional tests to prevent regressions

* Resolve merge conflicts

* Fixing E2E build issues
2025-11-04 16:02:19 -08:00
yuneng-jiang
2ed95e216c
[Feature] UI - Tag Usage Top Model Table View and Label Fix (#16249)
* Tag Usage Top Model Table View and Label Fix

* Removed unused state
2025-11-04 14:24:43 -08:00
yuneng-jiang
4d756a62d9
Prevent trailing slash in sso proxy base url input (#16244) 2025-11-04 14:22:50 -08:00
yuneng-jiang
615f76de88
[Feature] UI - Litellm test key audio (#16251)
* Add audio/transcriptions and audio/speech to Test key UI

* Removed unused import in test

* Fixed voice parameter not being passed in
2025-11-04 14:21:26 -08:00
YutaSaito
8e27b6c0b4
[MCP] configure static mcp header (#16179)
* feat: configure extra mcp headers in ui

* doc: static header

* build: add new migration file

* chore: add missing image file

* fix: test
2025-11-03 21:06:36 -08:00
YutaSaito
6ed76ff809
feat: change guardrail_information to list type (#16127)
* feat: change guardrail_information to list type to support displaying multiple guardrails

* fix: add missing commit and revert auto-format changes in utils.py

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-11-02 09:47:49 -08:00
yuneng-jiang
e336434b27
[Feature] UI - Guardrail Info Page Show PII Config (#16164)
* Guardrail info page fix

* Make the Configurations more readable and render in a table
2025-11-02 09:05:00 -08:00
yuneng-jiang
48822c2fa2
[Feature] UI - Add Model Existing Credentials Improvement (#16166)
* Model Settings UI Improvement

* Doc changes from Anthropic SDK to Passthrough

* Tests
2025-11-02 09:04:36 -08:00
yuneng-jiang
feea17181c
Delete Team Member with friction (#16167) 2025-11-02 09:04:00 -08:00
steve-gore-snapdocs
ef2000bfb7
Remove minimum validation for cache control injection index (#16149) 2025-11-01 13:22:24 -07:00
yuneng-jiang
31a4ab4780
Building UI (#16158) 2025-11-01 09:26:52 -07:00
Ishaan Jaffer
2cd57540a4 fix test fixes 2025-10-31 18:31:00 -07:00
Ishaan Jaffer
e6c9df230f fix linting 2025-10-31 18:26:22 -07:00
Ishaan Jaffer
159db27d5c fix test claude-sonnet-4-5-20250929 2025-10-31 18:13:29 -07:00
Ishaan Jaffer
d90f1696c3 UI new build 2025-10-31 18:11:41 -07:00
Ishaan Jaff
c59a0c9681
[Feat] UI - Allow setting cache settings on UI (#16143)
* add LiteLLM_CacheConfig

* add CacheSettingsField

* add UI cache saver

* feat add cache_settings_router

* fix schema

* fix ssl_check_hostname

* refactor into utils

* add groups for field names

* add test_connection in base cache

* add test_connection inredis and redis cluster

* feat _decrypt_db_variables

* add cache settings endpoints

* test_test_cache_connection_calls_cache_test_connection_with_params

* fix: add switch_on_llm_response_caching

* feat use CacheSettingsManager

* feat use CacheSettingsManager

* TestCacheSettingsManager

* fix update_config

* Cache Field test
2025-10-31 17:43:59 -07:00
yuneng-jiang
725671395a
[Feature] UI - Config Guardrails should not be editable and guardrail info fix (#16142)
* UI Config Guardrails should not be editable and guardrails info definition location fix

* Remove unused import

* Added literals for guardrail definition location
2025-10-31 16:29:24 -07:00
yuneng-jiang
cf0d84c789
[Feature] UI - Add Tags to update model (#16140)
* Add Tags to update model

* Test Key Page Tag Selector
2025-10-31 16:28:46 -07:00
yuneng-jiang
dd053e1d12
[Feature] UI - Add tags in model creation (#16138)
* Add tags in model creation

* Removing unused import in test
2025-10-31 16:26:30 -07:00
Ishaan Jaff
b6312e68f0
[Feat] UI + Management - Allow setting all routing strategies, tag filtering on UI (#16139)
* add ROUTER_SETTINGS_FIELDS

* feat: add router_settings_router on proxy

* add RouterSettingsField

* update RouterSettingsResponse

* add ROUTER_SETTINGS_FIELDS

* add getRouterSettingsCall

* add UI friendly name

* fix router settings

* fix get descriptions

* fix toggles /refator

* fix refactor

* fix refactor

* fix ROUTING_STRATEGY_DESCRIPTIONS

* fix fields
2025-10-31 11:29:37 -07:00
yuneng-jiang
b9850accaa
Circle CI e2e test fix (#16100) 2025-10-30 09:54:46 -07:00
yuneng-jiang
1b234108c0
[Feature] UI - Add Key Type Select in Key Settings (#16034)
* Add Key Type Select in Key Settings

* Frontend changes to fully support editing key type in key settings
2025-10-29 18:41:44 -07:00
yuneng-jiang
cd6d6cfdb5
Test Key UI Embeddings (#16065) 2025-10-29 18:40:19 -07:00
yuneng-jiang
5c71455d22
Validation for Proxy Base URL in SSO Settings (#16082) 2025-10-29 18:39:59 -07:00
Ishaan Jaff
99feefd614
[Feat] Add FAL AI Image Generations on LiteLLM (#16067)
* add fal-ai provider

* fix image_generation_handler

* init FalAIImageGenerationConfig

* init cost_calculator

* init FAL AI

* TestFAL_AI_ImageGeneration

* fix load_custom_provider_entrypoints

* TestFAL_AI_ImageGeneration

* add imagen4 transform FAL AI

* add FAL AI imagen 4 transform

* BaseImageGenTest

* test_fal_ai_image_generation_basic

* add BRIA + Recraft img gen

* add recraft + BRIA

* test_fal_ai_image_generation_basic

* tests for flux PRO v11

* Add FAL AI SD

* test FAL AI SD

* docs FAL AI

* docs fal ai

* Using Model-Specific Parameters

* add fal ai model prices

* add fall_ai JPG logo

* ui fixes FAL AI

* fix linting

* fix linting

* fix bedrock test_get_request_body_stability3

* test_custom_llm_provider_entrypoint
2025-10-29 13:10:51 -07:00
Ishaan Jaff
95dd216150
[UI] Feature - Add Apply Guardrail Testing Playground (#16030)
* add applyGuardrail endpoints

* v0 testing apply guard

* fix: use tabs

* move apply guardrails endpoint

* fix apply_guardrail

* fix applyGuardrail

* fix apply guardrail for bedrock

* test guard endpoints

* add tooltip for enter button

* refactor

* add guardrail test

* tests guardrails selector

* TestNomaApplyGuardrail
2025-10-28 16:41:17 -07:00
yuneng-jiang
12de66dad6
Config Models should not be editable (#16020) 2025-10-28 15:27:10 -07:00
yuneng-jiang
43af45ab88
Key Already Exist Error Notification (#15993) 2025-10-27 18:00:38 -07:00
yuneng-jiang
64167b7e34
Remove limit from admin UI numerical input fix (#15991) 2025-10-27 17:20:58 -07:00
yuneng-jiang
4ed9c7d7f2
[Feat] UI - Changed API Base from Select to Input in New LLM Credentials (#15987)
* Changed API Base from Select to Input

* Added Tests
2025-10-27 15:46:04 -07:00
Krish Dholakia
ddacaf6c32
(feat) Organizations: allow org admins to create teams on UI + (feat) IBM Guardrails (#15924)
* fix(oldteams.tsx): allow org admin to create team on ui

* fix(oldteams.tsx): show org admin a dropdown of allowed orgs for team creation

* docs(access_control.md): cleanup doc

* feat(ibm_guardrails/): initial commit adding support for ibm guardrails on litellm

allows user to use self-hosted ibm guardrails

* feat(ibm_detector.py): working detector

* docs(ibm_guardrails.md): document new ibm guardrails

* fix: fix linting errors
2025-10-25 11:13:39 -07:00