Commit graph

1340 commits

Author SHA1 Message Date
Ishaan Jaff
3f7b502cfb ui new build 2025-05-20 14:30:27 -07:00
Ishaan Jaff
5fb5b2521d ui fixes model alias mgmt 2025-05-19 17:50:24 -07:00
Ishaan Jaff
b78780e081 clean up style 2025-05-19 17:31:01 -07:00
Ishaan Jaff
1dcbb331b1 fixes for model alias 2025-05-19 17:25:33 -07:00
Ishaan Jaff
83d647952a fix edit model alias flow 2025-05-19 17:21:02 -07:00
Ishaan Jaff
b0219f8c3f fixes for edit alias 2025-05-19 17:18:40 -07:00
Ishaan Jaff
8936b9aca1 checkpoint model alias 2025-05-19 17:13:15 -07:00
Ishaan Jaff
aa3f3d0c79 ui model aliases 2025-05-19 17:03:57 -07:00
Ishaan Jaff
c01bf50728 working model alias mapping 2025-05-19 16:59:30 -07:00
Ishaan Jaff
3b5aa43ba1 working add alias flow 2025-05-19 16:56:00 -07:00
tanjiro
0676c840a1
add keys and members (#10950) 2025-05-19 13:21:02 -07:00
Ishaan Jaff
b861a650ad ui new build 2025-05-17 17:22:32 -07:00
Ishaan Jaff
93ec0c48bc
[UI QA Guardrails] - Minor UI Fixes (#10920)
* fix: presidio params on ui

* move mode and always on to the top

* explain each mode

* show switch for default on / off for guards

* allow multiple modes for guardrails

* fix: presidio output parsing with stream

* Revert "git commit fix linting error on cryptography bindings"

This reverts commit 2615f04afd.
2025-05-17 16:27:57 -07:00
Ishaan Jaff
50a6f289cd
[QA/Guardrails] Allow editing guardrail entity configs (#10918)
* allow editing guardrail entity

* fix: allow patching guardrail entity config

* fix: test init guardrails

* fix: update in mem guardrail params

* fix: update in mem guardrail params

* allow editing guardrail entities on ui

* fix pii entity config

* fixes for unselect/select entities

* fix: test fixes
2025-05-17 16:27:02 -07:00
Ishaan Jaff
db624c90f6 (UI) new build 2025-05-17 11:38:45 -07:00
Ishaan Jaff
88153e9a37 (ui) cleanup logs filter 2025-05-17 07:45:48 -07:00
Ishaan Jaff
e0cccb80dd ui - fixes leftnav 2025-05-16 20:55:09 -07:00
Ishaan Jaff
148814658e ui new build 2025-05-16 18:37:42 -07:00
Ishaan Jaff
76de6e374c
[UI] Allow editing guardrails (#10907)
* ui qa guardrails

* ui fixes guardrail info

* feat: add patch guardrail endpoint

* fix: update_guardrail_in_db

* ui add support for editing guardrails
2025-05-16 18:35:03 -07:00
Ishaan Jaff
ffafc77791
[UI] Fixes for using Lakera Guardrail on LiteLLM UI (#10906)
* add lakera v2 on ui

* fix: lakera init on ui

* ui fixes for exposed guardrails

* fix: lakera pii masking

* fix: lakera pii masking
2025-05-16 18:24:40 -07:00
tanjiro
fdacf07ccb
Key alias filter on logs (#10905)
* key hash filter added

* key alias filter added
2025-05-16 17:49:14 -07:00
Ishaan Jaff
888c4130bb
[Feat] UI: Allow clicking into a guardrail (#10904)
* ui allow clicking into guardrail

* feat: add guardrail info endpoint

* fix: guardrails/{guardrail_id}/info

* ui click into guard

* fix guardrail info view

* fix linting error
2025-05-16 16:58:40 -07:00
tanjiro
dc8945cce8
key hash filter added (#10903) 2025-05-16 16:53:52 -07:00
Ishaan Jaff
298912bd38
[UI] - Add Guardrail Tracing to LiteLLM SpendLogs (#10893)
* feat: trace guardrail SLP in spendLogs

* test: trace guardrail SLP in spendLogs

* add guardrail viewer

* checkpoint - working guardrail view on logs

* ui add guardrail view to SpendLogs

* test: fixes guardrails

* trace: fixes guardrails
2025-05-16 12:20:20 -07:00
Ishaan Jaff
f335bb91dd
Model filter added on logs tab. (#10877) (#10891)
* model filter added

* Make status logic it's own helper + add a unit test in test_spend_management_endpoints

Co-authored-by: tanjiro <56165694+NANDINI-star@users.noreply.github.com>
2025-05-16 10:04:02 -07:00
Ishaan Jaff
dc16e47df6
[UI] Allow adding Bedrock, Presidio, Lakera, AIM guardrails on UI (#10874)
* ui fix bedrock guard

* polish: logo should appear after selecting provider

* fix ui config bedrock

* fix: refactor - use specific configs per provider

* fix: refactor - use specific configs per provider

* feat: ui, show provider specific params for guardrails

* fix: updated type of LiteLLM params for guardrails

* fix: updated type of LiteLLM params for guardrails

* ui, use endpoint for adding presidio, bedrock guardrails

* fix: linting error

* add llama guard and secret detector on UI

* add aim on ui

* allow adding lakera AI on litellm ui

* fix: fixes for params to init guardrails

* test: test_guardrail_info_response

* test: test_initialize_presidio_guardrail

* fix: init guardrails

* fix: init guardrails

* add showSearch

* working bedrock guard
2025-05-15 21:22:56 -07:00
Ishaan Jaff
f2dc261efc
[Feat] UI: Add support for Deleting Guardrail on UI (#10869)
* show id on guardrails UI

* feat: show guardrail_id on UI

* guardrailToDelete

* ui - add DELETE guardrail

* Update ui/litellm-dashboard/src/components/guardrails.tsx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update ui/litellm-dashboard/src/components/guardrails.tsx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix ui linting

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-15 15:38:18 -07:00
Ishaan Jaff
4a0d711bed ui: fix render error on test key page 2025-05-14 18:57:51 -07:00
Ishaan Jaff
235ae79037 ui new build 2025-05-14 18:01:48 -07:00
Ishaan Jaff
91f32cd227 ui linting fixes 2025-05-14 18:00:50 -07:00
Ishaan Jaff
2a994d7016
[Feat] Presidio Improvements - Allow adding presidio api base on UI, Test presidio on Test Key, fixes for running presidio hook (#10840)
* feat: add GuardrailProviderSpecificParams

* feat: add add apply_guardrail helper for presidio

* ui cleanup

* fixes pii config on ui

* fixes for adding presidio pii

* refactor: InitializeGuardrails

* feat: init guardrails from DB

* allow running guardrails from test key pg

* fix: running a request with guardrails on UI

* fix: types/guardrails.py

* test: test_presidio_pre_call_hook_with_different_call_types

* test: test_initialize_presidio_guardrail

* test: fix custom guardrail tests
2025-05-14 17:41:33 -07:00
Ishaan Jaff
9ac47cd05a
[UI] Fixes for bulk invite users - add validation for bad inputs (#10836)
* fixes for bulk invite users

* add validation for bulk import
2025-05-14 17:36:30 -07:00
Ishaan Jaff
b9c3a3835c
[Feat UI] Add Guardrails on LiteLLM UI (#10834)
* feat: add DB Add, Edit, Delete for Guardrails

* feat: endpoints for guardrail management

* add guardrail info helpers

* add presidio logo

* add createGuardrailCall

* basic add guardrails on UI

* fix cleanup form

* feat: working add guardrails

* ui view guardrails

* allow viweing list of guardrails

* fix: show created_at and updated_at for guardrails on UI

* cleanup guardrail view

* use 1 file for guardrail table

* docs adding guardrails

* fix: expose endpoint to show allowed modes, entities, actions

* fix allow adding entity configs for PII

* fixes guardrails

* fix adding guardrails on UI

* feat: add PII_ENTITY_CATEGORIES_MAP

* use categories for pii

* use step based form

* fixes pii configs

* fix pii config

* refactor pii config on ui

* clear form on submit

* add ability to create guardrails

* fix linting error
2025-05-14 14:21:35 -07:00
Ishaan Jaff
ee1557afcd
[Feat] Add endpoints for adding, deleting, editing guardrails in DB (#10833)
* feat: add DB Add, Edit, Delete for Guardrails

* feat: endpoints for guardrail management

* add guardrail info helpers

* add presidio logo

* add createGuardrailCall
2025-05-14 14:19:51 -07:00
tanjiro
1fc5320e9f
Team id + Status filter on logs (#10831)
* added team_id filter

* improve hook

* pagination fixed

* fix pagination for team id filter

* minor

* added status filter

* fixed pagination
2025-05-14 13:06:42 -07:00
Jugal D. Bhatt
2b5a781fa4
add ollama api base defaults (#10805) 2025-05-13 14:58:36 -07:00
Ishaan Jaff
4d8f667b5e ui new build 2025-05-10 17:31:44 -07:00
Ishaan Jaff
02f0e13642
[UI] QA Logs page - Fix bug where log did not remain in focus + text overflow on error logs (#10725)
* logs page, ensure that the selected log remains in focus

* fix error view
2025-05-10 14:20:59 -07:00
Ishaan Jaff
e88ac57176
[UI] Bug Fix - Allow Copying Request / Response on Logs Page (#10720)
* dont show country with API req

* ui: allow copying request / response on logs
2025-05-10 12:54:16 -07:00
Ishaan Jaff
2c8f4efd33 (UI) fix regression on Logs page 2025-05-10 09:25:21 -07:00
Ishaan Jaff
8ab4ad1355 fix merge conflicts 2025-05-10 09:08:43 -07:00
Ishaan Jaff
56b5626554 Revert "Filter logs on status and model (#10670)"
This reverts commit d4f7403cb9.
2025-05-10 09:07:49 -07:00
Ishaan Jaff
9bc8130ad5 Revert "Fix log table bugs (after filtering logic was added) (#10712)"
This reverts commit 3fafe37eb9.
2025-05-10 09:07:32 -07:00
Krish Dholakia
9bfd3e4819
fix(router.py): write file to all deployments (#10708)
* fix(router.py): write file to all deployments

allows unified file id to work across multiple deployments

* fix(view_logs/index.tsx): show call type in request logs

* fix(router.py): pass a deep copy of kwargs to avoid conflict across multiple runs

* fix(batch_utils.py): broaden check

* fix(router_utils.py): handle null type for function name

* fix(proxy_track_cost_callback.py): fix ruff check error

* fix(router.py): handle healthy_deployments as a dict

* feat(managed_files.py): support encoding / decoding unified batch id … (#10711)

* feat(managed_files.py): support encoding / decoding unified batch id when using managed files

allows routing retrieve batch to the right model id

* fix: fix linting error

* test: add unit tests

* fix: fix ruff check
2025-05-10 00:08:30 -07:00
tanjiro
3fafe37eb9
Fix log table bugs (after filtering logic was added) (#10712)
* fix status filter

* fix refresh button

* minor

* fix refresh and auto refresh
2025-05-09 23:46:05 -07:00
Ishaan Jaff
42b8be526d ui new build 2025-05-08 20:21:14 -07:00
tanjiro
d4f7403cb9
Filter logs on status and model (#10670)
* added status filtering on logs

* added model filter

* fix linter

* fix model filtering

* modified status filter to use status column from LiteLLM_SpendLogs

* remove json import
2025-05-08 13:50:17 -07:00
Ishaan Jaff
24acee3596 new ui build 2025-05-07 21:10:29 -07:00
Ishaan Jaff
ad970ca41d
[Feat] Add endpoints to manage email settings (#10646)
* add email notifs endpoints

* ui refactor email settings

* allow controlling email settings / notifs through ui

* add email settings to enterprise router

* change order of email events

* manage email settings in general_settings

* fix location of email settings types

* testing for email settings
2025-05-07 18:56:17 -07:00
tanjiro
959ba21585
Filter on logs table (#10644)
* remove existing filter

* added team id based filtering
2025-05-07 17:51:03 -07:00