Krish Dholakia
4942e25707
fix(vertex_llm_base.py): remove quota_project_id parameter from credential refresh request ( #10915 )
...
Fixes https://github.com/BerriAI/litellm/issues/9863
2025-05-18 20:43:01 -07:00
Krrish Dholakia
16b2158d25
docs: update release notes
2025-05-17 19:47:57 -07:00
Krrish Dholakia
6bfd05bb76
docs: update docs with key highlights
2025-05-17 19:47:57 -07:00
DarinVerheijke
54a0766ff9
Add provider Featherless AI (access to 4200+ models) ( #10596 )
...
* add featherless provider
* change docs
* clean lint
* fix provider logic
* Add fixes per review
* update parameters
* update error msg
* remove featherless
* add tests
* add mock test e2e
* update to openai mock test
2025-05-17 19:38:46 -07:00
Krrish Dholakia
b53f1e7677
docs: clarify enterprise feature
2025-05-17 19:36:35 -07:00
Ishaan Jaff
8a05c57071
docs pii masking cleanup
2025-05-17 18:55:58 -07:00
Ishaan Jaff
d367eb3460
[Docs] Pii masking with LiteLLM ( #10924 )
...
* doc pii masking
* remove old doc
* docs add deployment options
* docs guardrail pii masking
* docs pii masking / tracing
* add images of tracing guards litellm ui
* docs presidio pii
2025-05-17 18:35:33 -07:00
Ishaan Jaff
cdf6026fdd
docs apply guard ( #10923 )
2025-05-17 18:34:35 -07:00
Krish Dholakia
b4fc703d3b
LiteLLM Stable release notes ( #10919 )
...
* docs(index/v1.70.1-stable): style improvements
* style: add style improvements to docs
* docs: cleanup docs
* docs: more style improvements
* docs: style improvements
* docs(gemini/realtime): add docs on realtime api via Google AI Studio
* docs: add openai example to anthropic web search docs
* docs: add missing doc links
* docs: doc cleanup
* docs: add more doc links
* fix: cleanup
* docs: add docker information
* docs: update doc links
* docs: add demo instance details to doc
s
2025-05-17 17:54:25 -07:00
Ishaan Jaff
ac541392ed
fix: apply_guardrail endpoint
2025-05-17 17:51:19 -07:00
Ishaan Jaff
22aa33e8b5
bump litellm_enterprise-0.1.4
2025-05-17 17:28:59 -07:00
Ishaan Jaff
b861a650ad
ui new build
2025-05-17 17:22:32 -07:00
Ishaan Jaff
5ab9fc0b7a
fix linting cryptography ( #10921 )
2025-05-17 17:21:22 -07:00
Ishaan Jaff
e87b536d03
fix config.yml
2025-05-17 16:59:03 -07:00
Ishaan Jaff
01d0983c29
fix config.yml
2025-05-17 16:57:17 -07:00
Ishaan Jaff
c79cba47ec
fix linting errors from ryptography.hazmat.bindings._rust
2025-05-17 16:31:30 -07:00
Ishaan Jaff
93ec0c48bc
[UI QA Guardrails] - Minor UI Fixes ( #10920 )
...
* fix: presidio params on ui
* move mode and always on to the top
* explain each mode
* show switch for default on / off for guards
* allow multiple modes for guardrails
* fix: presidio output parsing with stream
* Revert "git commit fix linting error on cryptography bindings"
This reverts commit 2615f04afd
2025-05-17 16:27:57 -07:00
Ishaan Jaff
50a6f289cd
[QA/Guardrails] Allow editing guardrail entity configs ( #10918 )
...
* allow editing guardrail entity
* fix: allow patching guardrail entity config
* fix: test init guardrails
* fix: update in mem guardrail params
* fix: update in mem guardrail params
* allow editing guardrail entities on ui
* fix pii entity config
* fixes for unselect/select entities
* fix: test fixes
2025-05-17 16:27:02 -07:00
Krrish Dholakia
d79cd70a1a
docs(index/v1.70.1-stable): add initial release note
2025-05-17 16:13:44 -07:00
Jugal D. Bhatt
b342aa9253
add docs for spend logs ( #10913 )
...
* add docs for spend logs
* change docs
* change docs
* change docs and change default run loops.
There was a calc error previously, it was not a million when run 100 times, but 100k, now default run would delete 500k records in 50s (running 500 loops of function before exiting)
* add docs changes to ui logs to metion deletion
2025-05-17 16:00:28 -07:00
Ishaan Jaff
9846abb5c0
allow using output parsing for guardrails
2025-05-17 14:52:39 -07:00
Ishaan Jaff
ddf1b20f4f
Revert "git commit fix linting error on cryptography bindings"
...
This reverts commit 2615f04afd
2025-05-17 14:49:54 -07:00
Ishaan Jaff
2615f04afd
git commit fix linting error on cryptography bindings
2025-05-17 12:16:37 -07:00
Ishaan Jaff
db624c90f6
(UI) new build
2025-05-17 11:38:45 -07:00
Krrish Dholakia
61d7704057
bump: version 1.70.0 → 1.70.1
2025-05-17 09:10:52 -07:00
Krrish Dholakia
9199078f36
test: update test
2025-05-17 07:56:05 -07:00
Ishaan Jaff
88153e9a37
(ui) cleanup logs filter
2025-05-17 07:45:48 -07:00
Krrish Dholakia
5c5699b65d
build: merge in https://github.com/BerriAI/litellm/pull/10909
...
Closes https://github.com/BerriAI/litellm/pull/10909
2025-05-17 07:36:56 -07:00
Krish Dholakia
cc626ad3ec
Handle openai gpt file data + add openai 'supports_pdf_input' to all vision models + Support bedrock tool cache pointing ( #10897 )
...
* fix(openai/gpt_transformation.py): handle missing filename for openai file data call
* fix(openai/gpt_transformation.py): clean handling for sync + async pdf url transformation flows
Fixes https://github.com/BerriAI/litellm/issues/10820
* build(model_prices_and_context_window.json): add 'supports_pdf_input' for all openai models which have 'vision' support
Follows openai guidelines
* feat(bedrock/chat): support cache pointing tool calls on Bedrock
Closes https://github.com/BerriAI/litellm/pull/10613
* fix: fix linting error
2025-05-17 07:29:01 -07:00
Ishaan Jaff
e0cccb80dd
ui - fixes leftnav
2025-05-16 20:55:09 -07:00
Ishaan Jaff
3bbfdcb865
fix: linting error
2025-05-16 20:15:42 -07:00
Ishaan Jaff
8a7fdf3dd5
bump: version 1.69.3 → 1.70.0
2025-05-16 18:38:10 -07:00
Ishaan Jaff
148814658e
ui new build
2025-05-16 18:37:42 -07:00
Ishaan Jaff
76de6e374c
[UI] Allow editing guardrails ( #10907 )
...
* ui qa guardrails
* ui fixes guardrail info
* feat: add patch guardrail endpoint
* fix: update_guardrail_in_db
* ui add support for editing guardrails
2025-05-16 18:35:03 -07:00
Jugal D. Bhatt
d8525ecbfa
Remove extra test file ( #10889 )
2025-05-16 18:34:22 -07:00
Jugal D. Bhatt
7702663666
add constant to config settings.md ( #10908 )
2025-05-16 18:33:19 -07:00
Ishaan Jaff
ffafc77791
[UI] Fixes for using Lakera Guardrail on LiteLLM UI ( #10906 )
...
* add lakera v2 on ui
* fix: lakera init on ui
* ui fixes for exposed guardrails
* fix: lakera pii masking
* fix: lakera pii masking
2025-05-16 18:24:40 -07:00
Jugal D. Bhatt
44c100d05d
[Feat] handle multi-pod deployment for SpendLogs Retention ( #10895 )
...
* handle multi-pod deployment
* fix utc and ruff errors
* add constants.py
* add lock duration acc to interval
* add lock duration on pod lock manager
* update tests to use redis
* update comments from review
* update config_Settings.md
* lint errors
* remove custom ttl setting
* add constants.py
* add constants.py
* add check for pod lock manager, and allow otherwise
* remove dup try except and move to finally
remove args
2025-05-16 18:18:51 -07:00
tanjiro
fdacf07ccb
Key alias filter on logs ( #10905 )
...
* key hash filter added
* key alias filter added
2025-05-16 17:49:14 -07:00
Ishaan Jaff
bd1e0634bf
[Feat] Add Lakera v2 Guardrail Support ( #10880 )
...
* feat: add types for lakera v2
* feat: add call v2 guard for lakera
* feat: add call v2 guard for lakera
* feat: add LAKERA_V2
* feat: add LAKERA_V2 params
* feat: add initialize_lakera_v2
* fix: lakera pii masking
* test: lakera pii masking
* fix: lakera pii masking with tracing
* fix: lakera pii masking with tracing
* fix: fix linting errors
* fix: lakera ai docs
2025-05-16 17:08:21 -07:00
Ishaan Jaff
888c4130bb
[Feat] UI: Allow clicking into a guardrail ( #10904 )
...
* ui allow clicking into guardrail
* feat: add guardrail info endpoint
* fix: guardrails/{guardrail_id}/info
* ui click into guard
* fix guardrail info view
* fix linting error
2025-05-16 16:58:40 -07:00
tanjiro
dc8945cce8
key hash filter added ( #10903 )
2025-05-16 16:53:52 -07:00
Ishaan Jaff
1a7932a262
Feat: add guardrail tracing to OTEL, Arize phoenix ( #10896 )
...
* feat: add guardrail tracing to OTEL, Arize phoenix
* fix: code qa check
* test: trace guard on OTEL
* fix: linting
2025-05-16 13:38:11 -07:00
Will Chen
0942a9d51d
Fix example commands in reliability.md ( #10894 )
...
-D is incorrect and dumps the headers.
The correct flag is -d which sets it as data
2025-05-16 13:21:34 -07:00
Ishaan Jaff
298912bd38
[UI] - Add Guardrail Tracing to LiteLLM SpendLogs ( #10893 )
...
* feat: trace guardrail SLP in spendLogs
* test: trace guardrail SLP in spendLogs
* add guardrail viewer
* checkpoint - working guardrail view on logs
* ui add guardrail view to SpendLogs
* test: fixes guardrails
* trace: fixes guardrails
2025-05-16 12:20:20 -07:00
Ishaan Jaff
b9460dfe37
[Feat] Add Tracing for guardrails in StandardLoggingPayload, Langfuse ( #10890 )
...
* test:test_standard_logging_payload_includes_guardrail_information
* feat: add tracing for presidio pii masking
* feat: add tracing for guardrails on langfuse
* test: test_langfuse_trace_includes_guardrail_information
* feat: add tracing for guardrails on langfuse
* fix: working guardrail trace
* test: guardrail trace lands on langfuse
* fix: linting
* fix: code qa check
* test: fixes for presidio test
* test: fixes for presidio test
* test: guardrail trace lands on langfuse
* test: guardrail trace lands on langfuse
* test: guardrail trace lands on langfuse
* test: guardrail trace lands on langfuse
2025-05-16 10:47:12 -07:00
Krrish Dholakia
cec4535cd8
fix: fix unit tests
2025-05-16 10:33:44 -07:00
Jason
803dda05ed
fix: fix novita ai docs ( #10882 )
2025-05-16 10:04:55 -07:00
Ishaan Jaff
f335bb91dd
Model filter added on logs tab. ( #10877 ) ( #10891 )
...
* model filter added
* Make status logic it's own helper + add a unit test in test_spend_management_endpoints
Co-authored-by: tanjiro <56165694+NANDINI-star@users.noreply.github.com>
2025-05-16 10:04:02 -07:00
Jugal D. Bhatt
d5d5166777
Feat log retention cleanup ( #10872 )
...
* Batch deletion with tasks
* reset utils
* change print to logger
* remove print for lint
* fix lint
* local testing
* remove constants.py var
* ruff fix
* type fix
* - make sure job doesn't get added if maximum_spend_logs_retention_period is not set
- enable user to override scheduler time
- Upper bound on while true
* update and fix test
2025-05-15 22:43:39 -07:00
