Commit graph

27921 commits

Author SHA1 Message Date
Ishaan Jaffer
d4be511130 UI new build 2025-11-27 12:33:56 -08:00
Ishaan Jaffer
b854218819 mypy: fix mypy linting errors 2025-11-27 12:33:02 -08:00
Ishaan Jaffer
19f03d4be3 ui fix linting errors 2025-11-27 12:32:51 -08:00
Ishaan Jaff
ffb75b04fd
[Feat] UI - allow adding pass through guardrails through UI (#17226)
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* init add pass through guardrails

* ui allow setting target fields on gd

* docs ui settings guardrails
2025-11-27 12:27:16 -08:00
Ishaan Jaff
d612d71ef4
[Feat] Add guardrails for pass through endpoints (#17221)
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-11-27 12:06:53 -08:00
yuneng-jiang
ef1b3f954b
Merge pull request #17223 from BerriAI/litellm_router_fallback_dropdown_fix
[Fix] Change Add Fallback Modal to use Antd Select
2025-11-27 11:40:59 -08:00
yuneng-jiang
d59e5dc1f5 Change add fallback to use antd select 2025-11-27 11:31:07 -08:00
Raghav Jhavar
e402b8cd26
do not include plaintext message in exception (#17216) 2025-11-27 10:25:08 -08:00
Yannay Hammer
d7ad2913be
Upgrade websockets to v15 (#16734) 2025-11-27 10:08:16 -08:00
Cesar Garcia
5197380dd2
docs: add OpenAI Agents SDK to projects (#17203)
* docs: add OpenAI Agents SDK to projects

Add documentation for OpenAI Agents SDK which has an official
LiteLLM extension enabling 100+ LLM providers in multi-agent workflows.

* Update project items in sidebars.js
2025-11-27 09:47:26 -08:00
yuneng-jiang
37b1797c59
Merge pull request #17213 from BerriAI/litellm_yuneng_ui_build_2
[Infra] Rebuilding UI
2025-11-27 09:28:57 -08:00
yuneng-jiang
f09a6a4187 Rebuilding UI 2025-11-27 09:26:47 -08:00
yuneng-jiang
4d00f5bb9b
Merge pull request #17212 from BerriAI/litellm_yuneng_ui_build
[Infra] Building UI
2025-11-27 09:15:43 -08:00
Ishaan Jaffer
96a0f960a9 test_e2e_batches_files 2025-11-27 09:14:43 -08:00
yuneng-jiang
23a979d6fc Building UI 2025-11-27 09:13:48 -08:00
Ishaan Jaff
31ecd4ce49
Revert "Respect custom llm provider in header" (#17211) 2025-11-27 09:12:44 -08:00
Sameer Kankute
83c1138067
Merge pull request #17195 from BerriAI/litellm_respect_custom_llm_header
Respect custom llm provider in header
2025-11-27 22:27:42 +05:30
yuneng-jiang
6825593735
Merge pull request #17181 from BerriAI/litellm_ui_org_usage_2
[Feature] UI - Organization Usage in Usage Tab (#16614)
2025-11-27 08:57:31 -08:00
Sameer Kankute
688066fa2e
Merge pull request #17096 from abi-jey/main
feat: add GA protocol as configurable parameter for azure openai realtime api
2025-11-27 22:20:07 +05:30
Ishaan Jaffer
3b330c3f0f docs config settings 2025-11-27 08:15:51 -08:00
abbas jafari
af5f31eb9f
Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer Kankute
1f6d8fc151
Merge pull request #17079 from naaa760/fix/vertex-batch-support
fix: support Vertex AI batch listing in LiteLLM proxy
2025-11-27 16:50:17 +05:30
Sameer Kankute
d4bc1cf23d Respect custom llm provider in header 2025-11-27 16:38:37 +05:30
yuneng-jiang
40db4527f7 [Feature] UI - Organization Usage in Usage Tab (#16614)
* Organization Usage UI

* Resolved build issues

* Added a test
2025-11-26 21:51:19 -08:00
yuneng-jiang
e093429740
Merge pull request #17177 from BerriAI/litellm_ui_model_perf_2
[Infra] UI - Migrate Provider Fields to React Query
2025-11-26 20:07:57 -08:00
Ishaan Jaffer
772be1778a test_append_system_prompt_messages 2025-11-26 19:00:31 -08:00
Ishaan Jaffer
01fd4d7cef fix fireworks test 2025-11-26 18:58:32 -08:00
Ishaan Jaffer
65f5cc29dd fix ai/ml api 2025-11-26 18:55:55 -08:00
Sameer Kankute
b09c64e4f3
Merge pull request #16874 from BerriAI/litellm_vertex_ai_anthopic_cost_tracking
Add cost tracking for streaming in vertex ai passthrough
2025-11-27 08:24:41 +05:30
Sameer Kankute
aab0684bb9
Merge pull request #16877 from BerriAI/litellm_mcp_responses_api_header_passing
feat: Add header passing support for MCP tools in Responses API
2025-11-27 08:10:43 +05:30
Krish Dholakia
1cb5fcddba
make generic api OSS + support multiple generic API's (#17152)
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's

Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967

* feat(callback_utils.py): support custom generic api callbacks

* feat(generic_api_callback.py): support specifying which event types to run the generic api for

* fix(litellm_logging.py): log system prompt for anthropic messages

* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud

* docs(sidebars.js): document new OSS generic api

* docs(generic_api.md): document new OSS Generic API

* docs(custom_webhook_api.md): document custom webhook api integration tutorial

* docs(custom_webhook_api.md): cleanup

* docs(custom_webhook_api.md): document what get's logged to custom webhook api

* Refactor: Pass callback config to GenericAPILogger

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Handle empty messages list in logging payload

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Checkpoint before follow-up message

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: Cache GenericAPILogger instances to improve performance

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-26 18:38:38 -08:00
Sameer Kankute
30a22f1fed type the secrets field 2025-11-27 07:58:35 +05:30
Sameer Kankute
605bc4e476 type the secrets field 2025-11-27 07:58:06 +05:30
Ishaan Jaffer
48eb34a875 fix cos tracking 2025-11-26 18:26:07 -08:00
Ishaan Jaffer
b487e67dec sec fix 2025-11-26 18:23:18 -08:00
yuneng-jiang
7e3f3c6f65 Migrate /public/provider/fields to react query 2025-11-26 18:16:52 -08:00
Ishaan Jaffer
5cfcc98d2e fix img gen 2025-11-26 17:56:59 -08:00
yuneng-jiang
ac1827cbfc
Merge pull request #17168 from BerriAI/litellm_ui_users_loading
[Feature] UI - Better Loading State for Internal User Page
2025-11-26 17:28:40 -08:00
yuneng-jiang
9a4d3bc347
Merge pull request #17170 from BerriAI/litellm_key_create_duration_fix
[Fix] UI - Create Key Duration Fix
2025-11-26 17:24:30 -08:00
Ishaan Jaffer
0346d1ea23 fix 2025-11-26 17:11:33 -08:00
yuneng-jiang
f0e5921bbd Add emoji for exact text match 2025-11-26 17:09:07 -08:00
Ishaan Jaff
831694897e
[Feat] RAG API - QA - allow internal user keys to access api, allow using litellm credentials with API, raise clear exception when RAG API fails (#17169)
* allow using a cred with RAG API

* add /rag/ingest to llm api routes

* add rag endpoints under llm api routes

* raise clear exception when RAG API fails

* use async methods for bedrock ingest

* fix ingestion

* fix _create_opensearch_collection

* fix qa check and linting
2025-11-26 17:07:30 -08:00
yuneng-jiang
4b951c3ced Removing flaky tests 2025-11-26 17:04:12 -08:00
yuneng-jiang
aad0075366 Change create key duration initial value to null 2025-11-26 17:00:56 -08:00
yuneng-jiang
67f9c6cc08 Adjusting e2e tests for new loading state 2025-11-26 16:47:37 -08:00
yuneng-jiang
87b4e9ebad User table loading state 2025-11-26 16:24:29 -08:00
Ishaan Jaff
379655e16b
[Feat] LiteLLM RAG API - Add support for Vertex RAG engine (#17117)
* add VertexAIVectorStoreOptions

* Revert "add VertexAIVectorStoreOptions"

This reverts commit b086adf10b.

* add VertexAIVectorStoreOptions

* add get_rag_ingestion_class

* add VertexAIRAGTransformation

* test ingestion

* docs vertex ai rag engine
2025-11-26 15:49:04 -08:00
SamAcctX
32617d1e72
Add OpenRouter Opus 4.5 (#17144) 2025-11-26 15:45:45 -08:00
yuneng-jiang
1b34312488
Merge pull request #17166 from BerriAI/litellm_ui_mh_server_root
[Fix] UI - Change model_hub_table to call getUiConfig before Fetching Public Data
2025-11-26 15:30:16 -08:00
yuneng-jiang
86af4891fa Change model_hub_table to call getUiConfig before fetching public data 2025-11-26 15:12:40 -08:00