Sameer Kankute
bcc35a6069
Merge pull request #17253 from BerriAI/litellm_nova_embedding_support
...
Add nova embedding support
2025-11-28 21:16:06 +05:30
Sameer Kankute
bb11c4fb3f
Merge pull request #17258 from BerriAI/litellm_add_tags_in_ui
...
Fix metadata tags and model name display in UI for Azure passthrough + Add cost tracking for responses API
2025-11-28 21:15:39 +05:30
Sameer Kankute
6c326ceb87
Merge pull request #17142 from BerriAI/litellm_anthropic_update_new_feat
...
Update new anthropic feats as reviewed
2025-11-28 21:06:34 +05:30
abbas jafari
23b737d2a4
Merge branch 'BerriAI:main' into main
2025-11-28 15:28:52 +01:00
abi_jey
4cf7a74e60
fix: Azure OpenAI GA path relies soley on model paramter as deployment
2025-11-28 14:27:57 +00:00
Sameer Kankute
f0d3c96a8d
Add tags and other field in UI logs and add responses api cost tracking
2025-11-28 17:23:15 +05:30
Sameer Kankute
8700c5ced6
Add nova embedding support
2025-11-28 14:56:46 +05:30
v0rtex20k
205a563b65
Allow wildcard routes for nonproxy admin (SCIM) ( #17178 )
...
* checked for wildcards in nonproxy
* ready
2025-11-27 22:10:19 -08:00
Andy Forest
8aa4f3d476
fix(bedrock): handle cohere v4 embed response dictionary format ( #17220 )
2025-11-27 21:50:35 -08:00
Saar wintrov
87050c6a02
SSO: fix the generic SSO provider ( #17227 )
...
* SSO: fix the generic SSO provider
* adding tests
2025-11-27 21:27:23 -08:00
YutaSaito
334d09b3b2
feat: add regex-based tool_name/tool_type matching for tool-permission ( #17164 )
...
* feat: add regex-based tool_name/tool_type matching for tool-permission
* docs: update tool permission quick start for UI workflow
2025-11-27 21:26:27 -08:00
Wei-Chiet Ku
d43c077653
Fix/issue 16759 streaming error validation ( #17242 )
...
* Enhance error handling in OpenAIResponsesAPIConfig to coalesce null error codes into a default string, preventing validation errors and improving stability during streaming iterations.
* Add test for coalescing null error codes in streaming responses
This test ensures that when a streaming error event has error.code set to None, the system correctly transforms it to 'unknown_error' and returns an ErrorEvent instance without raising a ValidationError.
---------
Co-authored-by: Ku Wei Chiet <chietkuw@fpt.com>
2025-11-27 21:24:04 -08:00
Sameer Kankute
71f41352fa
Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support
...
(Bug)Migrate Anthropic provider to azure ai
2025-11-28 08:14:14 +05:30
yuneng-jiang
a33a2cb5b5
Adding timeout to flaky test
2025-11-27 17:53:09 -08:00
yuneng-jiang
bed3006d94
Merge remote-tracking branch 'origin' into litellm_add_model_fix_team_admin
2025-11-27 17:32:09 -08:00
yuneng-jiang
25e2331510
Merge remote-tracking branch 'origin' into litellm_ui_callback_fix
2025-11-27 17:29:29 -08:00
yuneng-jiang
2d9acb2237
Merge remote-tracking branch 'origin' into litellm_non_root_docker_logo_fix
2025-11-27 17:27:47 -08:00
Ishaan Jaff
edfc35ddac
[Feature]: Add Provider publicai.co ( #17230 )
...
* init PublicAIChatConfig
* add publicai
* init public ai
* add publicai
* add publicai/swiss-ai models etc
2025-11-27 13:08:03 -08:00
Ishaan Jaff
38ddd50628
[Bug fix] Vector Store List Endpoint Returns 404 ( #17229 )
...
* fix vector store management
* fix: add vector_store_management_router
* TestVectorStoreManagementEndpointsExist
* fix pass_through
2025-11-27 12:51:51 -08:00
Ishaan Jaff
d612d71ef4
[Feat] Add guardrails for pass through endpoints ( #17221 )
...
* add PassThroughGuardrailsConfig
* init JsonPathExtractor
* feat PassthroughGuardrailHandler
* feat pt guardrails
* pt guardrails
* add Pass-Through Endpoint Guardrail Translation
* add PassThroughEndpointHandler
* execute simple guardrail config and dict settings
* TestPassthroughGuardrailHandlerNormalizeConfig
* add passthrough_guardrails_config on litellm logging obj
* add LiteLLMLoggingObj to base trasaltino
* cleaner _get_guardrail_settings
* update guardrails settings
* docs pt guardrail
* docs Guardrails on Pass-Through Endpoints
* fix typing
* fix typing
* test_no_fields_set_sends_full_body
* fix typing
* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-11-27 12:06:53 -08:00
Sameer Kankute
9669f33b39
fix tests/test_litellm/llms/azure_ai/claude/test_azure_anthropic_handler.py
2025-11-27 22:59:29 +05:30
Sameer Kankute
cf6dda5e29
block input_examples in fucntion definition for non anthropic providers
2025-11-27 22:46:28 +05:30
Ishaan Jaffer
96a0f960a9
test_e2e_batches_files
2025-11-27 09:14:43 -08:00
Ishaan Jaff
31ecd4ce49
Revert "Respect custom llm provider in header" ( #17211 )
2025-11-27 09:12:44 -08:00
Sameer Kankute
83c1138067
Merge pull request #17195 from BerriAI/litellm_respect_custom_llm_header
...
Respect custom llm provider in header
2025-11-27 22:27:42 +05:30
Sameer Kankute
5fc950ec05
migrate anthropic provider to azure ai provider
2025-11-27 19:47:54 +05:30
abbas jafari
af5f31eb9f
Merge branch 'BerriAI:main' into main
2025-11-27 14:46:15 +01:00
Sameer Kankute
1f6d8fc151
Merge pull request #17079 from naaa760/fix/vertex-batch-support
...
fix: support Vertex AI batch listing in LiteLLM proxy
2025-11-27 16:50:17 +05:30
Sameer Kankute
d4bc1cf23d
Respect custom llm provider in header
2025-11-27 16:38:37 +05:30
Sameer Kankute
247160277e
Added support for twelvelabs pegasus
2025-11-27 15:46:04 +05:30
yuneng-jiang
031677636a
Add user writable file to non root docker for logo
2025-11-26 21:44:02 -08:00
Ishaan Jaffer
772be1778a
test_append_system_prompt_messages
2025-11-26 19:00:31 -08:00
Ishaan Jaffer
01fd4d7cef
fix fireworks test
2025-11-26 18:58:32 -08:00
Sameer Kankute
b09c64e4f3
Merge pull request #16874 from BerriAI/litellm_vertex_ai_anthopic_cost_tracking
...
Add cost tracking for streaming in vertex ai passthrough
2025-11-27 08:24:41 +05:30
Krish Dholakia
1cb5fcddba
make generic api OSS + support multiple generic API's ( #17152 )
...
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's
Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967
* feat(callback_utils.py): support custom generic api callbacks
* feat(generic_api_callback.py): support specifying which event types to run the generic api for
* fix(litellm_logging.py): log system prompt for anthropic messages
* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud
* docs(sidebars.js): document new OSS generic api
* docs(generic_api.md): document new OSS Generic API
* docs(custom_webhook_api.md): document custom webhook api integration tutorial
* docs(custom_webhook_api.md): cleanup
* docs(custom_webhook_api.md): document what get's logged to custom webhook api
* Refactor: Pass callback config to GenericAPILogger
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* Fix: Handle empty messages list in logging payload
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* Checkpoint before follow-up message
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* feat: Cache GenericAPILogger instances to improve performance
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-26 18:38:38 -08:00
yuneng-jiang
ac1827cbfc
Merge pull request #17168 from BerriAI/litellm_ui_users_loading
...
[Feature] UI - Better Loading State for Internal User Page
2025-11-26 17:28:40 -08:00
Ishaan Jaffer
0346d1ea23
fix
2025-11-26 17:11:33 -08:00
yuneng-jiang
f0e5921bbd
Add emoji for exact text match
2025-11-26 17:09:07 -08:00
yuneng-jiang
67f9c6cc08
Adjusting e2e tests for new loading state
2025-11-26 16:47:37 -08:00
Ishaan Jaff
379655e16b
[Feat] LiteLLM RAG API - Add support for Vertex RAG engine ( #17117 )
...
* add VertexAIVectorStoreOptions
* Revert "add VertexAIVectorStoreOptions"
This reverts commit b086adf10b
2025-11-26 15:49:04 -08:00
Ishaan Jaffer
ce60453855
test_gemini_get_complete_url
2025-11-26 14:35:03 -08:00
Sameer Kankute
b97ea585b2
Add method for extracting vector store ids from path params ( #16566 )
...
* Add method for extracting vector store ids from path params
* Add vector id handling from path
* Move method to utils
2025-11-26 14:19:30 -08:00
Ishaan Jaff
d987593855
[Feat] Add audio transcriptions for WatsonX ( #17160 )
...
* feat: add IBMWatsonXAudioTranscriptionConfig
* init IBMWatsonXAudioTranscriptionConfig
* add inits
* test_watsonx_transcription_url_and_headers
* docs watsox audio
* docs watsonx audi
* docs
2025-11-26 14:15:49 -08:00
yuneng-jiang
1a9b2d2206
Merge pull request #16560 from BerriAI/litellm_org_usage
...
[Feature] Organization Usage
2025-11-26 13:55:58 -08:00
Ishaan Jaffer
529c56423c
test_opentelemetry_integration
2025-11-26 12:28:47 -08:00
Ishaan Jaffer
44e3133827
test_imagen_get_complete_url
2025-11-26 12:26:49 -08:00
yuneng-jiang
046b5fc27b
Merge remote-tracking branch 'origin' into litellm_org_usage
2025-11-26 12:23:43 -08:00
Ishaan Jaffer
4bf5830106
test fix
2025-11-26 12:07:58 -08:00
Chesars
8c128edb5d
test: add unit tests for BaseModelResponseIterator empty SSE line filtering
...
Tests verify that empty lines between SSE events are properly filtered
and don't produce extra empty chunks in streaming responses.
2025-11-26 17:05:40 -03:00
Ishaan Jaffer
983ada20c3
mock test fixes
2025-11-26 12:02:35 -08:00
