Commit graph

6027 commits

Author SHA1 Message Date
yuneng-jiang
bed3006d94 Merge remote-tracking branch 'origin' into litellm_add_model_fix_team_admin 2025-11-27 17:32:09 -08:00
yuneng-jiang
25e2331510 Merge remote-tracking branch 'origin' into litellm_ui_callback_fix 2025-11-27 17:29:29 -08:00
yuneng-jiang
2d9acb2237 Merge remote-tracking branch 'origin' into litellm_non_root_docker_logo_fix 2025-11-27 17:27:47 -08:00
Ishaan Jaff
edfc35ddac
[Feature]: Add Provider publicai.co (#17230)
* init PublicAIChatConfig

* add publicai

* init public ai

* add publicai

* add publicai/swiss-ai models etc
2025-11-27 13:08:03 -08:00
Ishaan Jaff
38ddd50628
[Bug fix] Vector Store List Endpoint Returns 404 (#17229)
* fix vector store management

* fix: add vector_store_management_router

* TestVectorStoreManagementEndpointsExist

* fix pass_through
2025-11-27 12:51:51 -08:00
Ishaan Jaff
d612d71ef4
[Feat] Add guardrails for pass through endpoints (#17221)
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-11-27 12:06:53 -08:00
Sameer Kankute
9669f33b39 fix tests/test_litellm/llms/azure_ai/claude/test_azure_anthropic_handler.py 2025-11-27 22:59:29 +05:30
Sameer Kankute
cf6dda5e29 block input_examples in fucntion definition for non anthropic providers 2025-11-27 22:46:28 +05:30
Ishaan Jaffer
96a0f960a9 test_e2e_batches_files 2025-11-27 09:14:43 -08:00
Ishaan Jaff
31ecd4ce49
Revert "Respect custom llm provider in header" (#17211) 2025-11-27 09:12:44 -08:00
Sameer Kankute
83c1138067
Merge pull request #17195 from BerriAI/litellm_respect_custom_llm_header
Respect custom llm provider in header
2025-11-27 22:27:42 +05:30
Sameer Kankute
5fc950ec05 migrate anthropic provider to azure ai provider 2025-11-27 19:47:54 +05:30
abbas jafari
af5f31eb9f
Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer Kankute
1f6d8fc151
Merge pull request #17079 from naaa760/fix/vertex-batch-support
fix: support Vertex AI batch listing in LiteLLM proxy
2025-11-27 16:50:17 +05:30
Sameer Kankute
d4bc1cf23d Respect custom llm provider in header 2025-11-27 16:38:37 +05:30
Sameer Kankute
247160277e Added support for twelvelabs pegasus 2025-11-27 15:46:04 +05:30
yuneng-jiang
031677636a Add user writable file to non root docker for logo 2025-11-26 21:44:02 -08:00
Ishaan Jaffer
772be1778a test_append_system_prompt_messages 2025-11-26 19:00:31 -08:00
Ishaan Jaffer
01fd4d7cef fix fireworks test 2025-11-26 18:58:32 -08:00
Sameer Kankute
b09c64e4f3
Merge pull request #16874 from BerriAI/litellm_vertex_ai_anthopic_cost_tracking
Add cost tracking for streaming in vertex ai passthrough
2025-11-27 08:24:41 +05:30
Krish Dholakia
1cb5fcddba
make generic api OSS + support multiple generic API's (#17152)
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's

Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967

* feat(callback_utils.py): support custom generic api callbacks

* feat(generic_api_callback.py): support specifying which event types to run the generic api for

* fix(litellm_logging.py): log system prompt for anthropic messages

* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud

* docs(sidebars.js): document new OSS generic api

* docs(generic_api.md): document new OSS Generic API

* docs(custom_webhook_api.md): document custom webhook api integration tutorial

* docs(custom_webhook_api.md): cleanup

* docs(custom_webhook_api.md): document what get's logged to custom webhook api

* Refactor: Pass callback config to GenericAPILogger

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Handle empty messages list in logging payload

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Checkpoint before follow-up message

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: Cache GenericAPILogger instances to improve performance

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-26 18:38:38 -08:00
yuneng-jiang
ac1827cbfc
Merge pull request #17168 from BerriAI/litellm_ui_users_loading
[Feature] UI - Better Loading State for Internal User Page
2025-11-26 17:28:40 -08:00
Ishaan Jaffer
0346d1ea23 fix 2025-11-26 17:11:33 -08:00
yuneng-jiang
f0e5921bbd Add emoji for exact text match 2025-11-26 17:09:07 -08:00
yuneng-jiang
67f9c6cc08 Adjusting e2e tests for new loading state 2025-11-26 16:47:37 -08:00
Ishaan Jaff
379655e16b
[Feat] LiteLLM RAG API - Add support for Vertex RAG engine (#17117)
* add VertexAIVectorStoreOptions

* Revert "add VertexAIVectorStoreOptions"

This reverts commit b086adf10b.

* add VertexAIVectorStoreOptions

* add get_rag_ingestion_class

* add VertexAIRAGTransformation

* test ingestion

* docs vertex ai rag engine
2025-11-26 15:49:04 -08:00
Ishaan Jaffer
ce60453855 test_gemini_get_complete_url 2025-11-26 14:35:03 -08:00
Sameer Kankute
b97ea585b2
Add method for extracting vector store ids from path params (#16566)
* Add method for extracting vector store ids from path params

* Add vector id handling from path

* Move method to utils
2025-11-26 14:19:30 -08:00
Ishaan Jaff
d987593855
[Feat] Add audio transcriptions for WatsonX (#17160)
* feat: add IBMWatsonXAudioTranscriptionConfig

* init IBMWatsonXAudioTranscriptionConfig

* add inits

* test_watsonx_transcription_url_and_headers

* docs watsox audio

* docs watsonx audi

* docs
2025-11-26 14:15:49 -08:00
yuneng-jiang
1a9b2d2206
Merge pull request #16560 from BerriAI/litellm_org_usage
[Feature] Organization Usage
2025-11-26 13:55:58 -08:00
Ishaan Jaffer
529c56423c test_opentelemetry_integration 2025-11-26 12:28:47 -08:00
Ishaan Jaffer
44e3133827 test_imagen_get_complete_url 2025-11-26 12:26:49 -08:00
yuneng-jiang
046b5fc27b Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-26 12:23:43 -08:00
Ishaan Jaffer
4bf5830106 test fix 2025-11-26 12:07:58 -08:00
Ishaan Jaffer
983ada20c3 mock test fixes 2025-11-26 12:02:35 -08:00
Ishaan Jaffer
2d70aee0c2 test_edit_mcp_server_redacts_credentials 2025-11-26 11:54:11 -08:00
Ishaan Jaffer
50328d15d4 test_process_chunk_with_response_completed_event 2025-11-26 11:52:05 -08:00
Ishaan Jaffer
6530749c89 test fixes 2025-11-26 11:42:12 -08:00
Ishaan Jaffer
85d4000af6 test_vertex_ai_partner_models_token_counting_endpoint 2025-11-26 11:37:55 -08:00
Ishaan Jaffer
19a6693dfc test_create_mcp_server_direct 2025-11-26 11:35:23 -08:00
Sameer Kankute
d4e80c6132
Merge pull request #17124 from BerriAI/litellm_gemini_file_search
Add gemini file search support
2025-11-26 22:07:11 +05:30
Sameer Kankute
79c1203377
Merge pull request #17129 from BerriAI/litellm_fix_mcp_responses_anthropic
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 22:06:59 +05:30
Sameer Kankute
1c317ac316
Merge pull request #17145 from BerriAI/main
merge main
2025-11-26 21:48:19 +05:30
Sameer Kankute
9a85ffceff Fix tests related to mediaResolution 2025-11-26 21:45:50 +05:30
Sameer Kankute
e49f21c918 Make sure that media resolution is only for gemini 3 model 2025-11-26 18:57:57 +05:30
abi_jey
98344417ab fix: tested e2e implementation and added sample config. 2025-11-26 12:37:13 +00:00
abbas jafari
fdee1e2946
Merge branch 'BerriAI:main' into main 2025-11-26 10:22:13 +01:00
Sameer Kankute
86a9b74fc8 Fix Thinking may not be enabled when tool_choice forces tool use 2025-11-26 13:32:13 +05:30
Sameer Kankute
241ad27843 Add gemini file search support 2025-11-26 11:17:30 +05:30
ripepersimmon
be970735de
feat: Add gemini-3-pro-image-preview model support for imageSize parameters (#17019)
- Add model identifier to FLASH_IMAGE_PREVIEW_MODEL_IDENTIFIERS
- Add imageSize parameter support (1K, 2K, 4K) with GeminiImageSize type
- Add tests for imageSize parameter transformation
- Update documentation with new model
2025-11-25 19:38:29 -08:00