yuneng-jiang
031677636a
Add user writable file to non root docker for logo
2025-11-26 21:44:02 -08:00
Ishaan Jaffer
772be1778a
test_append_system_prompt_messages
2025-11-26 19:00:31 -08:00
Ishaan Jaffer
01fd4d7cef
fix fireworks test
2025-11-26 18:58:32 -08:00
Sameer Kankute
b09c64e4f3
Merge pull request #16874 from BerriAI/litellm_vertex_ai_anthopic_cost_tracking
...
Add cost tracking for streaming in vertex ai passthrough
2025-11-27 08:24:41 +05:30
Krish Dholakia
1cb5fcddba
make generic api OSS + support multiple generic API's ( #17152 )
...
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's
Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967
* feat(callback_utils.py): support custom generic api callbacks
* feat(generic_api_callback.py): support specifying which event types to run the generic api for
* fix(litellm_logging.py): log system prompt for anthropic messages
* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud
* docs(sidebars.js): document new OSS generic api
* docs(generic_api.md): document new OSS Generic API
* docs(custom_webhook_api.md): document custom webhook api integration tutorial
* docs(custom_webhook_api.md): cleanup
* docs(custom_webhook_api.md): document what get's logged to custom webhook api
* Refactor: Pass callback config to GenericAPILogger
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* Fix: Handle empty messages list in logging payload
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* Checkpoint before follow-up message
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* feat: Cache GenericAPILogger instances to improve performance
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-26 18:38:38 -08:00
yuneng-jiang
ac1827cbfc
Merge pull request #17168 from BerriAI/litellm_ui_users_loading
...
[Feature] UI - Better Loading State for Internal User Page
2025-11-26 17:28:40 -08:00
Ishaan Jaffer
0346d1ea23
fix
2025-11-26 17:11:33 -08:00
yuneng-jiang
f0e5921bbd
Add emoji for exact text match
2025-11-26 17:09:07 -08:00
yuneng-jiang
67f9c6cc08
Adjusting e2e tests for new loading state
2025-11-26 16:47:37 -08:00
Ishaan Jaff
379655e16b
[Feat] LiteLLM RAG API - Add support for Vertex RAG engine ( #17117 )
...
* add VertexAIVectorStoreOptions
* Revert "add VertexAIVectorStoreOptions"
This reverts commit b086adf10b
2025-11-26 15:49:04 -08:00
Ishaan Jaffer
ce60453855
test_gemini_get_complete_url
2025-11-26 14:35:03 -08:00
Sameer Kankute
b97ea585b2
Add method for extracting vector store ids from path params ( #16566 )
...
* Add method for extracting vector store ids from path params
* Add vector id handling from path
* Move method to utils
2025-11-26 14:19:30 -08:00
Ishaan Jaff
d987593855
[Feat] Add audio transcriptions for WatsonX ( #17160 )
...
* feat: add IBMWatsonXAudioTranscriptionConfig
* init IBMWatsonXAudioTranscriptionConfig
* add inits
* test_watsonx_transcription_url_and_headers
* docs watsox audio
* docs watsonx audi
* docs
2025-11-26 14:15:49 -08:00
yuneng-jiang
1a9b2d2206
Merge pull request #16560 from BerriAI/litellm_org_usage
...
[Feature] Organization Usage
2025-11-26 13:55:58 -08:00
Ishaan Jaffer
529c56423c
test_opentelemetry_integration
2025-11-26 12:28:47 -08:00
Ishaan Jaffer
44e3133827
test_imagen_get_complete_url
2025-11-26 12:26:49 -08:00
yuneng-jiang
046b5fc27b
Merge remote-tracking branch 'origin' into litellm_org_usage
2025-11-26 12:23:43 -08:00
Ishaan Jaffer
4bf5830106
test fix
2025-11-26 12:07:58 -08:00
Chesars
8c128edb5d
test: add unit tests for BaseModelResponseIterator empty SSE line filtering
...
Tests verify that empty lines between SSE events are properly filtered
and don't produce extra empty chunks in streaming responses.
2025-11-26 17:05:40 -03:00
Ishaan Jaffer
983ada20c3
mock test fixes
2025-11-26 12:02:35 -08:00
Ishaan Jaffer
2d70aee0c2
test_edit_mcp_server_redacts_credentials
2025-11-26 11:54:11 -08:00
Ishaan Jaffer
50328d15d4
test_process_chunk_with_response_completed_event
2025-11-26 11:52:05 -08:00
Ishaan Jaffer
6530749c89
test fixes
2025-11-26 11:42:12 -08:00
Ishaan Jaffer
85d4000af6
test_vertex_ai_partner_models_token_counting_endpoint
2025-11-26 11:37:55 -08:00
Ishaan Jaffer
19a6693dfc
test_create_mcp_server_direct
2025-11-26 11:35:23 -08:00
Sameer Kankute
d4e80c6132
Merge pull request #17124 from BerriAI/litellm_gemini_file_search
...
Add gemini file search support
2025-11-26 22:07:11 +05:30
Sameer Kankute
79c1203377
Merge pull request #17129 from BerriAI/litellm_fix_mcp_responses_anthropic
...
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 22:06:59 +05:30
Sameer Kankute
1c317ac316
Merge pull request #17145 from BerriAI/main
...
merge main
2025-11-26 21:48:19 +05:30
Sameer Kankute
9a85ffceff
Fix tests related to mediaResolution
2025-11-26 21:45:50 +05:30
Sameer Kankute
e49f21c918
Make sure that media resolution is only for gemini 3 model
2025-11-26 18:57:57 +05:30
abi_jey
98344417ab
fix: tested e2e implementation and added sample config.
2025-11-26 12:37:13 +00:00
abbas jafari
fdee1e2946
Merge branch 'BerriAI:main' into main
2025-11-26 10:22:13 +01:00
Sameer Kankute
86a9b74fc8
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 13:32:13 +05:30
Sameer Kankute
241ad27843
Add gemini file search support
2025-11-26 11:17:30 +05:30
ripepersimmon
be970735de
feat: Add gemini-3-pro-image-preview model support for imageSize parameters ( #17019 )
...
- Add model identifier to FLASH_IMAGE_PREVIEW_MODEL_IDENTIFIERS
- Add imageSize parameter support (1K, 2K, 4K) with GeminiImageSize type
- Add tests for imageSize parameter transformation
- Update documentation with new model
2025-11-25 19:38:29 -08:00
Igal Boxerman
e6e1e8fca4
feat(pillar): add automatic LiteLLM context headers ( #17076 )
...
- Automatically pass LiteLLM virtual key context as X-LiteLLM-* headers
- Includes key_alias, user_id, team_id, org_id, and user_email
- No configuration required - always enabled for application/user tracking
- Excludes sensitive data (metadata, API tokens) for security
- Add comprehensive tests (30 tests, all passing)
- Update documentation with header details
2025-11-25 19:35:39 -08:00
Carlo Alberto Ferraris
b50fcc4b56
vertex ai: use the correct domain for the global location when counting tokens ( #17116 )
2025-11-25 19:22:20 -08:00
Sameer Kankute
cd65a84abd
Merge pull request #16844 from Chesars/fix/response-format-to-text-format-bridge-conversion
...
fix: Support response_format parameter in completion -> responses bridge
2025-11-26 08:51:09 +05:30
Ishaan Jaff
5c192a23c3
[Feat] Add new RAG API on LiteLLM AI Gateway ( #17109 )
...
* init RAG api types
* add RAG endpoints
* init main.py for RAG ingest API
* init RecursiveCharacterTextSplitter
* add BaseRAGIngestion
* fix OpenAIRAGIngestion
* fix img handler
* init OpenAIRAGIngestion
* init BedrockRAGIngestion
* init BedrockRAGIngestion
* init rag tests
* init BedrockVectorStoreOptions
* implement BedrockRAGIngestion
* add BaseRAGAPI
* add endpoint for RAG ingest
* add ingest RAG endpoints
* add test doc
* add parse_rag_ingest_request
* update endpoints
* docs add docs for new RAG API
* fix qa check
* fix linting
* docs ficx
* docs
* add max depth checks
* docs anthropic
2025-11-25 17:54:29 -08:00
Kerem Turgutlu
8637d74e17
include server_tool_use in streaming usage ( #16826 )
...
* include server_tool_use in streaming usage
* add test
2025-11-25 14:50:17 -08:00
Ishaan Jaff
be712908a3
[Feat] Add OpenAI compatible bedrock imported models. - qwen etc ( #17097 )
...
* test_bedrock_openai_imported_model
* AmazonBedrockOpenAIConfig
* add openai route for bedrock
* docs fix
* fix code qa check
2025-11-25 12:20:39 -08:00
Sameer Kankute
67622fb040
Add day 0 support for anthropic new feat ( #17091 )
...
* Added tool search support for anthropic
* Add programtic tool calling support
* Add tool use input examples support
* Add anthropic effort param support
* Add anthropic effort param support
* Add blog for new features
* fix mypy and lint errors
* fix mypy and lint errors
* fix mypy and lint errors
* fix mypy and lint errors
* Add better handling
* Add better handling
2025-11-25 11:28:47 -08:00
abi_jey
aec0ab777b
feat: add GA protocol as litellm_params for realtime api on azure provider
2025-11-25 19:18:41 +00:00
Sameer Kankute
3249f6dd2d
Merge pull request #17070 from BerriAI/litellm_add_vertex_ai_image_support
...
Add vertex ai image gen support for both gemini and imagen models
2025-11-26 00:04:03 +05:30
Sameer Kankute
83a9dcd2d2
Merge pull request #16886 from BerriAI/litellm_anthopic_azure_support
...
Added support for azure anthopic models via chat completion
2025-11-26 00:03:52 +05:30
Sameer Kankute
59bcf079fb
Merge pull request #17078 from BerriAI/litellm_add_search_logging
...
Add search API logging and cost tracking in LiteLLM Proxy
2025-11-25 23:59:41 +05:30
Sameer Kankute
2e50db81a5
Merge pull request #17071 from BerriAI/litellm_azure_gpt_5_reasoning
...
Fix `reasoning_effort="none"` not working on Azure for GPT-5.1
2025-11-25 23:59:25 +05:30
Krish Dholakia
00e17c81a1
Add enforce user param functionality ( #17088 )
...
* feat: Add reject_metadata_tags to proxy config
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* Refactor: Rename reject_metadata_tags to reject_clientside_metadata_tags
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-25 09:36:24 -08:00
Sameer Kankute
e0396e5fa7
Merge pull request #17082 from BerriAI/main
...
merge main
2025-11-25 18:49:52 +05:30
Sameer Kankute
e2f2ccd913
Add tests related messages api
2025-11-25 18:45:51 +05:30
