yuneng-jiang
67f9c6cc08
Adjusting e2e tests for new loading state
2025-11-26 16:47:37 -08:00
Ishaan Jaff
379655e16b
[Feat] LiteLLM RAG API - Add support for Vertex RAG engine ( #17117 )
...
* add VertexAIVectorStoreOptions
* Revert "add VertexAIVectorStoreOptions"
This reverts commit b086adf10b .
* add VertexAIVectorStoreOptions
* add get_rag_ingestion_class
* add VertexAIRAGTransformation
* test ingestion
* docs vertex ai rag engine
2025-11-26 15:49:04 -08:00
Ishaan Jaffer
ce60453855
test_gemini_get_complete_url
2025-11-26 14:35:03 -08:00
Sameer Kankute
b97ea585b2
Add method for extracting vector store ids from path params ( #16566 )
...
* Add method for extracting vector store ids from path params
* Add vector id handling from path
* Move method to utils
2025-11-26 14:19:30 -08:00
Ishaan Jaff
d987593855
[Feat] Add audio transcriptions for WatsonX ( #17160 )
...
* feat: add IBMWatsonXAudioTranscriptionConfig
* init IBMWatsonXAudioTranscriptionConfig
* add inits
* test_watsonx_transcription_url_and_headers
* docs watsox audio
* docs watsonx audi
* docs
2025-11-26 14:15:49 -08:00
yuneng-jiang
1a9b2d2206
Merge pull request #16560 from BerriAI/litellm_org_usage
...
[Feature] Organization Usage
2025-11-26 13:55:58 -08:00
Ishaan Jaffer
529c56423c
test_opentelemetry_integration
2025-11-26 12:28:47 -08:00
Ishaan Jaffer
44e3133827
test_imagen_get_complete_url
2025-11-26 12:26:49 -08:00
yuneng-jiang
046b5fc27b
Merge remote-tracking branch 'origin' into litellm_org_usage
2025-11-26 12:23:43 -08:00
Ishaan Jaffer
4bf5830106
test fix
2025-11-26 12:07:58 -08:00
Chesars
8c128edb5d
test: add unit tests for BaseModelResponseIterator empty SSE line filtering
...
Tests verify that empty lines between SSE events are properly filtered
and don't produce extra empty chunks in streaming responses.
2025-11-26 17:05:40 -03:00
Ishaan Jaffer
983ada20c3
mock test fixes
2025-11-26 12:02:35 -08:00
Ishaan Jaffer
2d70aee0c2
test_edit_mcp_server_redacts_credentials
2025-11-26 11:54:11 -08:00
Ishaan Jaffer
50328d15d4
test_process_chunk_with_response_completed_event
2025-11-26 11:52:05 -08:00
Ishaan Jaffer
6530749c89
test fixes
2025-11-26 11:42:12 -08:00
Ishaan Jaffer
85d4000af6
test_vertex_ai_partner_models_token_counting_endpoint
2025-11-26 11:37:55 -08:00
Ishaan Jaffer
19a6693dfc
test_create_mcp_server_direct
2025-11-26 11:35:23 -08:00
Sameer Kankute
d4e80c6132
Merge pull request #17124 from BerriAI/litellm_gemini_file_search
...
Add gemini file search support
2025-11-26 22:07:11 +05:30
Sameer Kankute
79c1203377
Merge pull request #17129 from BerriAI/litellm_fix_mcp_responses_anthropic
...
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 22:06:59 +05:30
Sameer Kankute
1c317ac316
Merge pull request #17145 from BerriAI/main
...
merge main
2025-11-26 21:48:19 +05:30
Sameer Kankute
9a85ffceff
Fix tests related to mediaResolution
2025-11-26 21:45:50 +05:30
Sameer Kankute
e49f21c918
Make sure that media resolution is only for gemini 3 model
2025-11-26 18:57:57 +05:30
abi_jey
98344417ab
fix: tested e2e implementation and added sample config.
2025-11-26 12:37:13 +00:00
abbas jafari
fdee1e2946
Merge branch 'BerriAI:main' into main
2025-11-26 10:22:13 +01:00
Sameer Kankute
86a9b74fc8
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 13:32:13 +05:30
Sameer Kankute
241ad27843
Add gemini file search support
2025-11-26 11:17:30 +05:30
ripepersimmon
be970735de
feat: Add gemini-3-pro-image-preview model support for imageSize parameters ( #17019 )
...
- Add model identifier to FLASH_IMAGE_PREVIEW_MODEL_IDENTIFIERS
- Add imageSize parameter support (1K, 2K, 4K) with GeminiImageSize type
- Add tests for imageSize parameter transformation
- Update documentation with new model
2025-11-25 19:38:29 -08:00
Igal Boxerman
e6e1e8fca4
feat(pillar): add automatic LiteLLM context headers ( #17076 )
...
- Automatically pass LiteLLM virtual key context as X-LiteLLM-* headers
- Includes key_alias, user_id, team_id, org_id, and user_email
- No configuration required - always enabled for application/user tracking
- Excludes sensitive data (metadata, API tokens) for security
- Add comprehensive tests (30 tests, all passing)
- Update documentation with header details
2025-11-25 19:35:39 -08:00
Carlo Alberto Ferraris
b50fcc4b56
vertex ai: use the correct domain for the global location when counting tokens ( #17116 )
2025-11-25 19:22:20 -08:00
Sameer Kankute
cd65a84abd
Merge pull request #16844 from Chesars/fix/response-format-to-text-format-bridge-conversion
...
fix: Support response_format parameter in completion -> responses bridge
2025-11-26 08:51:09 +05:30
Ishaan Jaff
5c192a23c3
[Feat] Add new RAG API on LiteLLM AI Gateway ( #17109 )
...
* init RAG api types
* add RAG endpoints
* init main.py for RAG ingest API
* init RecursiveCharacterTextSplitter
* add BaseRAGIngestion
* fix OpenAIRAGIngestion
* fix img handler
* init OpenAIRAGIngestion
* init BedrockRAGIngestion
* init BedrockRAGIngestion
* init rag tests
* init BedrockVectorStoreOptions
* implement BedrockRAGIngestion
* add BaseRAGAPI
* add endpoint for RAG ingest
* add ingest RAG endpoints
* add test doc
* add parse_rag_ingest_request
* update endpoints
* docs add docs for new RAG API
* fix qa check
* fix linting
* docs ficx
* docs
* add max depth checks
* docs anthropic
2025-11-25 17:54:29 -08:00
Kerem Turgutlu
8637d74e17
include server_tool_use in streaming usage ( #16826 )
...
* include server_tool_use in streaming usage
* add test
2025-11-25 14:50:17 -08:00
Ishaan Jaff
be712908a3
[Feat] Add OpenAI compatible bedrock imported models. - qwen etc ( #17097 )
...
* test_bedrock_openai_imported_model
* AmazonBedrockOpenAIConfig
* add openai route for bedrock
* docs fix
* fix code qa check
2025-11-25 12:20:39 -08:00
Sameer Kankute
67622fb040
Add day 0 support for anthropic new feat ( #17091 )
...
* Added tool search support for anthropic
* Add programtic tool calling support
* Add tool use input examples support
* Add anthropic effort param support
* Add anthropic effort param support
* Add blog for new features
* fix mypy and lint errors
* fix mypy and lint errors
* fix mypy and lint errors
* fix mypy and lint errors
* Add better handling
* Add better handling
2025-11-25 11:28:47 -08:00
abi_jey
aec0ab777b
feat: add GA protocol as litellm_params for realtime api on azure provider
2025-11-25 19:18:41 +00:00
Sameer Kankute
3249f6dd2d
Merge pull request #17070 from BerriAI/litellm_add_vertex_ai_image_support
...
Add vertex ai image gen support for both gemini and imagen models
2025-11-26 00:04:03 +05:30
Sameer Kankute
83a9dcd2d2
Merge pull request #16886 from BerriAI/litellm_anthopic_azure_support
...
Added support for azure anthopic models via chat completion
2025-11-26 00:03:52 +05:30
Sameer Kankute
59bcf079fb
Merge pull request #17078 from BerriAI/litellm_add_search_logging
...
Add search API logging and cost tracking in LiteLLM Proxy
2025-11-25 23:59:41 +05:30
Sameer Kankute
2e50db81a5
Merge pull request #17071 from BerriAI/litellm_azure_gpt_5_reasoning
...
Fix `reasoning_effort="none"` not working on Azure for GPT-5.1
2025-11-25 23:59:25 +05:30
Krish Dholakia
00e17c81a1
Add enforce user param functionality ( #17088 )
...
* feat: Add reject_metadata_tags to proxy config
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
* Refactor: Rename reject_metadata_tags to reject_clientside_metadata_tags
Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-25 09:36:24 -08:00
Sameer Kankute
e0396e5fa7
Merge pull request #17082 from BerriAI/main
...
merge main
2025-11-25 18:49:52 +05:30
Sameer Kankute
e2f2ccd913
Add tests related messages api
2025-11-25 18:45:51 +05:30
naaa760
2cf86e8ef8
new mocked
2025-11-25 17:28:02 +05:30
Sameer Kankute
67d69d12b0
Add cost tracking and logging support
2025-11-25 17:14:59 +05:30
Sameer Kankute
c149ade6a8
Add tests related to reasoning param none
2025-11-25 13:57:15 +05:30
Sameer Kankute
a50083a87b
Remove none support from reasoning param
2025-11-25 13:56:30 +05:30
Sameer Kankute
883cfaeeaf
Add tests
2025-11-25 13:32:13 +05:30
wcyat
6dcb5425a5
fix(vertex): fix CreateCachedContentRequest enum error ( #16965 )
...
* feat: add _fix_enum_types function to remove enums from non-string fields in schema
* test: add test for _fix_enum_types function to validate enum removal from non-string fields
2025-11-24 21:24:29 -08:00
yuneng-jiang
e629a6b703
Merge remote-tracking branch 'origin' into litellm_org_usage
2025-11-24 21:14:05 -08:00
Dmitrii Komarov
046b7efbbe
Make Bedrock image generation more consistent ( #17021 )
2025-11-24 20:58:01 -08:00