Chesars
8c128edb5d
test: add unit tests for BaseModelResponseIterator empty SSE line filtering
...
Tests verify that empty lines between SSE events are properly filtered
and don't produce extra empty chunks in streaming responses.
2025-11-26 17:05:40 -03:00
Chesars
16a7e0ce8f
fix: filter empty SSE lines in BaseModelResponseIterator to prevent extra empty chunks
...
When streaming with stream_options={"include_usage": True}, xAI and other
providers using BaseLLMHTTPHandler were returning an extra empty chunk after
the usage chunk. This was caused by empty SSE lines (separators between events)
being processed as empty GenericStreamingChunks.
The fix adds a loop in __next__ and __anext__ to skip empty lines before
processing, ensuring only meaningful SSE data events are converted to chunks.
Fixes #17136
2025-11-26 17:01:23 -03:00
yuneng-jiang
f0d1f2d2b4
Merge pull request #17123 from BerriAI/litellm_ui_model_page_perf
...
[Infra] UI - Migrate modelInfoCall to ReactQuery
2025-11-26 10:12:09 -08:00
yuneng-jiang
ba71d10398
Merge conflicts
2025-11-26 09:08:17 -08:00
yuneng-jiang
ce65663ad1
Merge remote-tracking branch 'origin' into litellm_ui_model_page_perf
2025-11-26 09:06:43 -08:00
Sameer Kankute
1db434348d
Merge pull request #17135 from BerriAI/litellm_add_missing_passthrough_fields
...
Add missing standard logging object fields
2025-11-26 22:07:28 +05:30
Sameer Kankute
d4e80c6132
Merge pull request #17124 from BerriAI/litellm_gemini_file_search
...
Add gemini file search support
2025-11-26 22:07:11 +05:30
Sameer Kankute
79c1203377
Merge pull request #17129 from BerriAI/litellm_fix_mcp_responses_anthropic
...
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 22:06:59 +05:30
Sameer Kankute
3c2623e38f
Merge pull request #17125 from BerriAI/litellm_fix_videos_lint
...
Fix videos lint errors
2025-11-26 17:06:54 +05:30
Sameer Kankute
448b07a213
Fix db logging for proxy
2025-11-26 17:01:19 +05:30
Sameer Kankute
fcf9ab4f7f
Add embed-multilingual-light-v3.0 costing
2025-11-26 16:12:34 +05:30
Sameer Kankute
effebdab38
Add custom llm provider in vertex ai embeddings
2025-11-26 15:29:05 +05:30
Sameer Kankute
86a9b74fc8
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 13:32:13 +05:30
Sameer Kankute
31c3913f46
Fix videos lint errors
2025-11-26 11:31:11 +05:30
Sameer Kankute
c1636bdb92
Fix mypy and lint error
2025-11-26 11:24:11 +05:30
Sameer Kankute
241ad27843
Add gemini file search support
2025-11-26 11:17:30 +05:30
yuneng-jiang
38bac312cd
Merge pull request #17110 from BerriAI/litellm_org_admin_access_fix
...
[Feature] UI - Org Admin Team Permissions Fix
2025-11-25 21:36:01 -08:00
yuneng-jiang
6c79240cd6
Merge pull request #17108 from BerriAI/litellm_user_table_sort_ui
...
[Feature] UI - User Table Sort by All
2025-11-25 21:35:27 -08:00
yuneng-jiang
e9ab20631f
Merge pull request #17098 from BerriAI/litellm_broken_links_ui
...
[Feature] UI - Disable edit, delete, info, for dynamically generated spend tags
2025-11-25 21:34:39 -08:00
yuneng-jiang
50dea2600f
Tests and revert useAvailableModels
2025-11-25 21:23:24 -08:00
yuneng-jiang
cb1809987d
Migrate some queries to use react query, tests pending
2025-11-25 21:00:41 -08:00
ripepersimmon
be970735de
feat: Add gemini-3-pro-image-preview model support for imageSize parameters ( #17019 )
...
- Add model identifier to FLASH_IMAGE_PREVIEW_MODEL_IDENTIFIERS
- Add imageSize parameter support (1K, 2K, 4K) with GeminiImageSize type
- Add tests for imageSize parameter transformation
- Update documentation with new model
2025-11-25 19:38:29 -08:00
Carlo Alberto Ferraris
a727f71b19
Optimize date filtering for spend logs queries ( #17073 )
...
This should allow postgres to perform a more efficient index scan instead of a sequential table scan.
These two queries consistently show up in the longest-running ones in our instance, and are a major latency source for the usage page on the admin UI.
2025-11-25 19:36:25 -08:00
Igal Boxerman
e6e1e8fca4
feat(pillar): add automatic LiteLLM context headers ( #17076 )
...
- Automatically pass LiteLLM virtual key context as X-LiteLLM-* headers
- Includes key_alias, user_id, team_id, org_id, and user_email
- No configuration required - always enabled for application/user tracking
- Excludes sensitive data (metadata, API tokens) for security
- Add comprehensive tests (30 tests, all passing)
- Update documentation with header details
2025-11-25 19:35:39 -08:00
Alexsander Hamir
7c09187daf
downgrade grpcio ( #17090 )
2025-11-25 19:33:24 -08:00
yuneng-jiang
7227747a6f
Improve Wording for Config Models in Model Table ( #17100 )
2025-11-25 19:25:23 -08:00
Carlo Alberto Ferraris
b50fcc4b56
vertex ai: use the correct domain for the global location when counting tokens ( #17116 )
2025-11-25 19:22:20 -08:00
Sameer Kankute
cd65a84abd
Merge pull request #16844 from Chesars/fix/response-format-to-text-format-bridge-conversion
...
fix: Support response_format parameter in completion -> responses bridge
2025-11-26 08:51:09 +05:30
yuneng-jiang
577f40bc60
ProviderLogo component, test pending
2025-11-25 18:05:30 -08:00
Ishaan Jaff
5c192a23c3
[Feat] Add new RAG API on LiteLLM AI Gateway ( #17109 )
...
* init RAG api types
* add RAG endpoints
* init main.py for RAG ingest API
* init RecursiveCharacterTextSplitter
* add BaseRAGIngestion
* fix OpenAIRAGIngestion
* fix img handler
* init OpenAIRAGIngestion
* init BedrockRAGIngestion
* init BedrockRAGIngestion
* init rag tests
* init BedrockVectorStoreOptions
* implement BedrockRAGIngestion
* add BaseRAGAPI
* add endpoint for RAG ingest
* add ingest RAG endpoints
* add test doc
* add parse_rag_ingest_request
* update endpoints
* docs add docs for new RAG API
* fix qa check
* fix linting
* docs ficx
* docs
* add max depth checks
* docs anthropic
2025-11-25 17:54:29 -08:00
yuneng-jiang
5ec3f19a53
Make model select required for team, add checks for all-proxy-models
2025-11-25 16:57:38 -08:00
Otavio Brito
6e5c7c0008
fix transcription exception handling - /audio/transcriptions ( #16791 )
...
* fix transcription exception handling
* reraise the exception
2025-11-25 16:41:35 -08:00
Krrish Dholakia
5cb5c2a7b7
docs: more doc cleanup
2025-11-25 16:04:27 -08:00
Krrish Dholakia
8ee6812edf
docs: cleanup launch post
2025-11-25 15:58:51 -08:00
yuneng-jiang
3da9974a87
Tests
2025-11-25 15:54:55 -08:00
Krrish Dholakia
70a1325847
docs: more doc cleanup
2025-11-25 15:01:22 -08:00
Kerem Turgutlu
8637d74e17
include server_tool_use in streaming usage ( #16826 )
...
* include server_tool_use in streaming usage
* add test
2025-11-25 14:50:17 -08:00
Sam Chou
c0288d81aa
Fix bedrock claude opus 4.5 inference profile - only global currently ( #17101 )
2025-11-25 14:49:12 -08:00
yuneng-jiang
db587926a4
Sorting changes, pending tests and loading state
2025-11-25 14:46:46 -08:00
Krrish Dholakia
f3d5775920
fix: fix doc load issue
2025-11-25 14:40:26 -08:00
YutaSaito
52f1bf1a80
fix: missing await ( #17103 )
2025-11-25 14:33:38 -08:00
Ishaan Jaff
be712908a3
[Feat] Add OpenAI compatible bedrock imported models. - qwen etc ( #17097 )
...
* test_bedrock_openai_imported_model
* AmazonBedrockOpenAIConfig
* add openai route for bedrock
* docs fix
* fix code qa check
2025-11-25 12:20:39 -08:00
yuneng-jiang
44cde2e48f
Disable edit, delete, info, for dynamically generated spend tags
2025-11-25 12:03:01 -08:00
Krrish Dholakia
db2c8e3631
docs: initial doc cleanup
2025-11-25 11:57:51 -08:00
Sameer Kankute
67622fb040
Add day 0 support for anthropic new feat ( #17091 )
...
* Added tool search support for anthropic
* Add programtic tool calling support
* Add tool use input examples support
* Add anthropic effort param support
* Add anthropic effort param support
* Add blog for new features
* fix mypy and lint errors
* fix mypy and lint errors
* fix mypy and lint errors
* fix mypy and lint errors
* Add better handling
* Add better handling
2025-11-25 11:28:47 -08:00
Sameer Kankute
3249f6dd2d
Merge pull request #17070 from BerriAI/litellm_add_vertex_ai_image_support
...
Add vertex ai image gen support for both gemini and imagen models
2025-11-26 00:04:03 +05:30
Sameer Kankute
83a9dcd2d2
Merge pull request #16886 from BerriAI/litellm_anthopic_azure_support
...
Added support for azure anthopic models via chat completion
2025-11-26 00:03:52 +05:30
Sameer Kankute
59b4b9a07c
fix documentation of anthropic azure
2025-11-26 00:02:48 +05:30
Sameer Kankute
59bcf079fb
Merge pull request #17078 from BerriAI/litellm_add_search_logging
...
Add search API logging and cost tracking in LiteLLM Proxy
2025-11-25 23:59:41 +05:30
Sameer Kankute
2e50db81a5
Merge pull request #17071 from BerriAI/litellm_azure_gpt_5_reasoning
...
Fix `reasoning_effort="none"` not working on Azure for GPT-5.1
2025-11-25 23:59:25 +05:30
