Commit graph

42355 commits

Author SHA1 Message Date
Chesars
8c128edb5d test: add unit tests for BaseModelResponseIterator empty SSE line filtering
Tests verify that empty lines between SSE events are properly filtered
and don't produce extra empty chunks in streaming responses.
2025-11-26 17:05:40 -03:00
Ishaan Jaffer
2548c89042 code qa check 2025-11-26 12:04:12 -08:00
Ishaan Jaffer
983ada20c3 mock test fixes 2025-11-26 12:02:35 -08:00
Chesars
16a7e0ce8f fix: filter empty SSE lines in BaseModelResponseIterator to prevent extra empty chunks
When streaming with stream_options={"include_usage": True}, xAI and other
providers using BaseLLMHTTPHandler were returning an extra empty chunk after
the usage chunk. This was caused by empty SSE lines (separators between events)
being processed as empty GenericStreamingChunks.

The fix adds a loop in __next__ and __anext__ to skip empty lines before
processing, ensuring only meaningful SSE data events are converted to chunks.

Fixes #17136
2025-11-26 17:01:23 -03:00
Ishaan Jaffer
2d70aee0c2 test_edit_mcp_server_redacts_credentials 2025-11-26 11:54:11 -08:00
Ishaan Jaffer
a48705bfaf fix code QA checks 2025-11-26 11:53:58 -08:00
Ishaan Jaffer
50328d15d4 test_process_chunk_with_response_completed_event 2025-11-26 11:52:05 -08:00
Alexsander Hamir
ff53a7555c
Merge branch 'main' into litellm_refactor_01 2025-11-26 11:50:18 -08:00
Ishaan Jaffer
3c3725db92 bump extras 2025-11-26 11:47:29 -08:00
Ishaan Jaffer
203df982e8 fix pyproject 2025-11-26 11:47:13 -08:00
Ishaan Jaffer
6530749c89 test fixes 2025-11-26 11:42:12 -08:00
Ishaan Jaffer
c7746eb58f bump proxy extras 2025-11-26 11:40:06 -08:00
Ishaan Jaffer
42376330ba add DEFAULT_CHUNK_OVERLAP, DEFAULT_CHUNK_SIZE 2025-11-26 11:39:24 -08:00
Ishaan Jaffer
72f8e5f9a3 bump litellm proxy extras 2025-11-26 11:39:09 -08:00
Ishaan Jaffer
85d4000af6 test_vertex_ai_partner_models_token_counting_endpoint 2025-11-26 11:37:55 -08:00
Ishaan Jaffer
19a6693dfc test_create_mcp_server_direct 2025-11-26 11:35:23 -08:00
Ishaan Jaffer
8d2dba8cac fix code qa checks 2025-11-26 11:34:22 -08:00
Ishaan Jaff
0f59e5fa3a
add fireworks_ai/accounts/fireworks/models/glm-4p6 (#17154) 2025-11-26 11:28:28 -08:00
yuneng-jiang
13848530b7 Revert "test fixes"
This reverts commit 40c21c4081.
2025-11-26 11:27:06 -08:00
Ishaan Jaff
99d0f130ad
fix api_key (#17153) 2025-11-26 11:17:11 -08:00
yuneng-jiang
40c21c4081 test fixes 2025-11-26 11:14:27 -08:00
Ishaan Jaffer
4d87ac04c0 Revert "add VertexAIVectorStoreOptions"
This reverts commit b086adf10b.
2025-11-26 11:09:39 -08:00
Ishaan Jaffer
016625bc5f add VertexAIVectorStoreOptions 2025-11-26 11:09:39 -08:00
yuneng-jiang
5b645d5f2f Update spend logs writer to add organization_id 2025-11-26 10:32:49 -08:00
yuneng-jiang
f0d1f2d2b4
Merge pull request #17123 from BerriAI/litellm_ui_model_page_perf
[Infra] UI - Migrate modelInfoCall to ReactQuery
2025-11-26 10:12:09 -08:00
yuneng-jiang
ba71d10398 Merge conflicts 2025-11-26 09:08:17 -08:00
yuneng-jiang
ce65663ad1 Merge remote-tracking branch 'origin' into litellm_ui_model_page_perf 2025-11-26 09:06:43 -08:00
Alexsander Hamir
eacf20fddb
Merge branch 'main' into litellm_refactor_01 2025-11-26 08:56:40 -08:00
Sameer Kankute
1db434348d
Merge pull request #17135 from BerriAI/litellm_add_missing_passthrough_fields
Add missing standard logging object fields
2025-11-26 22:07:28 +05:30
Sameer Kankute
d4e80c6132
Merge pull request #17124 from BerriAI/litellm_gemini_file_search
Add gemini file search support
2025-11-26 22:07:11 +05:30
Sameer Kankute
79c1203377
Merge pull request #17129 from BerriAI/litellm_fix_mcp_responses_anthropic
Fix Thinking may not be enabled when tool_choice forces tool use
2025-11-26 22:06:59 +05:30
Sameer Kankute
cdb9b60604
Merge pull request #17146 from BerriAI/main
merge main
2025-11-26 22:02:14 +05:30
Sameer Kankute
1c317ac316
Merge pull request #17145 from BerriAI/main
merge main
2025-11-26 21:48:19 +05:30
Sameer Kankute
9a85ffceff Fix tests related to mediaResolution 2025-11-26 21:45:50 +05:30
Sameer Kankute
c7ef668d78 Update documentation for azure 4 feats 2025-11-26 21:18:47 +05:30
Sameer Kankute
dba9946b98 Update new feats as reviewed 2025-11-26 21:04:15 +05:30
abi_jey
a40c6ae0c0 fix: remove the unnecessary config changes 2025-11-26 13:33:52 +00:00
Sameer Kankute
e49f21c918 Make sure that media resolution is only for gemini 3 model 2025-11-26 18:57:57 +05:30
abbas jafari
b009e50927
Merge branch 'BerriAI:main' into main 2025-11-26 13:40:21 +01:00
abi_jey
98344417ab fix: tested e2e implementation and added sample config. 2025-11-26 12:37:13 +00:00
Sameer Kankute
3c2623e38f
Merge pull request #17125 from BerriAI/litellm_fix_videos_lint
Fix videos lint errors
2025-11-26 17:06:54 +05:30
Sameer Kankute
448b07a213 Fix db logging for proxy 2025-11-26 17:01:19 +05:30
Sameer Kankute
fcf9ab4f7f Add embed-multilingual-light-v3.0 costing 2025-11-26 16:12:34 +05:30
Sameer Kankute
effebdab38 Add custom llm provider in vertex ai embeddings 2025-11-26 15:29:05 +05:30
abbas jafari
fdee1e2946
Merge branch 'BerriAI:main' into main 2025-11-26 10:22:13 +01:00
Sameer Kankute
86a9b74fc8 Fix Thinking may not be enabled when tool_choice forces tool use 2025-11-26 13:32:13 +05:30
Sameer Kankute
31c3913f46 Fix videos lint errors 2025-11-26 11:31:11 +05:30
Sameer Kankute
c1636bdb92 Fix mypy and lint error 2025-11-26 11:24:11 +05:30
Sameer Kankute
241ad27843 Add gemini file search support 2025-11-26 11:17:30 +05:30
yuneng-jiang
38bac312cd
Merge pull request #17110 from BerriAI/litellm_org_admin_access_fix
[Feature] UI - Org Admin Team Permissions Fix
2025-11-25 21:36:01 -08:00