mirror of
https://github.com/open-webui/open-webui.git
synced 2026-09-16 23:43:03 +00:00
89716ea880
* perf: stop scanning every socket.io payload for binary data Every socket.io event the backend sends was first walked recursively to check whether any value was a bytes object needing binary attachment framing. Open WebUI never emits binary, so the walk always came back empty and the work was thrown away. It has no early exit and allocates at every level, so it scaled with the full size of the message, and the messages are the big ones: chat streaming re-emits the whole assistant message on every update, note collaboration sends document state as a JSON array with one entry per byte. With the Redis manager it ran once per instance per emit on top of that, since every instance builds its own copy of the packet. The server now installs a Packet subclass with binary events off, through python-socketio's own serializer hook, the same mechanism its msgpack serializer uses. Inbound binary attachments are decoded to int lists rather than refused, so the one frontend path that sends a raw Uint8Array keeps working and handlers can still echo client data straight back out. One scan remains in multi-instance setups: python-socketio's Redis manager calls it on the base Packet class directly, where the serializer hook cannot reach. Measured per encode: | payload | before | after | |---|---|---| | chat completion re-emit (7.5 KB JSON) | 30 us | 13 us | | collaborative document state (292 KB JSON) | 9.0 ms | 1.7 ms | With ENABLE_ORJSON=true, where the scan is nearly the whole encode cost: 20 us to 2.3 us, and 7.8 ms to 0.14 ms. Closes #28164 * fix: match the other Yjs emits and send the full state as an array Collaboration.ts sent the initial full-document state as a raw Uint8Array while the other two Yjs emit sites convert with Array.from first. socket.io framed that one as a binary attachment, so with the JSON-only packet class the server turns it into a list of ints and re-broadcasts it as JSON: a 10240-byte state update becomes 36561 JSON characters. Converting at the emit site keeps the wire form uniform across all three sites. Also trims the JSONOnlyPacket docstring, which claimed attachments already arrive as int lists when the override is what converts them, and annotates the new reconstruct_binary parameters. |
||
|---|---|---|
| .. | ||
| RichTextInput | ||
| Tags | ||
| Valves | ||
| AccessButton.svelte | ||
| Badge.svelte | ||
| Banner.svelte | ||
| ChatList.svelte | ||
| Checkbox.svelte | ||
| CodeEditor.svelte | ||
| CodeEditorModal.svelte | ||
| Collapsible.svelte | ||
| ConfirmDialog.svelte | ||
| DocxPreview.svelte | ||
| DragGhost.svelte | ||
| Drawer.svelte | ||
| Dropdown.svelte | ||
| DropdownMenu.svelte | ||
| DropdownOptions.svelte | ||
| DropdownSub.svelte | ||
| Emoji.svelte | ||
| EmojiPicker.svelte | ||
| ExperimentalBadge.svelte | ||
| FileItem.svelte | ||
| FileItemModal.svelte | ||
| Folder.svelte | ||
| FullHeightIframe.svelte | ||
| HotkeyHint.svelte | ||
| Image.svelte | ||
| ImagePreview.svelte | ||
| InputModal.svelte | ||
| InterfaceSettings.svelte | ||
| Loader.svelte | ||
| Marquee.svelte | ||
| MobileSwipePanel.svelte | ||
| Modal.svelte | ||
| MultiSelect.svelte | ||
| NativeSelect.svelte | ||
| Overlay.svelte | ||
| Pagination.svelte | ||
| PanzoomContainer.svelte | ||
| PdfPagesPreview.svelte | ||
| PDFViewer.svelte | ||
| PptxPreview.svelte | ||
| ResizableSidePanel.svelte | ||
| RichTextInput.svelte | ||
| Select.svelte | ||
| Selector.svelte | ||
| SensitiveInput.svelte | ||
| SettingsSelect.svelte | ||
| Sidebar.svelte | ||
| SlideShow.svelte | ||
| Spinner.svelte | ||
| SplitCreateButton.svelte | ||
| SVGPanZoom.svelte | ||
| Switch.svelte | ||
| Tags.svelte | ||
| Textarea.svelte | ||
| ToolCallDisplay.svelte | ||
| Tooltip.svelte | ||
| Valves.svelte | ||