10 commits

Author	SHA1	Message	Date
hs	e84733f810	memory stream & some workers	2024-06-25 19:20:10 +08:00
jinli.yl	322f48117f	[dev] delete asyncio from base model	2024-06-25 12:23:39 +08:00
jinli.yl	a1c67d9e40	[dev] modify model response delta	2024-06-24 18:24:40 +08:00
xianzhe.xxz	ffc1c5261d	update module names, add stream support for llm	2024-06-24 18:18:54 +08:00
jinli.yl	0e4310b569	[dev] modify model response format	2024-06-24 16:00:28 +08:00
jinli.yl	31316a9080	[test] add test for llm models	2024-06-24 15:50:29 +08:00
xianzhe.xxz	b7d2c7b2b3	add unittest for llm embedding	2024-06-21 18:36:33 +08:00
xianzhe.xxz	dc1e2dab47	update LLILLM	2024-06-21 18:36:33 +08:00
jinli.yl	d628da23a3	[dev] add memory base worker	2024-06-19 14:27:34 +08:00
jinli.yl	9380b2127f	[dev] add base gen/emb model interface	2024-06-19 11:07:23 +08:00