30 commits

Author	SHA1	Message	Date
jinli.yl	862b55f2b0	[dev] rename prepare service function & reformat llm model data struct	2024-06-27 16:43:59 +08:00
jinli.yl	093946e999	[dev] modify test for llm	2024-06-27 14:46:41 +08:00
jinli.yl	3e5ad8f652	[dev] rename Reranker to ranker	2024-06-27 14:12:46 +08:00
hs	6d30e4b18a	[dev] add memoryscope to class path	2024-06-27 12:22:00 +08:00
jinli.yl	1b088fcca2	[dev] add worker_name to workflow	2024-06-27 12:16:49 +08:00
jinli.yl	6b3fb6bbc9	[dev] modify base model registry module	2024-06-26 18:32:55 +08:00
jinli.yl	02bb9718be	[dev] format model response	2024-06-26 18:27:39 +08:00
jinli.yl	7c30c104fd	[dev] add noinspection	2024-06-26 17:57:10 +08:00
xianzhe.xxz	83cdd63a84	rebase master	2024-06-26 13:34:15 +08:00
jinli.yl	0505b04781	[dev] add dummy worker	2024-06-26 10:07:45 +08:00
hs	e84733f810	memory stream & some workers	2024-06-25 19:20:10 +08:00
jinli.yl	322f48117f	[dev] delete asyncio from base model	2024-06-25 12:23:39 +08:00
xianzhe.xxz	160652b600	fix lli embedding	2024-06-24 19:18:05 +08:00
jinli.yl	a1c67d9e40	[dev] modify model response delta	2024-06-24 18:24:40 +08:00
xianzhe.xxz	ffc1c5261d	update module names, add stream support for llm	2024-06-24 18:18:54 +08:00
jinli.yl	0e4310b569	[dev] modify model response format	2024-06-24 16:00:28 +08:00
jinli.yl	31316a9080	[test] add test for llm models	2024-06-24 15:50:29 +08:00
xianzhe.xxz	627a93c10b	add unittest for llm, reranker and embedding	2024-06-24 15:20:13 +08:00
xianzhe.xxz	1887138e47	add async support for lli embedding	2024-06-21 18:49:45 +08:00
xianzhe.xxz	b7d2c7b2b3	add unittest for llm embedding	2024-06-21 18:36:33 +08:00
xianzhe.xxz	dc1e2dab47	update LLILLM	2024-06-21 18:36:33 +08:00
jinli.yl	bccfb4c122	[dev] move worker dirs	2024-06-20 22:18:57 +08:00
jinli.yl	f4e0e6bbc6	[dev] add emb/gene/rank json config	2024-06-19 21:44:41 +08:00
jinli.yl	d628da23a3	[dev] add memory base worker	2024-06-19 14:27:34 +08:00
jinli.yl	3c8fefbc1f	[dev] modify base gene reg class	2024-06-19 11:09:05 +08:00
jinli.yl	9380b2127f	[dev] add base gen/emb model interface	2024-06-19 11:07:23 +08:00
xianzhe.xxz	ae0d9956f3	feat: Resolve conflict, auto committed by CodeFlow	2024-06-18 19:27:56 +08:00
xianzhe.xxz	485abcb966	add llamaindex support	2024-06-18 18:38:14 +08:00
hs	9c79fd95d8	add cli_config & fix api	2024-06-18 16:50:45 +08:00
jinli.yl	3cf388b1a4	[dev] init dir & config	2024-06-17 20:12:58 +08:00