scriptoriumadmin/ReMe
1
0
Fork 0
mirror of https://github.com/agentscope-ai/ReMe.git synced 2026-09-11 22:51:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9

add experiments data

Browse source
This commit is contained in:
鸣山 2025-07-24 12:35:07 +08:00
parent c894d499bd
commit 90f761946d
1 changed files with 10 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

11
README.md
View file

@ -238,7 +238,16 @@ print(response.json())
### 🌍 Experiment on Appworld
Coming Soon! Stay tuned for comprehensive evaluation results.
# Qwen3-8B Experimental Results
We test ExperienceMaker on Appworld with qwen3-8b:
| Method | best@1 | best@2 | best@4 |
|------------------------------------------|--------|----------|------------|
| w/o ExperienceMaker (baseline) | 0.3561 | 0.4052 | 0.4536 |
| **w ExperienceMaker** | | | |
| [1] extract + compare + recall | **0.4069** | **0.5066** | 0.618 |
| [2] extract + compare + recall + rewrite | 0.3910 | 0.5038 | **0.6211** |
### 🔧 Experiment on BFCL-V3