From 90f761946d4acd0b5d35730e33b07b46bb73b9f0 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=E9=B8=A3=E5=B1=B1?= Date: Thu, 24 Jul 2025 12:35:07 +0800 Subject: [PATCH] add experiments data --- README.md | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 1330e35e..40468284 100644 --- a/README.md +++ b/README.md @@ -238,7 +238,16 @@ print(response.json()) ### 🌍 Experiment on Appworld -Coming Soon! Stay tuned for comprehensive evaluation results. +# Qwen3-8B Experimental Results + +We test ExperienceMaker on Appworld with qwen3-8b: + +| Method | best@1 | best@2 | best@4 | +|------------------------------------------|--------|----------|------------| +| w/o ExperienceMaker (baseline) | 0.3561 | 0.4052 | 0.4536 | +| **w ExperienceMaker** | | | | +| [1] extract + compare + recall | **0.4069** | **0.5066** | 0.618 | +| [2] extract + compare + recall + rewrite | 0.3910 | 0.5038 | **0.6211** | ### 🔧 Experiment on BFCL-V3