From f4ad4f8328492de324b441061263bbb7280a4969 Mon Sep 17 00:00:00 2001 From: dengjiaji Date: Thu, 31 Jul 2025 20:40:52 +0800 Subject: [PATCH] update table format --- README.md | 42 +++++++++++++++++++++++++----------------- 1 file changed, 25 insertions(+), 17 deletions(-) diff --git a/README.md b/README.md index 2de4fd61..01c5d2bf 100644 --- a/README.md +++ b/README.md @@ -19,7 +19,6 @@ --- ## 📰 What's New -- **[2025-08]** 👉 Access experiences directly through the library, and contribute to expand our expertise pool👉[TODO]() - **[2025-08]** 🚀 MCP is now available! → [Quick Start Guide](./doc/mcp_quick_start.md) - **[2025-07]** 🎉 ExperienceMaker v0.1.1 is now available on [PyPI](https://pypi.org/project/experiencemaker/)! - **[2025-07]** 📚 Complete documentation and quick start guides released @@ -483,7 +482,7 @@ We test ExperienceMaker on Appworld with qwen3-8b: |--------------------------------|-----------|-------------|-----------| | w/o ExperienceMaker (baseline) | 0.083 | 0.140 | 0.228 | | **w ExperienceMaker** | | | | -| experience(Direct Use) | **0.109** | **0.175** | **0.281** | +|experience(Direct Use) | **0.109** | **0.175** | **0.281** | Pass@K measures the probability that at least one out of K generated samples successfully completes the task (achieves score=1). The current experiments use an internal AppWorld environment which may have slight discrepancies, and we will soon update with experimental results from the standard AppWorld environment. @@ -492,25 +491,34 @@ You may find more details to reproduce this experiment in [quickstart.md](cookbo ### 🧊 Experiment on Frozenlake - - - - - - - - - + +
Without ExperienceWith Experience
without experiencewith experience
+ + + + + + + + + + + +
without experiencewith experience
+ GIF 1 + + GIF 2 +
We test on 100 random frozenlake map with qwen3-8b: -| Method | pass rate | -|--------------------------------|------------------| +| Method | pass rate | +|-------------------------------|------------------| | w/o ExperienceMaker (baseline) | 0.66 | -| **w ExperienceMaker** | | -| [1] experience(Direct Use) | 0.72 **(+9.1%)** | -| [2] experience(LLM Rewritten) | 0.72 **(+9.1%)** | +| **w ExperienceMaker** | | +| [1] experience(Direct Use) | 0.72 **(+9.1%)** | +| [2] experience(LLM Rewritten) | 0.72 **(+9.1%)** | We also noticed that in such simple scenarios, not using LLM rewriting may actually yield better results. @@ -530,7 +538,7 @@ Coming Soon! Stay tuned for comprehensive evaluation results. --- -## 🏪 Pre-built Experience Libraries +## 🏪 Ready-made Experience Store ExperienceMaker provides pre-built experience libraries to jumpstart your agent's capabilities. You can directly load these curated experiences into your workspace and start benefiting from accumulated knowledge