From 520b5019807eaf10e34eb00d2de81ebc27b359ca Mon Sep 17 00:00:00 2001 From: "jinli.yl" Date: Thu, 31 Jul 2025 20:38:06 +0800 Subject: [PATCH] add doc url --- README.md | 28 ++++++++++++++++++---------- 1 file changed, 18 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 71a01f68..2de4fd61 100644 --- a/README.md +++ b/README.md @@ -19,6 +19,7 @@ --- ## 📰 What's New +- **[2025-08]** 👉 Access experiences directly through the library, and contribute to expand our expertise pool👉[TODO]() - **[2025-08]** 🚀 MCP is now available! → [Quick Start Guide](./doc/mcp_quick_start.md) - **[2025-07]** 🎉 ExperienceMaker v0.1.1 is now available on [PyPI](https://pypi.org/project/experiencemaker/)! - **[2025-07]** 📚 Complete documentation and quick start guides released @@ -482,7 +483,7 @@ We test ExperienceMaker on Appworld with qwen3-8b: |--------------------------------|-----------|-------------|-----------| | w/o ExperienceMaker (baseline) | 0.083 | 0.140 | 0.228 | | **w ExperienceMaker** | | | | -|experience(Direct Use) | **0.109** | **0.175** | **0.281** | +| experience(Direct Use) | **0.109** | **0.175** | **0.281** | Pass@K measures the probability that at least one out of K generated samples successfully completes the task (achieves score=1). The current experiments use an internal AppWorld environment which may have slight discrepancies, and we will soon update with experimental results from the standard AppWorld environment. @@ -491,18 +492,25 @@ You may find more details to reproduce this experiment in [quickstart.md](cookbo ### 🧊 Experiment on Frozenlake -| without experience | with experience | -|:----------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------:| -|

ExperienceMaker Logo

|

GIF 2

| + + + + + + + + + +
Without ExperienceWith Experience
without experiencewith experience
We test on 100 random frozenlake map with qwen3-8b: -| Method | pass rate | -|-------------------------------|------------------| +| Method | pass rate | +|--------------------------------|------------------| | w/o ExperienceMaker (baseline) | 0.66 | -| **w ExperienceMaker** | | -| [1] experience(Direct Use) | 0.72 **(+9.1%)** | -| [2] experience(LLM Rewritten) | 0.72 **(+9.1%)** | +| **w ExperienceMaker** | | +| [1] experience(Direct Use) | 0.72 **(+9.1%)** | +| [2] experience(LLM Rewritten) | 0.72 **(+9.1%)** | We also noticed that in such simple scenarios, not using LLM rewriting may actually yield better results. @@ -522,7 +530,7 @@ Coming Soon! Stay tuned for comprehensive evaluation results. --- -## 🏪 Ready-made Experience Store +## 🏪 Pre-built Experience Libraries ExperienceMaker provides pre-built experience libraries to jumpstart your agent's capabilities. You can directly load these curated experiences into your workspace and start benefiting from accumulated knowledge