scriptoriumadmin/ReMe
1
0
Fork 0
mirror of https://github.com/agentscope-ai/ReMe.git synced 2026-08-28 05:25:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 11

update table format

Browse source
This commit is contained in:
dengjiaji 2025-07-31 20:40:52 +08:00
parent 520b501980
commit f4ad4f8328
1 changed files with 25 additions and 17 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

42
README.md
View file

@ -19,7 +19,6 @@
---
## 📰 What's New
- **[2025-08]** 👉 Access experiences directly through the library, and contribute to expand our expertise pool👉[TODO]()
- **[2025-08]** 🚀 MCP is now available! → [Quick Start Guide](./doc/mcp_quick_start.md)
- **[2025-07]** 🎉 ExperienceMaker v0.1.1 is now available on [PyPI](https://pypi.org/project/experiencemaker/)!
- **[2025-07]** 📚 Complete documentation and quick start guides released
@ -483,7 +482,7 @@ We test ExperienceMaker on Appworld with qwen3-8b:
|--------------------------------|-----------|-------------|-----------|
| w/o ExperienceMaker (baseline) | 0.083 | 0.140 | 0.228 |
| **w ExperienceMaker** | | | |
| experience(Direct Use) | **0.109** | **0.175** | **0.281** |
|experience(Direct Use) | **0.109** | **0.175** | **0.281** |
Pass@K measures the probability that at least one out of K generated samples successfully completes the task (achieves score=1).
The current experiments use an internal AppWorld environment which may have slight discrepancies, and we will soon update with experimental results from the standard AppWorld environment.
@ -492,25 +491,34 @@ You may find more details to reproduce this experiment in [quickstart.md](cookbo
### 🧊 Experiment on Frozenlake
<table>
<tr>
<td align="center"><strong>Without Experience</strong></td>
<td align="center"><strong>With Experience</strong></td>
</tr>
<tr>
<td align="center"><img src="doc/figure/frozenlake_failure.gif" alt="without experience" width="40%"></td>
<td align="center"><img src="doc/figure/frozenlake_success.gif" alt="with experience" width="40%"></td>
</tr>
<table style="width: 40%; margin: 0 auto; border-collapse: collapse;">
<thead>
<tr>
<th style="text-align: center; padding: 10px; border: 1px solid #ddd;">without experience</th>
<th style="text-align: center; padding: 10px; border: 1px solid #ddd;">with experience</th>
</tr>
</thead>
<tbody>
<tr>
<td style="text-align: center; padding: 10px; border: 1px solid #ddd;">
<img src="doc/figure/frozenlake_failure.gif" alt="GIF 1" width="100%">
</td>
<td style="text-align: center; padding: 10px; border: 1px solid #ddd;">
<img src="doc/figure/frozenlake_success.gif" alt="GIF 2" width="100%">
</td>
</tr>
</tbody>
</table>
We test on 100 random frozenlake map with qwen3-8b:
| Method | pass rate |
|--------------------------------|------------------|
| Method | pass rate |
|-------------------------------|------------------|
| w/o ExperienceMaker (baseline) | 0.66 |
| **w ExperienceMaker** | |
| [1] experience(Direct Use) | 0.72 **(+9.1%)** |
| [2] experience(LLM Rewritten) | 0.72 **(+9.1%)** |
| **w ExperienceMaker** | |
| [1] experience(Direct Use) | 0.72 **(+9.1%)** |
| [2] experience(LLM Rewritten) | 0.72 **(+9.1%)** |
We also noticed that in such simple scenarios, not using LLM rewriting may actually yield better results.
@ -530,7 +538,7 @@ Coming Soon! Stay tuned for comprehensive evaluation results.
---
## 🏪 Pre-built Experience Libraries
## 🏪 Ready-made Experience Store
ExperienceMaker provides pre-built experience libraries to jumpstart your agent's capabilities.
You can directly load these curated experiences into your workspace and start benefiting from accumulated knowledge