Roo-Code/benchmark
2025-04-01 16:42:54 -05:00
..
apps More progress 2025-04-01 16:42:54 -05:00
config Clean up package.json files 2025-03-20 14:43:02 -07:00
packages Get rid of VSCodeCommand 2025-03-31 23:00:03 -05:00
.env.sample More progress 2025-04-01 16:42:54 -05:00
.gitignore More progress 2025-03-20 20:01:53 -07:00
.npmrc Add comment 2025-03-19 23:21:41 -07:00
Dockerfile Dockerize evals (#2157) 2025-03-31 22:24:47 -05:00
package.json More progress 2025-04-01 16:42:54 -05:00
pnpm-lock.yaml Run in chunks 2025-03-30 16:51:48 -07:00
pnpm-workspace.yaml Organize package locations 2025-03-20 14:38:06 -07:00
README.md More progress 2025-04-01 16:42:54 -05:00
turbo.json Run in chunks 2025-03-30 16:51:48 -07:00

Benchmark Harness

Get Started

Clone the Roo Code repo:

git clone https://github.com/RooVetGit/Roo-Code.git

Install nvm:

curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.2/install.sh | bash
# Reload shell.
nvm install
node --version
# Verify the version is v20.18.1.

Install pnpm:

npm install --global corepack@latest
corepack enable pnpm
corepack use pnpm@latest-10

Build the Roo Code extension:

npm run install:all
npx vsce package --out bin/roo-code-latest.vsix

Install and run Docker Desktop.

Build a container to run the Roo Code evals:

cd benchmark
pnpm install
cp .env.sample .env
# Update OPENROUTER_API_KEY=... with your actual API key.
pnpm docker:start

Navigate to localhost:3000 in your browser.