Roo-Code/benchmark/README.md

Benchmark Harness

Get Started

Clone the Roo Code repo:

git clone https://github.com/RooVetGit/Roo-Code.git

Install nvm:

curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.2/install.sh | bash
# Reload shell.
nvm install
node --version
# Verify the version is v20.18.1.

Install pnpm:

npm install --global corepack@latest
corepack enable pnpm
corepack use pnpm@latest-10

Build the Roo Code extension:

npm run install:all
npx vsce package --out bin/roo-code-latest.vsix

Install and run Docker Desktop.

Build a container to run the Roo Code evals:

cd benchmark
pnpm install
cp .env.sample .env
# Update OPENROUTER_API_KEY=... with your actual API key.
pnpm docker:start

Navigate to localhost:3000 in your browser.