Roo-Code/benchmark
2025-03-30 16:51:48 -07:00
..
apps Run in chunks 2025-03-30 16:51:48 -07:00
config Clean up package.json files 2025-03-20 14:43:02 -07:00
packages Run in chunks 2025-03-30 16:51:48 -07:00
.env.sample Small fixes 2025-03-19 23:41:50 -07:00
.gitignore More progress 2025-03-20 20:01:53 -07:00
.npmrc Add comment 2025-03-19 23:21:41 -07:00
Dockerfile RUN npm install -g npm-run-all 2025-03-20 15:35:33 -07:00
entrypoint.sh Organize package locations 2025-03-20 14:38:06 -07:00
package.json Run in chunks 2025-03-30 16:51:48 -07:00
pnpm-lock.yaml Run in chunks 2025-03-30 16:51:48 -07:00
pnpm-workspace.yaml Organize package locations 2025-03-20 14:38:06 -07:00
README.md Parallel tasks (#2128) 2025-03-30 15:09:26 -07:00
turbo.json Run in chunks 2025-03-30 16:51:48 -07:00

Benchmark Harness

Get Started

Install and run Docker Desktop.

Build a container to run the Roo Code benchmarks:

docker build -f Dockerfile -t roo-code-benchmark ..

Local Debugging

Install nvm:

curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.2/install.sh | bash
# Reload shell.
nvm install

Install pnpm:

npm install --global corepack@latest
corepack enable pnpm
corepack use pnpm@latest-10

Install dependencies:

pnpm install

Configure database:

cp packages/server/.env.sample packages/server/.env
# Update BENCHMARKS_DB_PATH as needed in `packages/server/.env`.
pnpm --filter @benchmark/db db:push

Run the web app:

pnpm web

Run an exercise via the cli:

pnpm cli run [cpp|go|java|javascript|python|rust|all] [<exercise>|all]