Commit graph

8 commits

Author SHA1 Message Date
Claude
de3131fed8 fix(eval): require finite gateway startup budgets 2026-09-05 11:03:23 +00:00
Claude
fc61507da5 fix(eval): repair native containment checks 2026-09-05 10:48:39 +00:00
Claude
3598a69188 fix(eval): close CI and remaining review gaps 2026-09-05 10:29:58 +00:00
Gergo Magyar
1054e3e038 fix(eval): make evolution evidence valid and bounded 2026-09-05 10:08:35 +00:00
Gergo Magyar
8491cf4203 fix(eval): make historical review evolution score instead of aborting
Seed the current gitnexus-review skill into older PR checkouts, force-add
historically gitignored skill paths, accept plugin-qualified Skill ids,
and lock host-unsafe workspaces to review-output.json so a generation can
finish and score. Sandbox cleanup restores owner write bits before delete
because a session that copytrees the locked clone otherwise leaves 0555
trees that rmtree cannot remove.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-04 18:37:39 +00:00
Gergo Magyar
7477346a28 fix(eval): stop the OpenAI gateway from hanging on its own log pipe
The loopback LiteLLM proxy was started with stderr=PIPE, but nothing
drained that pipe after the readiness probe. Once the proxy's request
logs filled the 64 KiB pipe buffer it blocked on write, so every later
session request hung with no HTTP status. The last CI evolution run
burned 66 minutes and $3.98 before dying on ten "Request timed out"
retries with error_status=null.

Send proxy stdout+stderr to a 0600 log file in the gateway work dir
instead, and read startup failure detail from that file.

Also give both ends of the loopback hop a 30 minute budget: high
reasoning effort on a full context window can leave a request without a
first token for longer than Claude Code's default client timeout, so
sessions failed on the clock rather than on real errors.
2026-09-03 12:36:01 +00:00
Gergo Magyar
e51a408289 fix(eval): start OpenAI gateway via litellm console script
python -m litellm fails on 1.87 (no __main__); use the venv console entry and fall back through VIRTUAL_ENV under uv run.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-03 11:11:10 +00:00
Gergo Magyar
37415cb1ca feat(eval): route skill evolution through OpenAI
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-03 10:52:37 +00:00