mirror of
https://github.com/fabro-sh/fabro.git
synced 2026-09-23 00:41:13 +00:00
Test 1 (llm crate): Multi-turn cache verification runs 6 conversation turns with a large system prompt (~5460 tokens) and verifies cache_read_tokens on the final turn. Anthropic threshold 0.5, OpenAI/Gemini 0.0 (automatic caching not guaranteed). Test 2 (agent crate): Cross-provider parity matrix with 15 scenarios (file CRUD, shell, grep/glob, editing, steering, reasoning effort, loop detection, error recovery, etc.) across Anthropic, OpenAI, and Gemini. 41 total tests. Some scenarios excluded for OpenAI due to gpt-4o-mini limitations (no reasoning.effort, is_error rejection, weak editing). Test 3 (attractor crate): E2E pipeline with real LLM using AgentBackend, AutoApproveInterviewer, and default_registry. Verifies pipeline success, artifact files, goal gate outcomes, and checkpoint state. All tests are #[ignore] and require API keys to run. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| cli_integration.rs | ||
| parity_matrix.rs | ||