mirror of
https://github.com/abhigyanpatwari/GitNexus.git
synced 2026-10-01 02:01:24 +00:00
* fix(lbug): pin Ladybug core so Dependabot cannot ship a skewed FTS artifact The extension version is a separate upstream constant. Ignore daily core bumps and fail the pairing gate when the committed manifest does not name the installed core. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): make doctor and CI FTS gates resolve the packaged artifact Doctor and the REQUIRE_FTS file gates still treated an empty ~/.lbdb as unavailable, which would turn three CI jobs red once analyze stops installing into that tree. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): name native-abort and tuple-missing so analyze cannot mis-advise The CLI summary's trailing else treated every unknown skip reason as a missing extension. New crash and platform causes must get their own remedies, not a network-install hint. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): delete the dead read-path FTS index create ensureFTSIndex had no production callers and swallowed read-only CREATE_FTS_INDEX failures, which hid the only signal that a reader tried to write. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): vendor per-platform FTS artifacts so analyze needs no host install Keyword search depended on a CDN fetch into ~/.lbdb. Shipping the five published tuples inside the package makes air-gapped and ignore-scripts installs load the same artifact the publish gate checksums. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): load the packaged FTS artifact before any network install Analyze still required a CDN fetch into ~/.lbdb even when the package already shipped the file. FTS now path-loads the vendored tuple first and records source labels so a later truncated home copy cannot steal the diagnosis. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): diagnose a core/extension version skew instead of a missing runtime A structurally valid FTS artifact whose path version disagrees with the packaged pin must name both versions, not prescribe VC++ or OpenSSL. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): stamp an FTS phase so repair stays usable after an in-place abort A native CREATE_FTS_INDEX abort leaves no skip reason; the next run infers it from the dirty flag, and --repair-fts must not treat that phase as a half-written graph. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): park an in-place FTS crash WAL without wiping the graph An FTS abort after a successful checkpoint must reopen the live index on macOS, Windows, and Linux. Staging never parks the live WAL; readers keep today's large-WAL refusal. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): refuse read-only opens of an FTS-poisoned WAL MCP and serve cannot repair a leftover in-place abort. Fail before the native open and name --repair-fts, on macOS, Windows, and Linux. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): name a vendor-neutral Windows OpenSSL prerequisite OQ1 is unanswered here so GitNexus does not ship OpenSSL DLLs. Windows FTS now asks for a system OpenSSL 3 runtime instead of Git Bash PATH. Co-authored-by: Cursor <cursoragent@cursor.com> * test(lbug): inject the FTS vendor root and redact it on HTTP and MCP Path-loaded artifacts no longer vary with HOME. Tests pass an injected vendor tree and assert search warnings never leak a filesystem path. Co-authored-by: Cursor <cursoragent@cursor.com> * docs(lbug): document load-only as the global FTS install default Analyze still overrides to auto. Packaged per-platform artifacts load before any network install on macOS, Windows, and Linux. Co-authored-by: Cursor <cursoragent@cursor.com> * docs(lbug): format the FTS install-policy README table Prettier does not run on Markdown in pre-commit, so the U10 table wrap needs its own formatting commit. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): skip FTS CREATE after a persisted native abort A recovered analyze run was retrying CREATE_FTS_INDEX from skipReason alone. Keep that skip until --repair-fts, fail closed on unsupported tuples, and honor the checkpoint warrant for park/repair. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): honor checkpoint flushed warrant and align FTS tests with packaged vendor A no-op CHECKPOINT must not satisfy the FTS park warrant, and CI still asserted HOME-only FTS isolation after analyze started path-LOADing the packaged artifact. Co-authored-by: Cursor <cursoragent@cursor.com> * test(lbug): accept a nonempty incremental write set in the #2790 recovery check FTS-phase recovery can incremental-add files (changed=0, added=1). That is not the #2790 empty-diff wipe skip. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): compare FTS home versions to the core pin and tighten the publish filename gate Ladybug's ~/.lbdb/extension directory is the runtime/core version; treating it as the artifact version false-diagnosed skew. The publish guard now rejects a path-escaping filename the same way the fetch script does. Co-authored-by: Cursor <cursoragent@cursor.com> * test(lbug): seed FTS e2e fixtures from the packaged vendor artifact A machine with no ~/.lbdb copy should still run the vendor-survivorship cases; the seed no longer depends on HOME or a network install. Co-authored-by: Cursor <cursoragent@cursor.com> * Address PR review feedback (#3274) Keep in-place FTS abort evidence after persist so a second CREATE abort cannot fail-open readers, and close the CLI, loader, embed, and e2e gaps the review called out. Note: full npm test hit Ladybug worker-pool startup failures under memory pressure; tsc and 180 targeted unit tests passed. Co-authored-by: Cursor <cursoragent@cursor.com> * Address PR review feedback (#3274) Run the vendored-path symlink guard on the OS matrix, put e2e HOME fixtures on Ladybug's real extension layout, pin the embed crash-WAL gate before the writable open, and let analyze writers park through missing-shadow recovery. Co-authored-by: Cursor <cursoragent@cursor.com> * fix(lbug): keep --repair-fts CI green after vendored-first FTS Never-installed warning fixtures must not inspect a packaged vendor binary, and a failed dirty restamp must not abort an otherwise successful --repair-fts run. Co-authored-by: Cursor <cursoragent@cursor.com> * test(cli): give the #1169 analyze e2e the same 90s Windows budget as its sibling The first #1169 persist-meta case was still on a 60s spawn/it budget and was killed banner-only on windows-latest after the FTS warning fixture no longer failed the shard first. Co-authored-by: Cursor <cursoragent@cursor.com> * test(ci): reweight Windows shards after the FTS e2e grew Vendored-first HOME fixtures pushed fts-extension-e2e to ~6 minutes on windows-latest, so the old 146s weight packed it with skills-e2e and blew the 20-minute watchdog. Co-authored-by: Cursor <cursoragent@cursor.com> --------- Co-authored-by: Gergo Magyar <gergomagyar0@gmail.com> Co-authored-by: Cursor <cursoragent@cursor.com>
187 lines
7.4 KiB
TypeScript
187 lines
7.4 KiB
TypeScript
/**
|
|
* Unit tests for the manual WAL checkpoint driver (#1741 follow-up).
|
|
*
|
|
* The driver wraps a CHECKPOINT call in a bounded retry that fires only
|
|
* on `isLbugCheckpointIoError` shapes. These tests inject a fake
|
|
* `checkpointFn`, fake `sleepFn`, and fake `randomFn` to exercise the
|
|
* retry policy deterministically without touching a real LadybugDB.
|
|
*
|
|
* Integration-level coverage that the driver actually runs against a
|
|
* native engine lives in `test/integration/analyze-wal-checkpoint-failure.test.ts`.
|
|
*/
|
|
import { afterEach, beforeEach, describe, expect, it, vi } from 'vitest';
|
|
import * as lbugAdapter from '../../src/core/lbug/lbug-adapter.js';
|
|
import {
|
|
checkpointOnce,
|
|
isManualCheckpointEnabled,
|
|
runCheckpointWithRetry,
|
|
startWalCheckpointDriver,
|
|
} from '../../src/core/lbug/wal-checkpoint-driver.js';
|
|
|
|
const makeCheckpointError = () =>
|
|
// Matches the strict rename matcher in lbug-config.ts.
|
|
new Error(
|
|
'Runtime exception: IO exception: Error renaming file /tmp/lbug.wal to /tmp/lbug.wal.checkpoint. ErrorMessage: Permission denied',
|
|
);
|
|
|
|
describe('runCheckpointWithRetry — retry policy', () => {
|
|
it('returns on first success with attempts=1 and no sleeps', async () => {
|
|
const checkpointFn = vi.fn().mockResolvedValue(true);
|
|
const sleepFn = vi.fn().mockResolvedValue(undefined);
|
|
const randomFn = vi.fn().mockReturnValue(0);
|
|
|
|
const result = await runCheckpointWithRetry({ checkpointFn, sleepFn, randomFn });
|
|
|
|
expect(result.attempts).toBe(1);
|
|
expect(result.flushed).toBe(true);
|
|
expect(checkpointFn).toHaveBeenCalledTimes(1);
|
|
expect(sleepFn).toHaveBeenCalledTimes(0);
|
|
});
|
|
|
|
it('retries up to 3 times on checkpoint IO errors and succeeds on the final attempt', async () => {
|
|
const checkpointFn = vi
|
|
.fn()
|
|
.mockRejectedValueOnce(makeCheckpointError())
|
|
.mockRejectedValueOnce(makeCheckpointError())
|
|
.mockResolvedValueOnce(true);
|
|
const sleepFn = vi.fn().mockResolvedValue(undefined);
|
|
// Fixed random returns 0, so jitter contributes 0 ms and we can
|
|
// assert exact delays against BASE_DELAYS_MS = [50, 200, 500].
|
|
const randomFn = vi.fn().mockReturnValue(0);
|
|
|
|
const result = await runCheckpointWithRetry({ checkpointFn, sleepFn, randomFn });
|
|
|
|
expect(result.attempts).toBe(3);
|
|
expect(result.flushed).toBe(true);
|
|
expect(checkpointFn).toHaveBeenCalledTimes(3);
|
|
// Sleeps happen between attempts: after attempt 1 (50 ms) and after
|
|
// attempt 2 (200 ms). No sleep after the final attempt.
|
|
expect(sleepFn).toHaveBeenCalledTimes(2);
|
|
expect(sleepFn).toHaveBeenNthCalledWith(1, 50);
|
|
expect(sleepFn).toHaveBeenNthCalledWith(2, 200);
|
|
});
|
|
|
|
it('rethrows the last error after exhausting all retries on persistent IO failures', async () => {
|
|
const persistent = makeCheckpointError();
|
|
const checkpointFn = vi.fn().mockRejectedValue(persistent);
|
|
const sleepFn = vi.fn().mockResolvedValue(undefined);
|
|
const randomFn = vi.fn().mockReturnValue(0);
|
|
|
|
await expect(runCheckpointWithRetry({ checkpointFn, sleepFn, randomFn })).rejects.toBe(
|
|
persistent,
|
|
);
|
|
|
|
expect(checkpointFn).toHaveBeenCalledTimes(3);
|
|
// Two backoffs (50 ms, 200 ms) but no sleep after the final attempt.
|
|
expect(sleepFn).toHaveBeenCalledTimes(2);
|
|
expect(sleepFn).toHaveBeenNthCalledWith(1, 50);
|
|
expect(sleepFn).toHaveBeenNthCalledWith(2, 200);
|
|
});
|
|
|
|
it('does NOT retry non-checkpoint errors (e.g. WAL corruption surfaces immediately)', async () => {
|
|
const corruption = new Error('Runtime exception: Corrupted wal file.');
|
|
const checkpointFn = vi.fn().mockRejectedValue(corruption);
|
|
const sleepFn = vi.fn().mockResolvedValue(undefined);
|
|
|
|
await expect(runCheckpointWithRetry({ checkpointFn, sleepFn })).rejects.toBe(corruption);
|
|
|
|
expect(checkpointFn).toHaveBeenCalledTimes(1);
|
|
expect(sleepFn).toHaveBeenCalledTimes(0);
|
|
});
|
|
|
|
it('jitter is bounded: 0 <= jitter < 50 ms regardless of random source', async () => {
|
|
const checkpointFn = vi
|
|
.fn()
|
|
.mockRejectedValueOnce(makeCheckpointError())
|
|
.mockResolvedValueOnce(true);
|
|
const sleepFn = vi.fn().mockResolvedValue(undefined);
|
|
// Random returns 0.999... — jitter should still be <50 ms (floor).
|
|
const randomFn = vi.fn().mockReturnValue(0.9999);
|
|
|
|
await runCheckpointWithRetry({ checkpointFn, sleepFn, randomFn });
|
|
|
|
expect(sleepFn).toHaveBeenCalledTimes(1);
|
|
const delay = sleepFn.mock.calls[0][0] as number;
|
|
expect(delay).toBe(50 + Math.floor(0.9999 * 50)); // == 99
|
|
});
|
|
});
|
|
|
|
describe('isManualCheckpointEnabled — env var parsing', () => {
|
|
let originalEnv: string | undefined;
|
|
beforeEach(() => {
|
|
originalEnv = process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
});
|
|
afterEach(() => {
|
|
if (originalEnv === undefined) delete process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
else process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = originalEnv;
|
|
});
|
|
|
|
it('defaults to enabled when the env var is unset', () => {
|
|
delete process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
expect(isManualCheckpointEnabled()).toBe(true);
|
|
});
|
|
|
|
it.each(['0', 'false', 'FALSE', 'off', 'no', ' 0 '])(
|
|
'returns false for opt-out value %s',
|
|
(value) => {
|
|
process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = value;
|
|
expect(isManualCheckpointEnabled()).toBe(false);
|
|
},
|
|
);
|
|
|
|
it.each(['1', 'true', 'on', 'yes', ''])('returns true for non-opt-out value %s', (value) => {
|
|
process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = value;
|
|
expect(isManualCheckpointEnabled()).toBe(true);
|
|
});
|
|
});
|
|
|
|
describe('checkpointOnce — opt-out', () => {
|
|
let originalEnv: string | undefined;
|
|
beforeEach(() => {
|
|
originalEnv = process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
});
|
|
afterEach(() => {
|
|
if (originalEnv === undefined) delete process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
else process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = originalEnv;
|
|
vi.restoreAllMocks();
|
|
});
|
|
|
|
it('resolves false and does not call CHECKPOINT when GITNEXUS_WAL_MANUAL_CHECKPOINT=0', async () => {
|
|
process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = '0';
|
|
const flush = vi.spyOn(lbugAdapter, 'tryFlushWAL');
|
|
await expect(checkpointOnce()).resolves.toBe(false);
|
|
expect(flush).not.toHaveBeenCalled();
|
|
});
|
|
|
|
it('returns the flushed warrant, not a hardcoded success', async () => {
|
|
delete process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
const flush = vi.spyOn(lbugAdapter, 'tryFlushWAL').mockResolvedValue(false);
|
|
await expect(checkpointOnce()).resolves.toBe(false);
|
|
expect(flush).toHaveBeenCalled();
|
|
});
|
|
});
|
|
|
|
describe('startWalCheckpointDriver — lifecycle', () => {
|
|
let originalEnv: string | undefined;
|
|
beforeEach(() => {
|
|
originalEnv = process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
});
|
|
afterEach(() => {
|
|
if (originalEnv === undefined) delete process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT;
|
|
else process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = originalEnv;
|
|
});
|
|
|
|
it('returns a no-op handle when manual checkpoint is disabled', async () => {
|
|
process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = '0';
|
|
const driver = startWalCheckpointDriver({ periodMs: 10 });
|
|
// stop() must resolve cleanly even when no interval was scheduled.
|
|
await expect(driver.stop()).resolves.toBeUndefined();
|
|
});
|
|
|
|
it('stop() is idempotent (second call resolves without throwing)', async () => {
|
|
process.env.GITNEXUS_WAL_MANUAL_CHECKPOINT = '0';
|
|
const driver = startWalCheckpointDriver({ periodMs: 10 });
|
|
await driver.stop();
|
|
await expect(driver.stop()).resolves.toBeUndefined();
|
|
});
|
|
});
|