mirror of
https://github.com/abhigyanpatwari/GitNexus.git
synced 2026-10-29 06:32:28 +00:00
Some checks are pending
CodeQL / Analyze (javascript-typescript) (push) Waiting to run
CodeQL / Analyze (python) (push) Waiting to run
Gitleaks / gitleaks (push) Waiting to run
Publish / Classify release event (push) Waiting to run
Publish / RC guard (marker + release-PR skip) (push) Blocked by required conditions
Publish / ci (push) Blocked by required conditions
Publish / Publish to npm (push) Blocked by required conditions
Publish / Build & Push RC Docker images (push) Blocked by required conditions
Trivy Image Scan / Trivy (gitnexus-cli) (push) Waiting to run
Scorecard / Scorecard analysis (push) Waiting to run
Trivy Image Scan / Trivy (gitnexus-web) (push) Waiting to run
* fix(mcp): reject corrupt query identities and refresh index metadata * fix(mcp): preserve reader and search integrity Keep replaced readers unknown until matching metadata is published. Defer shared-handle refresh until other consumers release the old graph to avoid rebuilding connections against the same stale generation. Propagate identity corruption after both hybrid search lanes settle, so the sibling cannot query after its database session is released. Select the regressions for the OS matrix and retain Python coverage without optional Swift grammars. Validation: 393 focused tests, nine native generation tests and ten race executions across five fresh processes pass. Build and source/test typechecks pass. The early full run passed 26,096 tests and failed eight: seven reproduce on baseline; the mixed-source publication case passes in clean reruns. Windows/macOS native execution remains for CI. Graph analysis maps all edited production symbols; coverage remains partial for the anonymous FTS test callback, manually reviewed. Refs #3571 * fix(lbug): bump @ladybugdb/core to 0.21.2 to stop doubled rows after delete and re-copy LadybugDB 0.21.0 and 0.21.1 return every row of a table that spans more than one native vector twice once the incremental writeback has DETACH DELETEd it and a COPY into an earlier table has run. NodeGroup::scan let a morsel that ended before the group's first live row wrap an unsigned subtraction and rescan to the end of the group (LadybugDB #1085, fixed in 0.21.2). No primary key error fires. The identity guard from #3442 stops the run with "unexpected or duplicate ID", so a Swift edit that pulls every importer into the write set failed on repos with more than 2048 structs. Only unreleased main was affected: 1.6.12 ships 0.18.3. Pin 0.21.2 in package.json, update the six @ladybugdb/core entries in the lockfile, and move coreVersion in the vendored FTS manifest. The FTS extension stays at 0.21.0 because no v0.21.1 or v0.21.2 artifact is published; the pairing assertion and its unit tests pass. Add a regression to the delete-nodes-for-files suite: 2049 structs with CONTAINS edges are loaded, every file is deleted, the graph is loaded again, and each id and edge must appear exactly once. Verification (Linux, Node 22.18): - lbug-delete-nodes-for-files: 11/11 on 0.21.2. With the 0.21.1 native packages swapped in, the new test fails with 4098 rows instead of 2049. - Reporter recipe end to end on the built CLI: incremental analyze exits 0 with no duplicate ids on a Swift-heavy fixture and on a 70-file Python fixture, with and without FTS. On 0.21.1 the Swift fixture exits 1. - A 0.21.1-written database opens and reads under 0.21.2. - prettier, eslint and typecheck:tests are clean on the changed files. - The full lbug-db project had not finished when this was committed. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> * test(fts): say what the Windows warm-session branch covers On Windows the repair step calls poolClose, which removes the pool entry before the in-place writer opens. The step therefore checks the backend's cached capability state, not a live pool connection. The comment now says so instead of implying the pool stays warm. No behavior change. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> * revert: take the @ladybugdb/core 0.21.2 bump out of this PR Reverts0cdc3dfe3. The bump fixes LadybugDB 0.21.0 and 0.21.1 returning every row of a large table twice after a delete and re-copy, but on Windows it crashes the vendored FTS extension, which is still the v0.21.0 build: four of eight Windows shards failed with exit code 3221225477 (0xC0000005) in tests that load libfts and build an FTS index. All eight passed on9d79092abwith core 0.21.1. A Windows extension is only published for v0.21.0, not for v0.21.1 or v0.21.2. The bump moves to its own draft PR (#3578) until a matching Windows extension exists. This PR returns to its original query-integrity and index-freshness scope. Restores gitnexus/package.json, the six @ladybugdb/core entries in package-lock.json, the coreVersion in vendor/lbug-fts/manifest.json, and removes the regression test that belongs with the bump. All four files are identical to origin/main (1b4e3f0a8) after this commit. Verification: - git diff origin/main for the four files is empty. - fts-artifact-coverage and vendored-extension-path unit tests pass (31), and assert-publish-fts-coverage reports core 0.21.1 paired with extension 0.21.0. - The graph check on the staged revert was partial, because it only deletes test code. The forward change was gated clean: 4 files, 6 symbols, all in that test, no affected processes. - Windows CI has not run on this commit. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> --------- Co-authored-by: Gergo Magyar <gergomagyar0@gmail.com> Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
242 lines
9.9 KiB
TypeScript
242 lines
9.9 KiB
TypeScript
/** Injected corruption proves the query boundary, not the cause of #3527/#3564. */
|
|
import { execFileSync } from 'node:child_process';
|
|
import fs from 'node:fs/promises';
|
|
import path from 'node:path';
|
|
import { Client } from '@modelcontextprotocol/sdk/client/index.js';
|
|
import { InMemoryTransport } from '@modelcontextprotocol/sdk/inMemory.js';
|
|
import { afterAll, beforeAll, beforeEach, describe, expect, it, vi } from 'vitest';
|
|
import * as adapter from '../../src/core/lbug/lbug-adapter.js';
|
|
import { runFullAnalysis } from '../../src/core/run-analyze.js';
|
|
import { LocalBackend } from '../../src/mcp/local/local-backend.js';
|
|
import { SYMBOL_IDENTITY_RECOVERY_SUGGESTION } from '../../src/mcp/local/query-result-integrity.js';
|
|
import { createMCPServer, getNextStepHint } from '../../src/mcp/server.js';
|
|
import { getStoragePaths } from '../../src/storage/repo-manager.js';
|
|
import { commitAll, initGitRepo } from '../helpers/temp-git-repo.js';
|
|
import { createTempDir } from '../helpers/test-db.js';
|
|
|
|
const SOURCE = [
|
|
'export function integrityNeedle() {',
|
|
' return 42;',
|
|
'}',
|
|
'',
|
|
'export function startIntegrityFlow() {',
|
|
' return middleIntegrityFlow();',
|
|
'}',
|
|
'',
|
|
'function middleIntegrityFlow() {',
|
|
' return integrityNeedle();',
|
|
'}',
|
|
].join('\n');
|
|
const UID = 'Function:src/fixture.ts:integrityNeedle';
|
|
|
|
describe('query identity boundary through the real MCP server', () => {
|
|
let temp: Awaited<ReturnType<typeof createTempDir>>;
|
|
let repo: string;
|
|
let lbugPath: string;
|
|
let snapshot: string;
|
|
let ftsLoaded = false;
|
|
|
|
beforeAll(async () => {
|
|
temp = await createTempDir();
|
|
const root = await fs.realpath(temp.dbPath);
|
|
const userHome = path.join(root, 'user-home');
|
|
await fs.mkdir(userHome);
|
|
vi.stubEnv('HOME', userHome);
|
|
vi.stubEnv('USERPROFILE', userHome);
|
|
vi.stubEnv('GITNEXUS_HOME', path.join(root, 'home'));
|
|
vi.stubEnv('GITNEXUS_STORAGE_PATH', undefined);
|
|
vi.stubEnv('GITNEXUS_STORAGE_ROOT', undefined);
|
|
vi.stubEnv('GITNEXUS_SHARED_STORE', 'off');
|
|
vi.stubEnv('GITNEXUS_CONTENT_RETENTION', 'full');
|
|
vi.stubEnv('GITNEXUS_LBUG_EXTENSION_INSTALL', 'load-only');
|
|
vi.stubEnv('GITNEXUS_WAL_MANUAL_CHECKPOINT', '1');
|
|
await adapter.initLbug(path.join(root, 'fts-probe'));
|
|
ftsLoaded = await adapter.loadFTSExtension(undefined, { policy: 'load-only' });
|
|
await adapter.closeLbug();
|
|
if (!ftsLoaded) {
|
|
if (process.env.GITNEXUS_REQUIRE_FTS === '1')
|
|
throw new Error('FTS is required for this test');
|
|
return;
|
|
}
|
|
repo = path.join(root, 'repo');
|
|
await fs.mkdir(path.join(repo, 'src'), { recursive: true });
|
|
await fs.writeFile(path.join(repo, '.gitignore'), '.gitnexus/\n');
|
|
await fs.writeFile(path.join(repo, 'src/fixture.ts'), SOURCE);
|
|
initGitRepo(repo);
|
|
execFileSync('git', ['config', 'commit.gpgsign', 'false'], { cwd: repo });
|
|
commitAll(repo, 'source-derived query fixture');
|
|
await runFullAnalysis(repo, { skipAgentsMd: true, skipSkills: true }, { onProgress: () => {} });
|
|
lbugPath = getStoragePaths(repo).lbugPath;
|
|
snapshot = path.join(root, 'healthy.lbug');
|
|
await fs.copyFile(lbugPath, snapshot);
|
|
const groupDir = path.join(root, 'home', 'groups', 'integrity');
|
|
await fs.mkdir(groupDir, { recursive: true });
|
|
await fs.writeFile(
|
|
path.join(groupDir, 'group.yaml'),
|
|
JSON.stringify({ version: 1, name: 'integrity', repos: { service: 'repo' } }),
|
|
);
|
|
}, 120_000);
|
|
|
|
beforeEach(({ skip }) => {
|
|
if (!ftsLoaded) skip('FTS extension unavailable under the load-only policy');
|
|
});
|
|
|
|
afterAll(async () => {
|
|
await adapter.closeLbug();
|
|
vi.unstubAllEnvs();
|
|
await temp?.cleanup();
|
|
});
|
|
|
|
async function query(mutate?: () => Promise<void>, legacy = false, target = repo): Promise<any> {
|
|
await fs.copyFile(snapshot, lbugPath);
|
|
if (mutate) {
|
|
await adapter.initLbug(lbugPath);
|
|
try {
|
|
await mutate();
|
|
} finally {
|
|
await adapter.closeLbug();
|
|
}
|
|
}
|
|
const backend = new LocalBackend();
|
|
await backend.init();
|
|
const server = createMCPServer(backend);
|
|
const client = new Client({ name: 'query-integrity-regression', version: '1.0.0' });
|
|
const [clientTransport, serverTransport] = InMemoryTransport.createLinkedPair();
|
|
const args = {
|
|
repo: target,
|
|
[legacy ? 'query' : 'search_query']: 'integrityNeedle',
|
|
include_content: true,
|
|
chain_depth: 1,
|
|
};
|
|
try {
|
|
await Promise.all([server.connect(serverTransport), client.connect(clientTransport)]);
|
|
const result = await client.callTool({ name: 'query', arguments: args });
|
|
expect(result.isError).not.toBe(true);
|
|
const content = result.content as Array<{ type: string; text: string }>;
|
|
const text = content.find((item) => item.type === 'text')!.text;
|
|
const hint = getNextStepHint('query', args);
|
|
return JSON.parse(hint ? text.slice(0, -hint.length) : text);
|
|
} finally {
|
|
await client.close();
|
|
await server.close();
|
|
await backend.dispose();
|
|
}
|
|
}
|
|
|
|
it('returns source-derived symbol identity, range and content', async () => {
|
|
const result = await query();
|
|
expect(result).not.toHaveProperty('error');
|
|
expect(result).not.toHaveProperty('partial');
|
|
expect([...result.process_symbols, ...result.definitions]).toContainEqual(
|
|
expect.objectContaining({
|
|
id: UID,
|
|
name: 'integrityNeedle',
|
|
filePath: 'src/fixture.ts',
|
|
startLine: 1,
|
|
endLine: 3,
|
|
content: SOURCE.split('\n').slice(0, 3).join(' '),
|
|
}),
|
|
);
|
|
expect(result.processes.length).toBeGreaterThan(0);
|
|
});
|
|
|
|
it.each([
|
|
['NUL symbol name', 'MATCH (n:Function {id: $uid}) SET n.name = $value', 'invalid\0name'],
|
|
['NUL symbol path', 'MATCH (n:Function {id: $uid}) SET n.filePath = $value', 'invalid\0path'],
|
|
['NUL process label', 'MATCH (p:Process) SET p.label = $value', 'invalid\0process'],
|
|
['NUL cluster label', 'MATCH (c:Community) SET c.heuristicLabel = $value', 'invalid\0cluster'],
|
|
])(
|
|
'rejects injected %s instead of returning success or a fallback',
|
|
async (_name, statement, value) => {
|
|
const result = await query(async () => {
|
|
await adapter.executePrepared(statement, { uid: UID, value });
|
|
}, true);
|
|
expect(result.error).toContain('invalid symbol identity');
|
|
expect(result.recoverySuggestion).toBe(SYMBOL_IDENTITY_RECOVERY_SUGGESTION);
|
|
expect(result).not.toHaveProperty('definitions');
|
|
expect(JSON.stringify(result)).not.toContain('\\u0000');
|
|
},
|
|
);
|
|
|
|
it('rejects a blank UID read from native FTS instead of dropping it', async () => {
|
|
const result = await query(async () => {
|
|
await adapter.executeQuery(
|
|
"CREATE (n:Function {id: '', name: 'integrityNeedle', filePath: 'src/fixture.ts', startLine: 0, endLine: 2})",
|
|
);
|
|
await adapter.dropFTSIndex('Function', 'function_fts');
|
|
await adapter.createFTSIndex('Function', 'function_fts', ['name', 'content', 'description']);
|
|
});
|
|
expect(result.error).toContain('invalid symbol identity');
|
|
expect(result.recoverySuggestion).toBe(SYMBOL_IDENTITY_RECOVERY_SUGGESTION);
|
|
expect(result).not.toHaveProperty('definitions');
|
|
});
|
|
|
|
it('accepts legacy missing process entry points and empty optional labels', async () => {
|
|
const result = await query(async () => {
|
|
await adapter.executeQuery(
|
|
"MATCH (p:Process) SET p.entryPointId = NULL, p.heuristicLabel = ''",
|
|
);
|
|
});
|
|
expect(result).not.toHaveProperty('error');
|
|
expect(result.processes.length).toBeGreaterThan(0);
|
|
});
|
|
|
|
it('does not treat source content as an identity', async () => {
|
|
const content = 'source text containing \0 is not an identity';
|
|
const result = await query(async () => {
|
|
await adapter.executePrepared('MATCH (n:Function {id: $uid}) SET n.content = $content', {
|
|
uid: UID,
|
|
content,
|
|
});
|
|
});
|
|
expect(result).not.toHaveProperty('error');
|
|
expect(result.process_symbols).toContainEqual(expect.objectContaining({ id: UID, content }));
|
|
});
|
|
|
|
it('rejects corrupt route enrichment rather than degrading to a route-less process', async () => {
|
|
const result = await query(async () => {
|
|
await adapter.executePrepared(
|
|
"CREATE (r:Route {id: 'Route:injected', name: '/example', method: $method})",
|
|
{ method: 'GE\0T' },
|
|
);
|
|
await adapter.executeQuery(
|
|
"MATCH (p:Process), (r:Route {id: 'Route:injected'}) CREATE (r)-[:CodeRelation {type: 'ENTRY_POINT_OF'}]->(p)",
|
|
);
|
|
});
|
|
expect(result.error).toContain('invalid symbol identity');
|
|
expect(result.recoverySuggestion).toBe(SYMBOL_IDENTITY_RECOVERY_SUGGESTION);
|
|
});
|
|
|
|
it('preserves the integrity error through a group query and its legacy query argument', async () => {
|
|
const healthy = await query(undefined, true, '@integrity');
|
|
expect(healthy).not.toHaveProperty('error');
|
|
expect(healthy.results.length).toBeGreaterThan(0);
|
|
const result = await query(
|
|
async () => {
|
|
await adapter.executePrepared('MATCH (n:Function {id: $uid}) SET n.name = $name', {
|
|
uid: UID,
|
|
name: 'invalid\0name',
|
|
});
|
|
},
|
|
true,
|
|
'@integrity',
|
|
);
|
|
expect(result.error).toContain('invalid symbol identity');
|
|
expect(result.recoverySuggestion).toBe(SYMBOL_IDENTITY_RECOVERY_SUGGESTION);
|
|
expect(result).not.toHaveProperty('results');
|
|
});
|
|
|
|
it('rejects corruption found only by concurrent chain enrichment', async () => {
|
|
const result = await query(async () => {
|
|
await adapter.executePrepared(
|
|
"CREATE (n:Function {id: 'Function:chain-only', name: $name, filePath: 'src/fixture.ts'})",
|
|
{ name: 'invalid\0chain' },
|
|
);
|
|
await adapter.executeQuery(
|
|
"MATCH (p:Process), (entry:Function), (n:Function {id: 'Function:chain-only'}) WHERE entry.id = p.entryPointId CREATE (entry)-[:CodeRelation {type: 'CALLS'}]->(n)",
|
|
);
|
|
});
|
|
expect(result.error).toContain('invalid symbol identity');
|
|
expect(result.recoverySuggestion).toBe(SYMBOL_IDENTITY_RECOVERY_SUGGESTION);
|
|
});
|
|
});
|