Skip to content

fact-gate

An open-source CLI, GitHub Action and Claude Code hook that checks an AI-written PR description, README or changelog against the actual diff, test output or a facts file, and blocks when a number, date or claim doesn't hold up.

From
SaaS
Subject
Open-source developer tool: verifies AI-written PR descriptions and READMEs against the diff
Dated
2026 · Live

Problem

AI coding agents round numbers, invent dates and overstate test counts in the text they write about their own changes, and every existing claim-verifier on the market runs a second model to check the first one, adding cost and its own failure mode instead of removing one.

System

A deterministic, zero-dependency checker: it extracts checkable claims from text, compares each one against the diff, a measured command/file/JSON value, or the test suite's own output, and exits non-zero on a contradiction, no second model, no API key. Published on npm and the VS Code Marketplace, with 90+ tests and a 100/100 pass rate on its own evaluation suite.

  • A command-line tool, a GitHub Action and a Claude Code hook.
  • No second model, no API key, zero dependencies.

Built with: Node.js, CLI, GitHub Actions

How it runs

One pull request, checked before it merges.
  1. An AI agent writes the description of its own change

    Runs alone
  2. Every checkable claim is extracted from the text

    Runs alone
  3. Each claim is compared with the diff, a measured value or the test output

    Runs alone
  4. A contradiction blocks the merge until a person fixes the text

    Hands over to a person

Result

Want a system like this?

Book a call, or send a written brief. Quoted in 48h, fixed once signed.