Tools / AI Number Checker
AI Number Checker
Paste an AI answer and the data behind it. Every number in the answer is matched against your source, and anything that cannot be traced is flagged in red with the evidence you need. Nothing leaves your browser.
Tip: paste the raw export (CSV, Markdown table, CI log, SQL result) rather than a summary — the checker can only trace numbers that appear in the source.
AI answer with flags
No numbers found. Paste the AI answer and the source data first.
What is the AI Number Checker?
AI assistants write numbers that look right and are not: a fabricated duration, an invented percentage, a total that never appeared in the export. The AI Number Checker compares an AI answer with the raw data behind it and marks every number that cannot be traced back to the source. It is a first pass for reports, dashboards, postmortems and CI summaries, not a verdict on truth.
How it decides
- Numbers are extracted with their context and normalised: thousands separators, currency symbols, percentages, multipliers (12k, 1.5M, 2B, 万, 亿) and units (ms, s, min, h; KB, MB, GB, TB) are all understood.
- Every number in the AI answer is searched in the source, allowing rounding inside the tolerance you set. A match is reported with the exact source line as evidence.
- A number with no match is flagged in red. Green means "traceable to your source", it does not mean the source itself is correct.
FAQ
Is my data uploaded anywhere?
No. The checker is a single HTML page: extraction, matching and export all run in your browser with JavaScript. Internal reports, CI logs and financial figures never leave your machine, and there is nothing to sign up for.
What kind of source data works best?
Anything that contains the numbers verbatim: a CSV or TSV export, a Markdown table, a CI log with durations, a SQL result, a JSON dump, or a plain text file. Summaries and screenshots work poorly, because the numbers you want to verify may have been rounded away before you copied them.
What does it not catch?
Wrong conclusions built from correct numbers, numbers that only exist in a source you did not paste, and rounding differences larger than your tolerance. Use it to catch fabricated or stale figures quickly, then apply human judgement to the argument itself.