Working demo · Open source2026

Invoice Inbox

Reads each invoice twice, with plain code and with Gemini. The rules decide, never the AI.

  • Plain-code readerParses the text
  • Gemini readerReads the same fields
Rules decideThe AI never approves
  • ReadyEvery check passed
  • Needs a personHeld, with the reason
Illustration of how Invoice Inbox works.
Invoice Inbox demo: a queue of invoices on the left, and one invoice held because its total does not add up
Screenshot of the live demo, with generated invoices and made-up companies.

Invoice Inbox reads each invoice twice, once with plain code and once with Gemini, and lets plain rules decide what is ready. The AI never approves anything.

What it does

You drop in an invoice. Two readers extract the fields. If they disagree, or a check fails, the invoice does not reach "Ready". The model reads. The rules decide.

What I measured

On 88 generated test invoices (40 known, 48 held out), no bad invoice reached "Ready" and all 24 planted errors were caught. The AI read 512 of 517 held-out fields correctly. I measured this on 6 Nov 2026, and Claude reproduced it on 9 Nov 2026.

One result worth knowing about: a hidden instruction fooled the AI into reading a total of 120.00. The total check caught it.

What it doesn't show

These are generated invoices from made-up companies. No firm uses it, and I can't say real invoices would score the same. The live site has uploads switched off. It is open source (MIT) with 76 tests passing.

Questions about Invoice Inbox

What is Invoice Inbox?

A demo that reads each invoice twice, once with plain code and once with Gemini. Plain rules decide whether an invoice is ready, so the AI never approves anything.

How was Invoice Inbox measured?

On 88 generated test invoices (40 known, 48 held out), no bad invoice reached Ready and all 24 planted errors were caught. The AI read 512 of 517 held-out fields correctly. Measured on 6 Nov 2026 and reproduced on 9 Nov 2026.

What doesn't Invoice Inbox show?

The invoices are generated, from made-up companies. No firm uses it, so I can't say real invoices would score the same.

Can I try Invoice Inbox?

Yes. The live demo is at invoice-inbox-demo.vercel.app with uploads switched off, and the code is MIT licensed on GitHub.

Last updated 12 Nov 2026