https://anaivebidder.com/tags/fintech/Recent content in Fintech on A naive bidderen-usTue, 10 Nov 2026 06:00:00 +0100https://anaivebidder.com/posts/llm-reconciliation-benchmark/Tue, 10 Nov 2026 06:00:00 +0100Ruben Afonsohttps://anaivebidder.com/posts/llm-reconciliation-benchmark/<p>Can an AI agent open an Outlook email, follow it into an Excel workbook, query a database it has never seen and come back with the right number?</p> <p>In my last post, <a href="https://anaivebidder.com/posts/build-your-own-llm-benchmark/">How to Build your Own LLM Benchmark</a>, I shared tips for building your own. I kept two things back: the model names and the benchmark itself. Today you get both.</p> <p>Meet <a href="https://github.com/rubenafo/finrec-bm"><strong>finrec-bm</strong></a>, my benchmark for financial reconciliation, now on GitHub. It hands AI agents a number to verify and a pile of evidence: emails, spreadsheets, screenshots and a database. The answer has to be right to the cent, with the paper trail to prove it.</p>