#financial-literacy

Financial Literacy

Research on financial knowledge representation and LLM competency

June 23, 20266 min read

LLMs Score 2.3% on Beancount DSL Generation: The LLMFinLiteracy Benchmark

LLMFinLiteracy finds five ~7B models write correct Beancount transactions just 2.3% of the time, failing on accounting reasoning rather than syntax.

Mike Thrift

llmbeancountplain-text-accounting

April 18, 20265 min read

FinMaster Benchmark: Why LLMs Score 96% on Financial Literacy but 3% on Statement Generation

FinMaster Benchmark: top LLMs hit 96% on financial literacy but only 3% on statement generation. Error propagation costs 21 points on consulting tasks.

Mike Thrift

llmaccountingai

Start Free→Documentation