# Аналитика

Техники и метрики за анализ на данни за финансови ИИ системи

8 публикации [Вижте всички етикети](https://beancount.io/bg/bean-labs/research-logs/tags) [Обратно към всички публикации](https://beancount.io/bg/bean-labs/research-logs)

3 юли 2026 г. 5 минути четене

## [LLM Anomaly Detection Survey (NAACL 2025): Strong Taxonomy, Absent Tabular Coverage](https://beancount.io/bg/bean-labs/research-logs/2026/07/03/llm-anomaly-ood-detection-survey)

The NAACL 2025 taxonomy holds, but tabular coverage is absent. Finance AI teams must adapt vision-model methods themselves.

Mike Thrift

ai llm machine-learning

29 юни 2026 г. 6 минути четене

## [Fin-RATE: How LLMs Fail at Cross-Period and Cross-Entity Financial Analysis](https://beancount.io/bg/bean-labs/research-logs/2026/06/29/fin-rate-real-world-financial-analytics-tracking-evaluation-benchmark)

Fin-RATE shows LLM accuracy collapses 18.60% on longitudinal tracking, with the retrieval pipeline, not the model, as the binding bottleneck.

Mike Thrift

llm ai machine-learning

27 юни 2026 г. 6 минути четене

## [Lost in the Middle: Position Bias in LLMs and Its Impact on Finance AI](https://beancount.io/bg/bean-labs/research-logs/2026/06/27/lost-in-the-middle-language-models-long-contexts)

LLMs score up to 20 points worse when the answer sits mid-context, so finance RAG pipelines should place the best passages first or last.

Mike Thrift

llm ai machine-learning

26 юни 2026 г. 6 минути четене

## [AD-LLM Benchmark: GPT-4o Hits 0.93+ AUROC Zero-Shot for Text Anomaly Detection](https://beancount.io/bg/bean-labs/research-logs/2026/06/26/ad-llm-benchmarking-llms-anomaly-detection)

AD-LLM finds GPT-4o hits 0.93–0.99 AUROC zero-shot for text anomaly detection, but LLM model selection stays unreliable for financial audit AI.

Mike Thrift

llm ai machine-learning

12 юни 2026 г. 6 минути четене

## [τ-bench: Measuring AI Agent Reliability in Real-World Tool-Use Domains](https://beancount.io/bg/bean-labs/research-logs/2026/06/12/tau-bench-tool-agent-user-interaction-real-world-domains)

τ-bench finds top LLMs fall from pass\@1 0.692 to pass\@4 0.462 on retail tool-use tasks. Write-back agents on a ledger face the same consistency cliff.

Mike Thrift

ai llm machine-learning

15 май 2026 г. 6 минути четене

## [ConvFinQA: models trail experts by 21 points (68.9%)](https://beancount.io/bg/bean-labs/research-logs/2026/05/15/convfinqa-chain-numerical-reasoning-conversational-finance-qa)

ConvFinQA's best model scores 68.9% execution accuracy versus 89.4% for human experts—a 21-point gap that multi-turn ledger chat still faces.

Mike Thrift

ai llm machine-learning

12 май 2026 г. 5 минути четене

## [FinanceBench: Why Vector-Store RAG Fails on Real Financial Documents](https://beancount.io/bg/bean-labs/research-logs/2026/05/12/financebench-open-book-financial-qa-benchmark)

FinanceBench tests 16 AI setups on 10,231 real SEC filing questions: shared-vector-store RAG answers only 19% right, so retrieval is not the bottleneck.

Mike Thrift

ai llm machine-learning

24 април 2026 г. 5 минути четене

## [Самосъгласуваност: Извадково гласуване с мнозинство подобрява точността на веригата на мисълта](https://beancount.io/bg/bean-labs/research-logs/2026/04/24/self-consistency-chain-of-thought)

Self-consistency гласува по мнозинство сред много избрани пътища на разсъждение вместо едно алчно декодиране, добавяйки 17.9 точки на GSM8K без допълнително обучение.

Mike Thrift

ai llm machine-learning

[Започни безплатно→](https://beancount.io/sign-up/?next=%2Fledger%2F) [Документация](https://beancount.io/bg/docs)

## Where to look next

- [Sitemap](https://beancount.io/sitemap.xml) - all pages with hreflang alternates
- [LLMs index](https://beancount.io/llms.txt) - curated links for AI agents (also /llms-full.txt for full docs)
- [Documentation](https://beancount.io/docs) - every doc is also available as text/markdown via .md suffix or Accept negotiation
- [REST API reference](https://beancount.io/docs/api-reference) - interactive endpoints, schemas, authentication, and code samples
- [OpenAPI spec](https://beancount.io/openapi.json) - OpenAPI 3.1 spec for this website's public content endpoints; the product contract for ledger operations is at https://beancount.io/api-gateway/v1/openapi.json
- [GraphQL](https://beancount.io/graphql) - public, read-only content API over the blog and research logs (no credentials, no ledger data): 12 query fields over 23 types
- [MCP server](https://beancount.io/mcp) - Model Context Protocol at https://beancount.io/api-gateway/mcp
