# Наука за данни

Методи на науката за данни, приложени към финансови набори от данни и счетоводни работни процеси

40 публикации [Вижте всички етикети](https://beancount.io/bg/bean-labs/research-logs/tags) [Обратно към всички публикации](https://beancount.io/bg/bean-labs/research-logs)

12 юли 2026 г. 5 минути четене

## [FinRAGBench-V: Multimodal RAG with Visual Citations in the Financial Domain](https://beancount.io/bg/bean-labs/research-logs/2026/07/12/finragbench-v-multimodal-rag-visual-citation-financial-domain)

FinRAGBench-V finds top models reach only 20–61% block-level citation recall on financial pages. Multimodal retrieval beats text-only by nearly 50 points.

Mike Thrift

ai llm machine-learning

10 юли 2026 г. 6 минути четене

## [WildToolBench: Why No LLM Exceeds 15% Session Accuracy in Real-World Tool Use](https://beancount.io/bg/bean-labs/research-logs/2026/07/10/wildtoolbench-benchmarking-llm-tool-use-in-the-wild)

WildToolBench finds no LLM exceeds 15% session accuracy on 1,024 real-user tasks, with hidden intent and instruction transitions the sharpest failure modes.

Mike Thrift

ai llm automation

9 юли 2026 г. 6 минути четене

## [LLM Confidence and Calibration: A Survey of What the Research Actually Shows](https://beancount.io/bg/bean-labs/research-logs/2026/07/09/confidence-estimation-calibration-llms-survey)

Verbalized GPT-4 confidence hits only \~62.7% AUROC, barely above chance. Uncertainty-aware finance agents need better calibration than that.

Mike Thrift

llm ai machine-learning

5 юли 2026 г. 6 минути четене

## [FinToolBench: Оценка на LLM агенти при реален финансов инструментариум](https://beancount.io/bg/bean-labs/research-logs/2026/07/05/fintoolbench-evaluating-llm-agents-real-world-financial-tool-use)

FinToolBench съчетава 760 реални финансови API инструмента с 295 изпълними заявки, за да оцени LLM агенти върху реални финансови задачи — разкривайки, че консервативният процент на извикване от 22,7% на GPT-4o води до по-високо качество на отговорите (CSS 0,670) от агресивния TIR от 87,1% на Qwen3-8B, докато несъответствието на намеренията надхвърля 50% при всеки тестван модел.

Mike Thrift

ai llm automation

4 юли 2026 г. 5 минути четене

## [OmniEval: Omnidirectional RAG Evaluation Benchmark for the Financial Domain](https://beancount.io/bg/bean-labs/research-logs/2026/07/04/omnieval-omnidirectional-automatic-rag-evaluation-financial-domain)

OmniEval scores the best RAG systems at 36% numerical accuracy across 5 financial task types, so ledger agents need validation before writing entries.

Mike Thrift

ai machine-learning llm

3 юли 2026 г. 5 минути четене

## [LLM Anomaly Detection Survey (NAACL 2025): Strong Taxonomy, Absent Tabular Coverage](https://beancount.io/bg/bean-labs/research-logs/2026/07/03/llm-anomaly-ood-detection-survey)

The NAACL 2025 taxonomy holds, but tabular coverage is absent. Finance AI teams must adapt vision-model methods themselves.

Mike Thrift

ai llm machine-learning

2 юли 2026 г. 6 минути четене

## [Found in the Middle: Calibrating Positional Attention Bias Improves Long-Context RAG](https://beancount.io/bg/bean-labs/research-logs/2026/07/02/found-in-the-middle-calibrating-positional-attention-bias)

Subtracting positional bias from LLM attention weights recovers up to 15 points of RAG accuracy when evidence sits mid-context, aiding finance agent pipelines.

Mike Thrift

ai llm machine-learning

29 юни 2026 г. 6 минути четене

## [Fin-RATE: How LLMs Fail at Cross-Period and Cross-Entity Financial Analysis](https://beancount.io/bg/bean-labs/research-logs/2026/06/29/fin-rate-real-world-financial-analytics-tracking-evaluation-benchmark)

Fin-RATE shows LLM accuracy collapses 18.60% on longitudinal tracking, with the retrieval pipeline, not the model, as the binding bottleneck.

Mike Thrift

llm ai machine-learning

28 юни 2026 г. 6 минути четене

## [FinDER: Real Analyst Queries Expose a 74% Recall Gap in Financial RAG](https://beancount.io/bg/bean-labs/research-logs/2026/06/28/finder-financial-dataset-rag-evaluation)

FinDER's 5,703 real analyst queries show top RAG recalls only 25.95% of 10-K evidence. Normalize abbreviations first, before swapping embeddings.

Mike Thrift

ai llm machine-learning

27 юни 2026 г. 6 минути четене

## [Lost in the Middle: Position Bias in LLMs and Its Impact on Finance AI](https://beancount.io/bg/bean-labs/research-logs/2026/06/27/lost-in-the-middle-language-models-long-contexts)

LLMs score up to 20 points worse when the answer sits mid-context, so finance RAG pipelines should place the best passages first or last.

Mike Thrift

llm ai machine-learning

26 юни 2026 г. 6 минути четене

## [AD-LLM Benchmark: GPT-4o Hits 0.93+ AUROC Zero-Shot for Text Anomaly Detection](https://beancount.io/bg/bean-labs/research-logs/2026/06/26/ad-llm-benchmarking-llms-anomaly-detection)

AD-LLM finds GPT-4o hits 0.93–0.99 AUROC zero-shot for text anomaly detection, but LLM model selection stays unreliable for financial audit AI.

Mike Thrift

llm ai machine-learning

25 юни 2026 г. 6 минути четене

## [CausalTAD: Causal Column Ordering for LLM Tabular Anomaly Detection](https://beancount.io/bg/bean-labs/research-logs/2026/06/25/causaltad-causal-knowledge-llm-tabular-anomaly-detection)

CausalTAD reorders table columns by causal dependency before LLM serialization, raising average AUC-ROC from 0.803 to 0.834 over AnoLLM.

Mike Thrift

llm ai machine-learning

[Започни безплатно→](https://beancount.io/sign-up/?next=%2Fledger%2F) [Документация](https://beancount.io/bg/docs)

## Where to look next

- [Sitemap](https://beancount.io/sitemap.xml) - all pages with hreflang alternates
- [LLMs index](https://beancount.io/llms.txt) - curated links for AI agents (also /llms-full.txt for full docs)
- [Documentation](https://beancount.io/docs) - every doc is also available as text/markdown via .md suffix or Accept negotiation
- [REST API reference](https://beancount.io/docs/api-reference) - interactive endpoints, schemas, authentication, and code samples
- [OpenAPI spec](https://beancount.io/openapi.json) - OpenAPI 3.1 spec for this website's public content endpoints; the product contract for ledger operations is at https://beancount.io/api-gateway/v1/openapi.json
- [GraphQL](https://beancount.io/graphql) - public, read-only content API over the blog and research logs (no credentials, no ledger data): 12 query fields over 23 types
- [MCP server](https://beancount.io/mcp) - Model Context Protocol at https://beancount.io/api-gateway/mcp
