Accuracy in LLM legal information extraction rose from 52% to 70%
Photo: The Cryptonomist
Revised instructions were associated with an increase in accuracy from 52% to 70% in a study of LLM-based legal information extraction submitted on November 2, 2026. But Tomáš Knap and colleagues also found that a model agreeing with itself was no guarantee that it had extracted the right answer. The researchers present a pipeline for turning criminal verdicts into structured datasets . These decisions describe criminal behavior that can support quantitative legal research, but the attributes and extraction rules needed to organize that information cannot always be settled in advance.
Source: The Cryptonomist
