Epistemic orientation in parliamentary discourse is associated with deliberative democracy

Researchers developed an LLM-based metric to quantify whether parliamentary speech leans toward evidence or intuition, then applied it to 15 million speeches across seven countries since 1946. The analysis reveals correlations between evidence-based discourse and stronger democratic institutions, offering a scalable method for measuring epistemic quality in political communication.
Modelwire context
ExplainerThe correlation between evidence-based speech and democratic health is the headline, but the more consequential methodological question is whether an LLM-derived score can reliably distinguish 'evidence' from 'intuition' in political rhetoric across seven languages and eight decades without systematic bias baked in from training data. The paper's causal claims, if any, deserve scrutiny that the summary doesn't invite.
The reliability problem here connects directly to coverage from mid-April: 'Diagnosing LLM Judge Reliability' found that even when aggregate consistency looks high, one-third to two-thirds of documents show logical inconsistencies in pairwise comparisons. Applying that finding to EMI scores across 15 million speeches is not a small concern. If the judge is inconsistent at the document level, a country-level aggregate could still look stable while masking substantial noise. The 'Context Over Content' paper from the same period adds another wrinkle, showing LLM judges shift verdicts based on framing rather than substance, which is a particular hazard when scoring politically charged speech.
Watch whether the authors release per-country, per-decade reliability diagnostics for the EMI scorer itself. If the score variance within clearly authoritarian periods is as high as within democratic ones, the correlation finding weakens considerably.
This analysis is generated by Modelwire’s editorial layer from our archive and the summary above. It is not a substitute for the original reporting. How we write it.
MentionsEvidence-Minus-Intuition (EMI) score
Modelwire summarizes — we don’t republish. The full article lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.