Article · Russian Digital Libraries Journal · December 4, 2025

Measuring Uncertainty in Transformer Circuits with Effective Information Consistency

Abstract

Mechanistic interpretability has identified functional subgraphs within large language models (LLMs), known as Transformer Circuits (TCs), that appear to implement specific algorithms. Yet we lack a formal, single-pass way to quantify when an active circuit is behaving coherently and thus likely trustworthy. Building on the author’s prior sheaf‑theoretic formulation of causal emergence (Krasnovsky, 2025), we specialize it to transformer circuits and introduce the single‑pass, dimensionless Effective‑Information Consistency Score (EICS). EICS combines (i) a normalized sheaf inconsistency computed from local Jacobians and activations, with (ii) a Gaussian EI proxy for circuit-level causal emergence derived from the same forward state. The construction is white-box, single-pass, and makes units explicit so that the score is dimensionless. We further provide practical guidance on score interpretation, computational overhead (with fast and exact modes), and a toy sanity-check analysis.

Explainable Artificial Intelligence (XAI)Adversarial Robustness in Machine LearningDiverse Interdisciplinary Research Studiestransformer circuitseffective informationcausal emergence

Measuring Uncertainty in Transformer Circuits with Effective Information Consistency

Abstract

More by Anatoly Krasnovsky