Seven participants, one model layer, one story dataset
The brain data come from seven participants listening to autobiographical stories from the Moth Radio Hour while undergoing fMRI. Word-level representations were aligned to the fMRI signal and expanded with four delayed copies covering roughly 2 to 8 seconds to account for the hemodynamic response. For each voxel, an encoding model was trained on nine stories and tested on a held-out story, with analyses restricted to voxels whose estimated noise ceiling exceeded 0.4.
LLaMA2-7B features came from layer 15 of 32, an intermediate layer chosen because intermediate layers tend to be among the most brain-predictive. SCRIBE scores were produced by an ensemble of four LLM annotators and had previously been validated against contextual semantic judgments from 921 human participants, reaching 75–81% of the estimated human noise ceiling.
One asymmetry is built into the design: LLaMA2-7B saw a sliding context window of 256 to 512 preceding words, while SCRIBE used a 10-token window. The authors kept each representation in its standard configuration and note that LLaMA-unique variance may therefore partly reflect longer-range context. Because the study covers one model, one layer, one dataset, and seven participants, the conclusions are specific to this setting.
Semantic contributions accumulate across many properties
The second property-level analysis removed one SCRIBE dimension at a time across all 65 and retrained the SCRIBE and joint models, ranking properties by their mean whole-brain decrease in shared and SCRIBE-unique variance. Because the properties are correlated, a leave-one-out decrease measures a property's unique contribution given the other 64, not its overall importance.
From those rankings the authors built nested top-5, top-10, and top-20 sets, removed each set, and recomputed the variance partitioning. The result was cumulative: semantic contributions extended across multiple dimensions, with cumulative effects on both shared and SCRIBE-unique variance. No single property carried the alignment.
The authors also flag a measurement issue: SCRIBE-unique variance is small, so its percentage changes are unstable. They therefore ranked and tested on absolute decreases and summarized SCRIBE-unique changes by the median percentage across participants. With seven participants, the smallest attainable p-value in the paired one-sided exact Wilcoxon tests is 1/27 ≈ 0.0078, reached only when all seven show an effect in the same direction, which is why the paper also reports how many participants show each effect.
The result is a decomposition, not a causal claim
The variance components are statistical partitions of held-out prediction variance, not causal statements about what the brain uses. Shared variance means both representations predict the same brain-response variance; it does not establish that LLaMA2-7B computes meaning the way the brain does, nor that SCRIBE's properties are the mechanism behind the alignment.
The practical priority the paper supports is narrower and more useful: when evaluating brain-LLM alignment, the shared-versus-unique split tells you how much of a model's predictivity an interpretable semantic basis can already account for. Here that shared portion was dominant, and the concrete-versus-abstract comparison and the cumulative ablation effects describe where the remaining interpretable signal sits.
For readers comparing models or representations, the paper's own threshold is the noise-ceiling cutoff of 0.4 and its region set of whole brain, late language network, angular gyrus, lateral temporal cortex, and IFG/MFG. Conclusions drawn outside that voxel selection, region set, model, layer, or dataset are not tested here.
Sources used in this answer
Decomposing Brain-LLM Alignment with Interpretable Semantic Representations
Variance partitioning between LLaMA2-7B and SCRIBE on Moth Radio Hour fMRI data from seven participants shows shared variance is dominant across the whole brain and language-related regions, while both representations retain significant unique contributions; concrete properties share more variance than abstract ones, and property ablations show cumulative effects.
