Rxivist logo

To pool or not to pool: Can we ignore cross-trial variability in FMRI?

By Gang Chen, Srikanth Padmala, Yi Chen, Paul A. Taylor, Robert W. Cox, Luiz Pessoa

Posted 22 May 2020
bioRxiv DOI: 10.1101/2020.05.19.102111 (published DOI: 10.1016/j.neuroimage.2020.117496)

In this work, we investigate the importance of explicitly accounting for cross-trial variability in neuroimaging data analysis. To attempt to obtain reliable estimates in a task-based experiment, each condition is usually repeated across many trials. The investigator may be interested in (a) condition-level effects, (b) trial-level effects, or (c) the association of trial-level effects with the corresponding behavior data. The typical strategy for condition-level modeling is to create one regressor per condition at the subject level with the underlying assumption that responses do not change across trials. In this methodology of complete pooling, all cross-trial variability is ignored and dismissed as random noise that is swept under the rug of model residuals. Unfortunately, this framework invalidates the generalizability from the confine of specific trials (e.g., particular faces) to the associated stimulus category ("face"). Here we propose an adaptive and computationally tractable framework that meshes well with the current two-level pipeline and explicitly accounts for trial-by-trial variability. The trial-level effects are first estimated per subject through no pooling. To allow generalizing beyond the particular stimulus set employed, the cross-trial variability is modeled at the population level through partial pooling in a multilevel model, which permits accurate effect estimation and characterization. Alternatively, trial-level estimates can be used to investigate, for example, brain-behavior associations or correlations between brain regions. Furthermore, our approach allows appropriate accounting for serial correlation, handling outliers, adapting to data skew, and capturing nonlinear brain-behavior relationships. By applying a Bayesian multilevel model framework at the level of regions of interest to an experimental dataset, we show how multiple testing can be addressed and full results reported without arbitrary dichotomization. Our approach revealed important differences compared to the conventional method at the condition level, including how the latter can distort effect magnitude and precision. Notably, in some cases our approach led to increased statistical sensitivity. In summary, our proposed framework provides an effective strategy to capture trial-by-trial responses that should be of interest to a wide community of experimentalists. ### Competing Interest Statement The authors have declared no competing interest.

Download data

  • Downloaded 490 times
  • Download rankings, all-time:
    • Site-wide: 68,672
    • In neuroscience: 9,975
  • Year to date:
    • Site-wide: 121,260
  • Since beginning of last month:
    • Site-wide: 132,348

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide