Bayesian multi-task learning for decoding multi-subject neuroimaging data

Neuroimage. 2014 May 15;92(100):298-311. doi: 10.1016/j.neuroimage.2014.02.008. Epub 2014 Feb 13.


Decoding models based on pattern recognition (PR) are becoming increasingly important tools for neuroimaging data analysis. In contrast to alternative (mass-univariate) encoding approaches that use hierarchical models to capture inter-subject variability, inter-subject differences are not typically handled efficiently in PR. In this work, we propose to overcome this problem by recasting the decoding problem in a multi-task learning (MTL) framework. In MTL, a single PR model is used to learn different but related "tasks" simultaneously. The primary advantage of MTL is that it makes more efficient use of the data available and leads to more accurate models by making use of the relationships between tasks. In this work, we construct MTL models where each subject is modelled by a separate task. We use a flexible covariance structure to model the relationships between tasks and induce coupling between them using Gaussian process priors. We present an MTL method for classification problems and demonstrate a novel mapping method suitable for PR models. We apply these MTL approaches to classifying many different contrasts in a publicly available fMRI dataset and show that the proposed MTL methods produce higher decoding accuracy and more consistent discriminative activity patterns than currently used techniques. Our results demonstrate that MTL provides a promising method for multi-subject decoding studies by focusing on the commonalities between a group of subjects rather than the idiosyncratic properties of different subjects.

Keywords: Decoding; Functional magnetic resonance imaging; Gaussian process; Machine learning; Mixed effects; Multi-output learning; Multi-task learning; Pattern recognition; Repeated measures; Transfer learning.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adult
  • Algorithms
  • Artificial Intelligence*
  • Bayes Theorem*
  • Brain Mapping / methods*
  • Female
  • Humans
  • Image Interpretation, Computer-Assisted / methods
  • Male
  • Memory, Episodic*
  • Pattern Recognition, Automated / methods*
  • Pattern Recognition, Visual / physiology*
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Visual Cortex / physiology*
  • Young Adult