A note on rank reduction in sparse multivariate regression

J Stat Theory Pract. 2016;10(1):100-120. doi: 10.1080/15598608.2015.1081573. Epub 2015 Aug 18.

Abstract

A reduced-rank regression with sparse singular value decomposition (RSSVD) approach was proposed by Chen et al. for conducting variable selection in a reduced-rank model. To jointly model the multivariate response, the method efficiently constructs a prespecified number of latent variables as some sparse linear combinations of the predictors. Here, we generalize the method to also perform rank reduction, and enable its usage in reduced-rank vector autoregressive (VAR) modeling to perform automatic rank determination and order selection. We show that in the context of stationary time-series data, the generalized approach correctly identifies both the model rank and the sparse dependence structure between the multivariate response and the predictors, with probability one asymptotically. We demonstrate the efficacy of the proposed method by simulations and analyzing a macro-economical multivariate time series using a reduced-rank VAR model.

Keywords: Reduced-rank; rank selection; singular value decomposition; sparsity; vector autoregressive model.