We use cookies to ensure that we give you the best experience on our website. By continuing to browse this repository, you give consent for essential cookies to be used. You can read more about our Privacy and Cookie Policy.

Durham Research Online
You are in:

Scalable Bayesian regression in high dimensions with multiple data sources.

Perrakis, Konstantinos and Mukherjee, Sach and The Alzheimer’s Disease Neuroimaging Initiative , (2020) 'Scalable Bayesian regression in high dimensions with multiple data sources.', Journal of computational and graphical statistics., 29 (1). pp. 28-39.


Applications of high-dimensional regression often involve multiple sources or types of covariates. We propose methodology for this setting, emphasizing the “wide data” regime with large total dimensionality p and sample size n≪p. We focus on a flexible ridge-type prior with shrinkage levels that are specific to each data type or source and that are set automatically by empirical Bayes. All estimation, including setting of shrinkage levels, is formulated mainly in terms of inner product matrices of size n×n. This renders computation efficient in the wide data regime and allows scaling to problems with millions of features. Furthermore, the proposed procedures are free of user-set tuning parameters. We show how sparsity can be achieved by post-processing of the Bayesian output via constrained minimization of a certain Kullback–Leibler divergence. This yields sparse solutions with adaptive, source-specific shrinkage, including a closed-form variant that scales to very large p. We present empirical results from a simulation study based on real data and a case study in Alzheimer’s disease involving millions of features and multiple data sources.

Item Type:Article
Full text:(AM) Accepted Manuscript
Download PDF
Publisher Web site:
Publisher statement:This is an Accepted Manuscript of an article published by Taylor & Francis in Journal of computational and graphical statistics on 15 July 2019 available online:
Date accepted:14 May 2019
Date deposited:03 October 2019
Date of first online publication:15 July 2019
Date first made open access:15 July 2020

Save or Share this output

Look up in GoogleScholar