Sparse multimodal Gaussian processes

Abstract

Gaussian processes (GPs) are effective tools in machine learning. Unfortunately, due to their unfavorable scaling, a more widespread use has probably been impeded. By leveraging sparse approximation methods, sparse Gaussian processes extend the applicability of GPs to a richer data. Multimodal data are common in machine learning applications. However, there are few sparse multimodal approximation methods for GPs applicable to multimodal data. In this paper, we present two kinds of sparse multimodal approaches for multi-view GPs, the maximum informative vector machine (mIVM) and the alternative manifold-preserving (aMP), which are inspired by the information theory and the manifold preserving principle, respectively. The aMP uses an alternative selection strategy for preserving the high space connectivity. In the experiments, we apply the proposed sparse multimodal methods to a recent framework of multi-view GPs, and results have verified the effectiveness of the proposed methods.