Minimum message length estimation of mixtures of multivariate Gaussian and von Mises-Fisher distributions

Verfasser / Beitragende:
[Parthan Kasarapu, Lloyd Allison]
Ort, Verlag, Jahr:
2015
Enthalten in:
Machine Learning, 100/2-3(2015-09-01), 333-378
Format:
Artikel (online)
ID: 605478295
LEADER caa a22 4500
001 605478295
003 CHVBK
005 20210128100405.0
007 cr unu---uuuuu
008 210128e20150901xx s 000 0 eng
024 7 0 |a 10.1007/s10994-015-5493-0  |2 doi 
035 |a (NATIONALLICENCE)springer-10.1007/s10994-015-5493-0 
245 0 0 |a Minimum message length estimation of mixtures of multivariate Gaussian and von Mises-Fisher distributions  |h [Elektronische Daten]  |c [Parthan Kasarapu, Lloyd Allison] 
520 3 |a Mixture modelling involves explaining some observed evidence using a combination of probability distributions. The crux of the problem is the inference of an optimal number of mixture components and their corresponding parameters. This paper discusses unsupervised learning of mixture models using the Bayesian Minimum Message Length (MML) criterion. To demonstrate the effectiveness of search and inference of mixture parameters using the proposed approach, we select two key probability distributions, each handling fundamentally different types of data: the multivariate Gaussian distribution to address mixture modelling of data distributed in Euclidean space, and the multivariate von Mises-Fisher (vMF) distribution to address mixture modelling of directional data distributed on a unit hypersphere. The key contributions of this paper, in addition to the general search and inference methodology, include the derivation of MML expressions for encoding the data using multivariate Gaussian and von Mises-Fisher distributions, and the analytical derivation of the MML estimates of the parameters of the two distributions. Our approach is tested on simulated and real world data sets. For instance, we infer vMF mixtures that concisely explain experimentally determined three-dimensional protein conformations, providing an effective null model description of protein structures that is central to many inference problems in structural bioinformatics. The experimental results demonstrate that the performance of our proposed search and inference method along with the encoding schemes improve on the state of the art mixture modelling techniques. 
540 |a The Author(s), 2015 
690 7 |a Mixture modelling  |2 nationallicence 
690 7 |a Minimum message length  |2 nationallicence 
690 7 |a Multivariate Gaussian  |2 nationallicence 
690 7 |a von Mises-Fisher  |2 nationallicence 
690 7 |a Protein structure  |2 nationallicence 
700 1 |a Kasarapu  |D Parthan  |u Faculty of Information Technology, Monash University, 3800, Melbourne, VIC, Australia  |4 aut 
700 1 |a Allison  |D Lloyd  |u Faculty of Information Technology, Monash University, 3800, Melbourne, VIC, Australia  |4 aut 
773 0 |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 100/2-3(2015-09-01), 333-378  |x 0885-6125  |q 100:2-3<333  |1 2015  |2 100  |o 10994 
856 4 0 |u https://doi.org/10.1007/s10994-015-5493-0  |q text/html  |z Onlinezugriff via DOI 
898 |a BK010053  |b XK010053  |c XK010000 
900 7 |a Metadata rights reserved  |b Springer special CC-BY-NC licence  |2 nationallicence 
908 |D 1  |a research-article  |2 jats 
949 |B NATIONALLICENCE  |F NATIONALLICENCE  |b NL-springer 
950 |B NATIONALLICENCE  |P 856  |E 40  |u https://doi.org/10.1007/s10994-015-5493-0  |q text/html  |z Onlinezugriff via DOI 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Kasarapu  |D Parthan  |u Faculty of Information Technology, Monash University, 3800, Melbourne, VIC, Australia  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Allison  |D Lloyd  |u Faculty of Information Technology, Monash University, 3800, Melbourne, VIC, Australia  |4 aut 
950 |B NATIONALLICENCE  |P 773  |E 0-  |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 100/2-3(2015-09-01), 333-378  |x 0885-6125  |q 100:2-3<333  |1 2015  |2 100  |o 10994