Entropic risk minimization for nonparametric estimation of mixing distributions

Verfasser / Beitragende:
[Kazuho Watanabe, Shiro Ikeda]
Ort, Verlag, Jahr:
2015
Enthalten in:
Machine Learning, 99/1(2015-04-01), 119-136
Format:
Artikel (online)
ID: 605478422
LEADER caa a22 4500
001 605478422
003 CHVBK
005 20210128100405.0
007 cr unu---uuuuu
008 210128e20150401xx s 000 0 eng
024 7 0 |a 10.1007/s10994-014-5467-7  |2 doi 
035 |a (NATIONALLICENCE)springer-10.1007/s10994-014-5467-7 
245 0 0 |a Entropic risk minimization for nonparametric estimation of mixing distributions  |h [Elektronische Daten]  |c [Kazuho Watanabe, Shiro Ikeda] 
520 3 |a We discuss a nonparametric estimation method for the mixing distributions in mixture models. The problem is formalized as a minimization of a one-parameter objective functional, which becomes the maximum likelihood estimation or the kernel vector quantization in special cases. Generalizing the theorem for the nonparametric maximum likelihood estimation, we prove the existence and discreteness of the optimal mixing distribution and provide an algorithm to calculate it. It is demonstrated that with an appropriate choice of the parameter, the proposed method is less prone to overfitting than the maximum likelihood method. We further discuss the connection between the unifying estimation framework and the rate-distortion problem. 
540 |a The Author(s), 2014 
690 7 |a Mixture models  |2 nationallicence 
690 7 |a Nonparametric estimation  |2 nationallicence 
690 7 |a Entropic risk measure  |2 nationallicence 
690 7 |a Rate-distortion theory  |2 nationallicence 
700 1 |a Watanabe  |D Kazuho  |u Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka, Tempaku-cho, 441-8580, Toyohashi, Japan  |4 aut 
700 1 |a Ikeda  |D Shiro  |u The Institute of Statistical Mathematics, 10-3, Midori-cho, 190-8562, Tachikawa-shi, Tokyo, Japan  |4 aut 
773 0 |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 99/1(2015-04-01), 119-136  |x 0885-6125  |q 99:1<119  |1 2015  |2 99  |o 10994 
856 4 0 |u https://doi.org/10.1007/s10994-014-5467-7  |q text/html  |z Onlinezugriff via DOI 
898 |a BK010053  |b XK010053  |c XK010000 
900 7 |a Metadata rights reserved  |b Springer special CC-BY-NC licence  |2 nationallicence 
908 |D 1  |a research-article  |2 jats 
949 |B NATIONALLICENCE  |F NATIONALLICENCE  |b NL-springer 
950 |B NATIONALLICENCE  |P 856  |E 40  |u https://doi.org/10.1007/s10994-014-5467-7  |q text/html  |z Onlinezugriff via DOI 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Watanabe  |D Kazuho  |u Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka, Tempaku-cho, 441-8580, Toyohashi, Japan  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Ikeda  |D Shiro  |u The Institute of Statistical Mathematics, 10-3, Midori-cho, 190-8562, Tachikawa-shi, Tokyo, Japan  |4 aut 
950 |B NATIONALLICENCE  |P 773  |E 0-  |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 99/1(2015-04-01), 119-136  |x 0885-6125  |q 99:1<119  |1 2015  |2 99  |o 10994