Entropic risk minimization for nonparametric estimation of mixing distributions
Gespeichert in:
Verfasser / Beitragende:
[Kazuho Watanabe, Shiro Ikeda]
Ort, Verlag, Jahr:
2015
Enthalten in:
Machine Learning, 99/1(2015-04-01), 119-136
Format:
Artikel (online)
Online Zugang:
| LEADER | caa a22 4500 | ||
|---|---|---|---|
| 001 | 605478422 | ||
| 003 | CHVBK | ||
| 005 | 20210128100405.0 | ||
| 007 | cr unu---uuuuu | ||
| 008 | 210128e20150401xx s 000 0 eng | ||
| 024 | 7 | 0 | |a 10.1007/s10994-014-5467-7 |2 doi |
| 035 | |a (NATIONALLICENCE)springer-10.1007/s10994-014-5467-7 | ||
| 245 | 0 | 0 | |a Entropic risk minimization for nonparametric estimation of mixing distributions |h [Elektronische Daten] |c [Kazuho Watanabe, Shiro Ikeda] |
| 520 | 3 | |a We discuss a nonparametric estimation method for the mixing distributions in mixture models. The problem is formalized as a minimization of a one-parameter objective functional, which becomes the maximum likelihood estimation or the kernel vector quantization in special cases. Generalizing the theorem for the nonparametric maximum likelihood estimation, we prove the existence and discreteness of the optimal mixing distribution and provide an algorithm to calculate it. It is demonstrated that with an appropriate choice of the parameter, the proposed method is less prone to overfitting than the maximum likelihood method. We further discuss the connection between the unifying estimation framework and the rate-distortion problem. | |
| 540 | |a The Author(s), 2014 | ||
| 690 | 7 | |a Mixture models |2 nationallicence | |
| 690 | 7 | |a Nonparametric estimation |2 nationallicence | |
| 690 | 7 | |a Entropic risk measure |2 nationallicence | |
| 690 | 7 | |a Rate-distortion theory |2 nationallicence | |
| 700 | 1 | |a Watanabe |D Kazuho |u Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka, Tempaku-cho, 441-8580, Toyohashi, Japan |4 aut | |
| 700 | 1 | |a Ikeda |D Shiro |u The Institute of Statistical Mathematics, 10-3, Midori-cho, 190-8562, Tachikawa-shi, Tokyo, Japan |4 aut | |
| 773 | 0 | |t Machine Learning |d Springer US; http://www.springer-ny.com |g 99/1(2015-04-01), 119-136 |x 0885-6125 |q 99:1<119 |1 2015 |2 99 |o 10994 | |
| 856 | 4 | 0 | |u https://doi.org/10.1007/s10994-014-5467-7 |q text/html |z Onlinezugriff via DOI |
| 898 | |a BK010053 |b XK010053 |c XK010000 | ||
| 900 | 7 | |a Metadata rights reserved |b Springer special CC-BY-NC licence |2 nationallicence | |
| 908 | |D 1 |a research-article |2 jats | ||
| 949 | |B NATIONALLICENCE |F NATIONALLICENCE |b NL-springer | ||
| 950 | |B NATIONALLICENCE |P 856 |E 40 |u https://doi.org/10.1007/s10994-014-5467-7 |q text/html |z Onlinezugriff via DOI | ||
| 950 | |B NATIONALLICENCE |P 700 |E 1- |a Watanabe |D Kazuho |u Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka, Tempaku-cho, 441-8580, Toyohashi, Japan |4 aut | ||
| 950 | |B NATIONALLICENCE |P 700 |E 1- |a Ikeda |D Shiro |u The Institute of Statistical Mathematics, 10-3, Midori-cho, 190-8562, Tachikawa-shi, Tokyo, Japan |4 aut | ||
| 950 | |B NATIONALLICENCE |P 773 |E 0- |t Machine Learning |d Springer US; http://www.springer-ny.com |g 99/1(2015-04-01), 119-136 |x 0885-6125 |q 99:1<119 |1 2015 |2 99 |o 10994 | ||