Stochastic feature mapping for PAC-Bayes classification
| LEADER | caa a22 4500 | ||
|---|---|---|---|
| 001 | 605477833 | ||
| 003 | CHVBK | ||
| 005 | 20210128100403.0 | ||
| 007 | cr unu---uuuuu | ||
| 008 | 210128e20151001xx s 000 0 eng | ||
| 024 | 7 | 0 | |a 10.1007/s10994-015-5525-9 |2 doi |
| 035 | |a (NATIONALLICENCE)springer-10.1007/s10994-015-5525-9 | ||
| 245 | 0 | 0 | |a Stochastic feature mapping for PAC-Bayes classification |h [Elektronische Daten] |c [Xiong Li, Bin Wang, Yuncai Liu, Tai Lee] |
| 520 | 3 | |a Hidden information derived from probabilistic generative models of data distributions can be used to construct features for discriminative classifiers. This observation has motivated the development of approaches that attempt to couple generative and discriminative models together for classification. However, existing approaches typically feed features derived from generative models to discriminative classifiers, and do not refine the generative models or the feature mapping functions based on classification results. In this paper, we propose a coupling mechanism developed under the PAC-Bayes framework that can fine-tune the generative models and the feature mapping functions iteratively to improve the classifier's performance. In our approach, a stochastic feature mapping, which is a function over the random variables of a generative model, is derived to generate feature vectors for a stochastic classifier. We construct a stochastic classifier over the feature mapping and derive the PAC-Bayes generalization bound for the classifier, for both supervised and semi-supervised learning. This allows us to jointly learn the feature mapping and the classifier by minimizing the bound with an EM-like iterative algorithm using labeled and unlabeled data. The resulting framework integrates the learning of the discriminative classifier and the generative model and allows iterative fine-tuning of the generative models, and the feedforward feature mappings based on task performance feedback. Our experiments show, in three distinct applications, this new framework produces a general classification tool with state-of-the-art performance. | |
| 540 | |a The Author(s), 2015 | ||
| 690 | 7 | |a Stochastic feature mapping |2 nationallicence | |
| 690 | 7 | |a PAC-Bayes generalization bound |2 nationallicence | |
| 690 | 7 | |a Hybrid generative-discriminative classification |2 nationallicence | |
| 700 | 1 | |a Li |D Xiong |u Department of Automation, Shanghai Jiao Tong University, Shanghai, China |4 aut | |
| 700 | 1 | |a Wang |D Bin |u College of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai, China |4 aut | |
| 700 | 1 | |a Liu |D Yuncai |u Department of Automation, Shanghai Jiao Tong University, Shanghai, China |4 aut | |
| 700 | 1 | |a Lee |D Tai |u Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, USA |4 aut | |
| 773 | 0 | |t Machine Learning |d Springer US; http://www.springer-ny.com |g 101/1-3(2015-10-01), 5-33 |x 0885-6125 |q 101:1-3<5 |1 2015 |2 101 |o 10994 | |
| 856 | 4 | 0 | |u https://doi.org/10.1007/s10994-015-5525-9 |q text/html |z Onlinezugriff via DOI |
| 898 | |a BK010053 |b XK010053 |c XK010000 | ||
| 900 | 7 | |a Metadata rights reserved |b Springer special CC-BY-NC licence |2 nationallicence | |
| 908 | |D 1 |a research-article |2 jats | ||
| 949 | |B NATIONALLICENCE |F NATIONALLICENCE |b NL-springer | ||
| 950 | |B NATIONALLICENCE |P 856 |E 40 |u https://doi.org/10.1007/s10994-015-5525-9 |q text/html |z Onlinezugriff via DOI | ||
| 950 | |B NATIONALLICENCE |P 700 |E 1- |a Li |D Xiong |u Department of Automation, Shanghai Jiao Tong University, Shanghai, China |4 aut | ||
| 950 | |B NATIONALLICENCE |P 700 |E 1- |a Wang |D Bin |u College of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai, China |4 aut | ||
| 950 | |B NATIONALLICENCE |P 700 |E 1- |a Liu |D Yuncai |u Department of Automation, Shanghai Jiao Tong University, Shanghai, China |4 aut | ||
| 950 | |B NATIONALLICENCE |P 700 |E 1- |a Lee |D Tai |u Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, USA |4 aut | ||
| 950 | |B NATIONALLICENCE |P 773 |E 0- |t Machine Learning |d Springer US; http://www.springer-ny.com |g 101/1-3(2015-10-01), 5-33 |x 0885-6125 |q 101:1-3<5 |1 2015 |2 101 |o 10994 | ||