Multilabel classification through random graph ensembles

Verfasser / Beitragende:
[Hongyu Su, Juho Rousu]
Ort, Verlag, Jahr:
2015
Enthalten in:
Machine Learning, 99/2(2015-05-01), 231-256
Format:
Artikel (online)
ID: 605478570
LEADER caa a22 4500
001 605478570
003 CHVBK
005 20210128100406.0
007 cr unu---uuuuu
008 210128e20150501xx s 000 0 eng
024 7 0 |a 10.1007/s10994-014-5465-9  |2 doi 
035 |a (NATIONALLICENCE)springer-10.1007/s10994-014-5465-9 
245 0 0 |a Multilabel classification through random graph ensembles  |h [Elektronische Daten]  |c [Hongyu Su, Juho Rousu] 
520 3 |a We present new methods for multilabel classification, relying on ensemble learning on a collection of random output graphs imposed on the multilabel, and a kernel-based structured output learner as the base classifier. For ensemble learning, differences among the output graphs provide the required base classifier diversity and lead to improved performance in the increasing size of the ensemble. We study different methods of forming the ensemble prediction, including majority voting and two methods that perform inferences over the graph structures before or after combining the base models into the ensemble. We put forward a theoretical explanation of the behaviour of multilabel ensembles in terms of the diversity and coherence of microlabel predictions, generalizing previous work on single target ensembles. We compare our methods on a set of heterogeneous multilabel benchmark problems against the state-of-the-art machine learning approaches, including multilabel AdaBoost, convex multitask feature learning, as well as single target learning approaches represented by Bagging and SVM. In our experiments, the random graph ensembles are very competitive and robust, ranking first or second on most of the datasets. Overall, our results show that our proposed random graph ensembles are viable alternatives to flat multilabel and multitask learners. 
540 |a The Author(s), 2014 
690 7 |a Multilabel classification  |2 nationallicence 
690 7 |a Structured output  |2 nationallicence 
690 7 |a Ensemble methods  |2 nationallicence 
690 7 |a Kernel methods  |2 nationallicence 
690 7 |a Graphical models  |2 nationallicence 
700 1 |a Su  |D Hongyu  |u Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, Konemiehentie 2, 02150, Espoo, Finland  |4 aut 
700 1 |a Rousu  |D Juho  |u Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, Konemiehentie 2, 02150, Espoo, Finland  |4 aut 
773 0 |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 99/2(2015-05-01), 231-256  |x 0885-6125  |q 99:2<231  |1 2015  |2 99  |o 10994 
856 4 0 |u https://doi.org/10.1007/s10994-014-5465-9  |q text/html  |z Onlinezugriff via DOI 
898 |a BK010053  |b XK010053  |c XK010000 
900 7 |a Metadata rights reserved  |b Springer special CC-BY-NC licence  |2 nationallicence 
908 |D 1  |a research-article  |2 jats 
949 |B NATIONALLICENCE  |F NATIONALLICENCE  |b NL-springer 
950 |B NATIONALLICENCE  |P 856  |E 40  |u https://doi.org/10.1007/s10994-014-5465-9  |q text/html  |z Onlinezugriff via DOI 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Su  |D Hongyu  |u Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, Konemiehentie 2, 02150, Espoo, Finland  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Rousu  |D Juho  |u Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, Konemiehentie 2, 02150, Espoo, Finland  |4 aut 
950 |B NATIONALLICENCE  |P 773  |E 0-  |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 99/2(2015-05-01), 231-256  |x 0885-6125  |q 99:2<231  |1 2015  |2 99  |o 10994