Pruning of Error Correcting Output Codes by optimization of accuracy-diversity trade off

Verfasser / Beitragende:
[Süreyya Özöğür-Akyüz, Terry Windeatt, Raymond Smith]
Ort, Verlag, Jahr:
2015
Enthalten in:
Machine Learning, 101/1-3(2015-10-01), 253-269
Format:
Artikel (online)
ID: 605477965
LEADER caa a22 4500
001 605477965
003 CHVBK
005 20210128100403.0
007 cr unu---uuuuu
008 210128e20151001xx s 000 0 eng
024 7 0 |a 10.1007/s10994-014-5477-5  |2 doi 
035 |a (NATIONALLICENCE)springer-10.1007/s10994-014-5477-5 
245 0 0 |a Pruning of Error Correcting Output Codes by optimization of accuracy-diversity trade off  |h [Elektronische Daten]  |c [Süreyya Özöğür-Akyüz, Terry Windeatt, Raymond Smith] 
520 3 |a Ensemble learning is a method of combining learners to obtain more reliable and accurate predictions in supervised and unsupervised learning. However, the ensemble sizes are sometimes unnecessarily large which leads to additional memory usage, computational overhead and decreased effectiveness. To overcome such side effects, pruning algorithms have been developed; since this is a combinatorial problem, finding the exact subset of ensembles is computationally infeasible. Different types of heuristic algorithms have developed to obtain an approximate solution but they lack a theoretical guarantee. Error Correcting Output Code (ECOC) is one of the well-known ensemble techniques for multiclass classification which combines the outputs of binary base learners to predict the classes for multiclass data. In this paper, we propose a novel approach for pruning the ECOC matrix by utilizing accuracy and diversity information simultaneously. All existing pruning methods need the size of the ensemble as a parameter, so the performance of the pruning methods depends on the size of the ensemble. Our unparametrized pruning method is novel as being independent of the size of ensemble. Experimental results show that our pruning method is mostly better than other existing approaches. 
540 |a The Author(s), 2014 
690 7 |a Ensemble learning  |2 nationallicence 
690 7 |a Ensemble pruning  |2 nationallicence 
690 7 |a Error Correcting Output Codes  |2 nationallicence 
690 7 |a DC programming  |2 nationallicence 
690 7 |a Support vector machines  |2 nationallicence 
690 7 |a Integer programming  |2 nationallicence 
700 1 |a Özöğür-Akyüz  |D Süreyya  |u Center for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH, Surrey, UK  |4 aut 
700 1 |a Windeatt  |D Terry  |u Center for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH, Surrey, UK  |4 aut 
700 1 |a Smith  |D Raymond  |u Center for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH, Surrey, UK  |4 aut 
773 0 |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 101/1-3(2015-10-01), 253-269  |x 0885-6125  |q 101:1-3<253  |1 2015  |2 101  |o 10994 
856 4 0 |u https://doi.org/10.1007/s10994-014-5477-5  |q text/html  |z Onlinezugriff via DOI 
898 |a BK010053  |b XK010053  |c XK010000 
900 7 |a Metadata rights reserved  |b Springer special CC-BY-NC licence  |2 nationallicence 
908 |D 1  |a research-article  |2 jats 
949 |B NATIONALLICENCE  |F NATIONALLICENCE  |b NL-springer 
950 |B NATIONALLICENCE  |P 856  |E 40  |u https://doi.org/10.1007/s10994-014-5477-5  |q text/html  |z Onlinezugriff via DOI 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Özöğür-Akyüz  |D Süreyya  |u Center for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH, Surrey, UK  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Windeatt  |D Terry  |u Center for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH, Surrey, UK  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Smith  |D Raymond  |u Center for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH, Surrey, UK  |4 aut 
950 |B NATIONALLICENCE  |P 773  |E 0-  |t Machine Learning  |d Springer US; http://www.springer-ny.com  |g 101/1-3(2015-10-01), 253-269  |x 0885-6125  |q 101:1-3<253  |1 2015  |2 101  |o 10994