Kagan Tumer's Publications

Display Publications by [Year] [Type] [Topic]


Robust Combining of Disparate Classifiers through Order Statistics. K. Tumer and J. Ghosh. Pattern Analysis and Applications, 5(2):189–200, 2002.

Abstract

Integrating the outputs of multiple classifiers via combinersor meta-learners has led to substantial improvements in several difficult pattern recognition problems. In this article we investigate a family of combiners based on order statistics, for robust handling of situations where there are large discrepancies in performance of individual classifiers. Based on a mathematical modeling of how the decision boundaries are affected by order statistic combiners, we derive expressions for the reductions in error expected when simple output combination methods based on the the median, the maximum and in general, the ith order statistic, are used. Furthermore, we analyze the trim and spread combiners, both based on linear combinations of the ordered classifier outputs, and show that in the presence of uneven classifier performance, they often provide substantial gains over both linear and simple ord er statistics combiners. Experimental results on both real world data and standard public domain data sets corroborate these findings.

Download

[PDF]324.6kB  

BibTeX Entry

@article{tumer-ghosh_paa02,
        author={K. Tumer and J. Ghosh},
        title="Robust Combining of Disparate Classifiers through Order Statistics",
        journal = {Pattern Analysis and Applications},
        volume={5},
        number={2},
        pages ={189-200},
	abstract ={Integrating the outputs of multiple classifiers via combiners
or meta-learners has led to substantial improvements in several difficult pattern recognition problems.  In this article we investigate a family of combiners based on order statistics, for robust handling of situations where there are large discrepancies in performance of individual classifiers. Based on a mathematical modeling of how the decision boundaries are affected by order statistic combiners, we derive expressions for the reductions in error expected when simple output combination methods based on the the median, the maximum and in general, the ith order statistic, are used.  Furthermore, we analyze the trim and spread combiners, both based on linear combinations of the ordered classifier outputs, and show that in the presence of uneven classifier performance, they often provide substantial gains over both linear and simple ord er statistics combiners.  Experimental results on both real world data and standard public domain data sets corroborate these findings.},  
	bib2html_pubtype = {Journal Articles},
	bib2html_rescat = {Classifier Ensembles},
        year={2002}
}

Generated by bib2html.pl (written by Patrick Riley ) on Wed Apr 01, 2020 17:39:43