arXiv · math/0405345
Bounding the generalization error of convex combinations of classifiers: balancing the dimensionality and the margins
Abstract
A problem of bounding the generalization error of a classifier f in H, where H is a "base" class of functions (classifiers), is considered. This problem frequently occurs in computer learning, where efficient algorithms of combining simple classifiers into a complex one (such as boosting and bagging) have attracted a lot of attention. Using Talagrand's concentration inequalities for empirical processes, we obtain new sharper bounds on the generalization error of combined classifiers that take into account both the empirical distribution of "classification margins'' and an "approximate dimension" of the classifiers and study the performance of these bounds in several experiments with learning algorithms.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Vladimir Koltchinskii, Dmitry Panchenko, Fernando Lozano. 2004-05-18. Bounding the generalization error of convex combinations of classifiers: balancing the dimensionality and the margins. https://arxiv.science/abs/math/0405345
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.