Not logged in.
Quick Search - Contribution
Contribution Details
| Type | Conference or Workshop Paper |
| Scope | Discipline-based scholarship |
| Published in Proceedings | Yes |
| Title | The balanced accuracy and its posterior distribution |
| Authors |
|
| Presentation Type | paper |
| Item Subtype | Original Work |
| Refereed | Yes |
| Status | Published in final form |
| Page Range | 3121 - 3124 |
| Event Title | Proceedings of the 20th International Conference on Pattern Recognition |
| Event Type | conference |
| Event Location | Istanbul, Turkey |
| Event Start Date | August 22 - 2010 |
| Event End Date | August 25 - 2010 |
| Place of Publication | Istanbul, Turkey |
| Publisher | IEEE Computer Society |
| Abstract Text | Evaluating the performance of a classification algorithm critically requires a measure of the degree to which unseen examples have been identified with their correct class labels. In practice, generalizability is frequently estimated by averaging the accuracies obtained on individual cross-validation folds. This procedure, however, is problematic in two ways. First, it does not allow for the derivation of meaningful confidence intervals. Second, it leads to an optimistic estimate when a biased classifier is tested on an imbalanced dataset. We show that both problems can be overcome by replacing the conventional point estimate of accuracy by an estimate of the posterior distribution of the balanced accuracy. |
| Export |
BibTeX
EP3 XML (ZORA)
|