Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Consistency and Accuracy of CelebA Attribute Values
Organization Unit
Authors
  • Haiyu Wu
  • Grace Bezold
  • Manuel Günther
  • Terrance Boult
  • Michael C King
  • Kevin W Bowyer
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
ISSN 2160-7508
Page Range 3258 - 3266
Event Title Conference on Computer Vision and Pattern Recognition (CVPR) Workshops
Event Type conference
Event Location Vancouver, Canada
Event Start Date June 18 - 2023
Event End Date June 22 - 2023
Series Name IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Publisher Institute of Electrical and Electronics Engineers
Abstract Text We report the first systematic analysis of the experimental foundations of facial attribute classification.Two annotators independently assigning attribute values shows that only 12 of 40 common attributes are assigned values with >= 95% consistency, and three (high cheekbones, pointed nose, oval face) have essentially random consistency. Of 5,068 duplicate face appearances in CelebA, attributes have contradicting values on from 10 to 860 of the 5,068 duplicates. Manual audit of a subset of CelebA estimates error rates as high as 40% for (no beard=false), even though the labeling consistency experiment indicates that no beard could be assigned with >= 95% consistency. Selecting the mouth slightly open (MSO) for deeper analysis, we estimate the error rate for (MSO=true) at about 20% and (MSO=false) at about 2%. A corrected version of the MSO attribute values enables learning a model that achieves higher accuracy than previously reported for MSO. Corrected values for CelebA MSO are available at https:// github.com/ HaiyuWu/ CelebAMSO.
Free access at Official URL
Official URL https://openaccess.thecvf.com/content/CVPR2023W/VDU/html/Wu_Consistency_and_Accuracy_of_CelebA_Attribute_Values_CVPRW_2023_paper.html
Digital Object Identifier 10.1109/CVPRW59228.2023.00328
Other Identification Number merlin-id:24157
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)