Back
atanasiu2016-cuckoosamongyourdata_aqualitycontrolmethodtoretrievemislabeledwriteridentitiesfromhandwritingdatasets
Conference paper (in proceedings)

Cuckoos among Your Data: A Quality Control Method to Retrieve Mislabeled Writer Identities from Handwriting Datasets

DOKPE

  • 2016
Published in:
  • Electronic Imaging. - Society for Imaging Science and Technology. - 2016, vol. Document Recognition and Retrieval XXIII
handwriting analysis
misclassification
writer identification
English Motivation: Handwriting datasets may contain specimens assigned to the wrong writer. A little discussed problem, such misclassifications, “cuckoos”, can bias recognition, retrieval, identification, and other expertise systems, with serious consequences in biometric and forensic applications. Indeed, misclassification research has been purported as the most important topic in pattern recognition. Objective: We describe the design of a generic semi-automatic method for detecting possible misclassifications and illustrate it by way of an exemplary classification criteria (writer identity), measurement feature (contour orientation), and document distance metrics combination. Method: The core of the method consists in automated ranking of writer classes by stylistic variability, using the open source software Alphonse, followed by visual inspection of a limited number of top ranking classes, using an interactive handwriting datasets visual- ization tool, Rex. The method is independent from dataset producers and does not necessitate training. It is the result of empirical and theoretical research, and its performance demonstrated on the Swiss IAM offline handwriting dataset. Findings: We show that to evaluate the performance of a quality control it is necessary to consider the interdependency between system sensitivity and task difficulty. We propose a dataset-independent measure of the scrambling severity of a dataset and its proneness to misclassification. We find that in a broad writer population the variability of the contour orientation approaches a log-normal distribution, increasing the amount of genuine outliers.
Faculty
Faculté des sciences et de médecine
Department
Département d'Informatique
Language
  • English
Classification
Computer science and technology
Other electronic version

Published version

License
License undefined
Open access status
green
Identifiers
Persistent URL
https://folia.unifr.ch/unifr/documents/325909
Statistics
Document views: 27 File downloads:
  • atanasiu2016-cuckoosamongyourdata_aqualitycontrolmethodtoretrievemislabeledwriteridentitiesfromhandwritingdatasets.pdf: 34