Can handwriting analysis be helpful for Alzheimer detection?
Mounim A El-Yacoubi
University Paris Saclay, France
: J Comput Eng Inf Technol
Abstract
Handwriting recognition has become, in the last two decades, a mature technology with successful applications like automatic mail sorting, bank check processing and natural interaction with mobile devices (tablet PC, smartphones, etc.). We propose a novel technique to characterize patients with early-stage Alzheimer (ESAD) w.r.t healthy controls (HC) by analyzing the kinematics of online handwriting on the 4l (llll) series task (figure 1). Our approach addresses the limits of current state of the art in several ways. Instead of comparing ESAD and HC based on global parameters (speed or acceleration average, etc.), we perform such a comparison based on the full dynamics of these kinematics parameters. To do so, we first automatically segment the 4l series into individual loops (figure 2). To characterize the variability of loops over the two classes, we define a dictionary of prototype loops (medoids, figure 3) by a clustering scheme based on the k-medoid algorithm, with a dynamic time warping (DTW) dissimilarity measure that accommodates the sequential aspect of the loops. Each cluster thus generated consists of a set of loops pertaining to the two classes in different proportions, reflecting the cluster power in discriminating the two classes. To leverage all the loops generated by a given person in the test phase, we consider a Bayesian formalism that probabilistically aggregates the contribution of each loop before making a classification decision over the two classes (ESAD and HC). This formalism has the advantage of offering a sound mechanism for rejecting the persons with ambiguous HW, for which it is better not to make a hard automatic decision. We have tested our approach on a database acquired at Broca Hospital in Paris, from patients with ESAD and from HC, and we obtain promising results, reflected by an encouraging classification performance using the leave-one-out validation scheme.
Biography
Mounîm A El-Yacoubi completed his PhD at University of Rennes, France, in 1996. He worked at Service de Recherche Technique de la Poste (SRTP) at Nantes, France, from 1992 to 1996, where he developed software for Handwritten Address Recognition that is still running in Automatic French mail sorting machines. He was a Visiting Scientist for 18 months at Centre for Pattern Recognition and Machine Intelligence (CENPARMI) in Montréal, Canada, and then an Associate Professor (1998-2000) at Catholic University of Parana (PUC-PR) in Curitiba, Brazil. From 2001 to 2008, he was a Senior Software Engineer at Parascript, Boulder (Colorado, USA). Since June 2008, he is a Professor at Telecom SudParis, University of Paris-Saclay. His main interests include Machine Learning, Human Gesture and Activity Recognition, Human Robot Interaction, Video Surveillance and Biometrics, Information Retrieval, and Handwriting Analysis and Recognition.
Email: mounim.el_yacoubi@telecom-sudparis.eu
