Deep Learning Based Multimedia Data Mining for Autism Spectrum Disorder (ASD) Diagnosis

Figure 1. Differences in spectral and deep features between audio of adult and child, which allows us to model predictions based on the type of audio data.

Deep Learning Based Multimedia Data Mining for Autism Spectrum…

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder characterized by deficits in social communication and restricted and repetitive patterns of behavior. Autism is estimated to affect 1 in 59 children in the United States and costs roughly $35 billion dollars to the society. Early diagnosis of ASD is vital for promoting early intervention and positive developmental outcomes. Traditional diagnostic procedures for ASD include structured behavioral observation by a trained clinician. Diagnosticians typically rely on the Autism Diagnostic Observation Schedule (ADOS-2) to quantify ASD symptoms. In this paper, we take a parallel approach and investigate language modalities and discover associations between objective measurements of social communication and ASD symptoms. We analyze 33 children with autism and extract their linguistic patterns from their conversations with diagnosticians in a clinical setting. Our methods use LongShort Term Memory (LSTM) networks to learn Speech Activity Detection (SAD) and speaker diarization patterns to generate the vocal turn-taking metrics. We then use our novel proposed pipeline to predict the ADOS-2 Calibrated Severity Scores (CSS) of Social Affect (SA). The proposed framework achieve state-of-the-art predictive diagnostic estimates of ASD severity compared to industry’s leading algorithms. Results compared with the language acquisition system Language ENvironment Analysis (LENA) and other algorithms indicate a significant improvement in the R 2 measure.

Read more . . .

S. Sadiq, M. Castellanos, J. Moffitt, M. Shyu, L. Perry and D. Messinger, Deep Learning Based Multimedia Data Mining for Autism Spectrum Disorder (ASD) Diagnosis, 2019 International Conference on Data Mining Workshops (ICDMW), Beijing, China, 2019, pp. 847-854, doi: 10.1109/ICDMW.2019.00124.