Automated Measurement of Engagement Level of Children with Autism Spectrum Conditions during Human-robot Interaction

Engaging children with ASC (Autism Spectrum Conditions) in communication centred activities during educational therapy is one of the cardinal challenges by ASC and contributes to its poor outcome. To this end, therapists recently started using humanoid robots (e.g., NAO) as assistive tools. However, this technology lacks the ability to autonomously engage with children, which is the key for improving the therapy and, thus, learning opportunities. Existing approaches typically use machine learning algorithms to estimate the engagement of children with ASC from their head-pose or eye-gaze inferred from face-videos. These approaches are rather limited for modeling atypical behavioral displays of engagement of children with ASC, which can vary considerably across the children. The first objective of EngageME is to bring novel machine learning models that can for the first time effectively leverage multi-modal behavioural cues, including facial expressions, head pose, vocal and physiological cues, to realize fully automated context-sensitive estimation of engagement levels of children with ASC. These models build upon dynamic graph models for multi-modal ordinal data, based on state-of-the-art machine learning approaches to sequence classification and domain adaptation, which can adapt to each child, while still being able to generalize across children and cultures. To realize this, the second objective of EngageME is to provide the candidate with the cutting-edge training aimed at expanding his current expertise in visual processing with expertise in wearable/physiological, and audio technologies, from leading experts in these fields.

Datum 1. 10. 2016 - 30. 9. 2019
Länderkürzel DE
Name der begünstigten Einrichtung Universität Passau
Förderrahmen & Förderprogramm H2020, MSCA-IF-GF - Global Fellowships
Ikona

Entdecke die Europaregion

Hochschulführer

Hochschulführer

Ein Hochschulleitfaden für die Europaregion

Best Practice Projekte

Best Practice Projekte

Aus dem Hochschulbereich

Sommerjobs in der EDM

Sommerjobs in der EDM

Sammeln Sie Erfahrungen

Fotodatenbank der EDM

Fotodatenbank der EDM

Fotografien für die breite Nutzung

28 schönste Tagestouren

28 schönste Tagestouren

Mit dem Fahrrad durch die EDM

28 schönste Rundwanderungen

28 schönste Rundwanderungen

Wanderausflüge durch die Europagerion

28 traditionelle Rezepte

28 traditionelle Rezepte

Kochen mit der Europaregion

Wir kochen gut

Wir kochen gut

Geschmack der Europaregion

Zweisprachigkeit in der EDM

Zweisprachigkeit in der EDM

Unseres Angebot