On-the-fly Detection of User Engagement Decrease in Spontaneous Human-Robot Interaction

Atef Ben Youssef 1, 2 Giovanna Varni 1, 2 Slim Essid 1, 2 Chloé Clavel 1, 2
1 S2A - Signal, Statistique et Apprentissage
LTCI - Laboratoire Traitement et Communication de l'Information
Abstract :

In this paper, we address the detection of engagement decrease of users spontaneously interacting with a socially assistive robot in a public space. We first describe the UE-HRI dataset that collects spontaneous Human-Robot Interactions following the guidelines provided by the Affective Computing research community to collect data "in-the-wild". We then analyze the users' behaviors focusing on proxemics, gaze, head motion, facial expressions and speech during interactions with the robot. Engaged behaviors versus signs of engagement decrease exhibited by the users were annotated and analyzed. Finally, we investigate the use of deep leaning techniques (Recurrent and Deep Neural Networks) to detect user engagement decrease in real-time. The results of this work particularly highlight the relevance of taking into account temporal dynamics of the user's behavior. Allowing 1 to 2 seconds as buffer delay improves the performance of taking a decision on user engagement.

Document type :
Journal articles
Complete list of metadatas

https://hal.telecom-paristech.fr/hal-02288044
Contributor : Telecomparis Hal <>
Submitted on : Friday, September 13, 2019 - 5:37:33 PM
Last modification on : Thursday, October 17, 2019 - 12:37:03 PM

Identifiers

  • HAL Id : hal-02288044, version 1

Citation

Atef Ben Youssef, Giovanna Varni, Slim Essid, Chloé Clavel. On-the-fly Detection of User Engagement Decrease in Spontaneous Human-Robot Interaction. International Journal of Social Robotics, 2019. ⟨hal-02288044⟩

Share

Metrics

Record views

84