Remote heart rate variability for emotional state monitoring

Yannick Benezeth 1 Peixi Li Richard Macwan 1 Keisuke Nakamura 2 Randy Gomez 2 Fan Yang 1
1 Le2i - Laboratoire d'Electronique, d'Informatique et d'Image [EA 7508]
2 Honda Research Institute
Abstract : Several researches have been conducted to recognize emotions using various modalities such as facial expressions , gestures, speech or physiological signals. Among all these modalities, physiological signals are especially interesting because they are mainly controlled by the autonomic nervous system. It has been shown for example that there is an undeniable relationship between emotional state and Heart Rate Variability (HRV). In this paper, we present a methodology to monitor emotional state from physiological signals acquired remotely. The method is based on a remote photoplethysmography (rPPG) algorithm that estimates remote Heart Rate Variability (rHRV) using a simple camera. We first show that the rHRV signal can be estimated with a high accuracy (more than 96% in frequency domain). Then, frequency-feature of rHRV is calculated and we show that there is a strong correlation between the rHRV feature and different emotional states. This observation has been validated on 12 out of 16 volunteers and video-induced emotions which opens the way to contactless monitoring of emotions from physiological signals.
Type de document :
Communication dans un congrès
Liste complète des métadonnées
https://hal-univ-bourgogne.archives-ouvertes.fr/hal-01678244
Contributeur : Yannick Benezeth <>
Soumis le : mercredi 24 janvier 2018 - 17:38:42
Dernière modification le : vendredi 7 décembre 2018 - 16:48:04
Document(s) archivé(s) le : jeudi 24 mai 2018 - 22:05:01

Fichier

BHI_2018_RHRV.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01678244, version 2

Collections

UNIV-BM | LE2I | UNIV-BM-THESE | UNIV-BOURGOGNE | UNIV-HESAM

Citation

Yannick Benezeth, Peixi Li, Richard Macwan, Keisuke Nakamura, Randy Gomez, et al.. Remote heart rate variability for emotional state monitoring. IEEE International Conference on Biomedical and Health Informatics, 2018, Las Vegas, United States. ⟨hal-01678244v2⟩

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

611

Téléchargements de fichiers

1202

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD