Automated Characterization of Mouth Activity for Stress and Anxiety Assessment

Abstract : Non-verbal information portrayed by human facial expression, apart from emotional cues also encompasses information relevant to psychophysical status. Mouth activities in particular have been found to correlate with signs of several conditions; depressed people smile less, while those in fatigue yawn more. In this paper, we present a semi-automated, robust and efficient algorithm for extracting mouth activity from video recordings based on Eigen-features and template-matching. The algorithm was evaluated for mouth openings and mouth deformations, on a minimum specification dataset of 640x480 resolution and 15 fps. The extracted features were the signals of mouth expansion (openness estimation) and correlation (deformation estimation). The achieved classification accuracy reached 89.17%. A second series of experimental results, for the preliminary evaluation of the proposed algorithm in assessing stress/anxiety, took place using an additional dataset. The proposed algorithm showed consistent performance across both datasets, which indicates high robustness. Furthermore, normalized openings per minute, and average openness intensity were extracted as video-based features, resulting in a significant difference between video recordings of stressed/anxious versus relaxed subjects.
Type de document :
Communication dans un congrès
IEEE Instrumentat & Measurement Soc. IEEE International Conference on Imaging Systems and Techniques (IST) / IEEE International School on Imaging, Oct 2016, Chania, Greece. IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA, 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), pp.356-361, 2016, IEEE International Conference on Imaging Systems and Techniques. 〈http://ieeexplore.ieee.org/document/7738251/〉. 〈10.1109/IST.2016.7738251〉
Liste complète des métadonnées

https://hal-univ-bourgogne.archives-ouvertes.fr/hal-01514927
Contributeur : Le2i - Université de Bourgogne <>
Soumis le : mercredi 26 avril 2017 - 17:45:47
Dernière modification le : mercredi 12 septembre 2018 - 01:27:29

Identifiants

Collections

Citation

Anastasia Pampouchidou, Matthew Pediaditis,, F Chiarugi,, Kostas Marias, Panagiotis Simos, et al.. Automated Characterization of Mouth Activity for Stress and Anxiety Assessment. IEEE Instrumentat & Measurement Soc. IEEE International Conference on Imaging Systems and Techniques (IST) / IEEE International School on Imaging, Oct 2016, Chania, Greece. IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA, 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), pp.356-361, 2016, IEEE International Conference on Imaging Systems and Techniques. 〈http://ieeexplore.ieee.org/document/7738251/〉. 〈10.1109/IST.2016.7738251〉. 〈hal-01514927〉

Partager

Métriques

Consultations de la notice

66