Accéder directement au contenu Accéder directement à la navigation
Nouvelle interface
Communication dans un congrès

Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text

Abstract : Depression is a major cause of disability world-wide. The present paper reports on the results of our participation to the depression sub-challenge of the sixth Audio/Visual Emotion Challenge (AVEC 2016), which was designed to compare feature modalities ( audio, visual, interview transcript-based) in gender-based and gender-independent modes using a variety of classification algorithms. In our approach, both high and low level features were assessed in each modality. Audio features were extracted from the low-level descriptors provided by the challenge organizers. Several visual features were extracted and assessed including dynamic characteristics of facial elements (using Landmark Motion History Histograms and Landmark Motion Magnitude), global head motion, and eye blinks. These features were combined with statistically derived features from pre-extracted features ( emotions, action units, gaze, and pose). Both speech rate and word-level semantic content were also evaluated. Classification results are reported using four different classification schemes: i) gender-based models for each individual modality, ii) the feature fusion model, ii) the decision fusion model, and iv) the posterior probability classification model. Proposed approaches outperforming the reference classification accuracy include the one utilizing statistical descriptors of low-level audio features. This approach achieved f1-scores of 0.59 for identifying depressed and 0.87 for identifying notdepressed individuals on the development set and 0.52/0.81, respectively for the test set.
Liste complète des métadonnées
Contributeur : LE2I - université de Bourgogne Connectez-vous pour contacter le contributeur
Soumis le : jeudi 9 février 2017 - 19:46:56
Dernière modification le : vendredi 5 août 2022 - 14:54:00



Anastasia Pampouchidou, Matthew Pediaditis,, Georgios Giannakakis,, Kostas Marias, Olympia Simantiraki,, et al.. Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text. 6th International Workshop on Audio-Visual Emotion Recognition Challenge - Depression, Mood, and Emotion (AVEC), Oct 2016, Amsterdam, Netherlands. pp.27-34, ⟨10.1145/2988257.2988266⟩. ⟨hal-01464064⟩



Consultations de la notice