Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text

Abstract : Depression is a major cause of disability world-wide. The present paper reports on the results of our participation to the depression sub-challenge of the sixth Audio/Visual Emotion Challenge (AVEC 2016), which was designed to compare feature modalities ( audio, visual, interview transcript-based) in gender-based and gender-independent modes using a variety of classification algorithms. In our approach, both high and low level features were assessed in each modality. Audio features were extracted from the low-level descriptors provided by the challenge organizers. Several visual features were extracted and assessed including dynamic characteristics of facial elements (using Landmark Motion History Histograms and Landmark Motion Magnitude), global head motion, and eye blinks. These features were combined with statistically derived features from pre-extracted features ( emotions, action units, gaze, and pose). Both speech rate and word-level semantic content were also evaluated. Classification results are reported using four different classification schemes: i) gender-based models for each individual modality, ii) the feature fusion model, ii) the decision fusion model, and iv) the posterior probability classification model. Proposed approaches outperforming the reference classification accuracy include the one utilizing statistical descriptors of low-level audio features. This approach achieved f1-scores of 0.59 for identifying depressed and 0.87 for identifying notdepressed individuals on the development set and 0.52/0.81, respectively for the test set.
Liste complète des métadonnées

https://hal-univ-bourgogne.archives-ouvertes.fr/hal-01464064
Contributeur : Le2i - Université de Bourgogne <>
Soumis le : jeudi 9 février 2017 - 19:46:56
Dernière modification le : mardi 21 mai 2019 - 10:52:18

Identifiants

Collections

Citation

Anastasia Pampouchidou, Matthew Pediaditis,, Georgios Giannakakis,, Kostas Marias, Olympia Simantiraki,, et al.. Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text. 6th International Workshop on Audio-Visual Emotion Recognition Challenge - Depression, Mood, and Emotion (AVEC), Oct 2016, Amsterdam, Netherlands. pp.27-34, ⟨10.1145/2988257.2988266⟩. ⟨hal-01464064⟩

Partager

Métriques

Consultations de la notice

220