Analyzing Learned Representations of a Deep ASR Performance Prediction Model

Abstract : This paper addresses a relatively new task: prediction of ASR performance on unseen broadcast programs. In a previous paper, we presented an ASR performance prediction system using CNNs that encode both text (ASR transcript) and speech, in order to predict word error rate. This work is dedicated to the analysis of speech signal embeddings and text em-beddings learnt by the CNN while training our prediction model. We try to better understand which information is captured by the deep model and its relation with different conditioning factors. It is shown that hidden layers convey a clear signal about speech style, accent and broadcast type. We then try to leverage these 3 types of information at training time through multi-task learning. Our experiments show that this allows to train slightly more efficient ASR performance prediction systems that-in addition-simultaneously tag the analyzed utterances according to their speech style, accent and broadcast program origin.
Type de document :
Communication dans un congrès
Blackbox NLP Workshop and EMLP 2018, Nov 2018, Bruxelles, Belgium
Liste complète des métadonnées

Littérature citée [16 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01863293
Contributeur : Benjamin Lecouteux <>
Soumis le : mardi 28 août 2018 - 11:58:58
Dernière modification le : samedi 5 janvier 2019 - 01:09:56
Document(s) archivé(s) le : jeudi 29 novembre 2018 - 15:22:49

Fichier

emnlp2018.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01863293, version 1

Collections

Citation

Zied Elloumi, Laurent Besacier, Olivier Galibert, Benjamin Lecouteux. Analyzing Learned Representations of a Deep ASR Performance Prediction Model. Blackbox NLP Workshop and EMLP 2018, Nov 2018, Bruxelles, Belgium. 〈hal-01863293〉

Partager

Métriques

Consultations de la notice

29

Téléchargements de fichiers

13