A modular RNN-based method for continuous Mandarin speech recognition

Y. F. Liao*, Sin-Horng Chen

*Corresponding author for this work

Research output: Contribution to journalArticle

5 Scopus citations

Abstract

A new modular recurrent neural network (MRNN)-based method for continuous Mandarin speech recognition (CMSR) is proposed. The MRNN recognizer is composed of four main modules. The first is a sub-MRNN module whose function is to generate discriminant functions for all 412 base-syllables. It accomplishes the task by using four recurrent neural network (RNN) submodules. The second is an RNN module which is designed to detect syllable boundaries for providing timing cues in order to help solve the time-alignment problem. The third is also an RNN module whose function is to generate discriminant functions for 143 intersyllable diphone-like units to compensate the intersyllable coarticulation effect. The fourth is a dynamic programming (DP)-based recognition search module. Its function is to integrate the other three modules and solve the time-alignment problem for generating the recognized base-syllable sequence. A new multilevel pruning scheme designed to speed up the recognition process is also proposed. The whole MRNN can be trained by a sophisticated three-stage minimum classification error/generalized probabilistic descent (MCE/GPD) algorithm. Experimental results showed that the proposed method performed better than the maximum likelihood (ML)-trained hidden Markov model (HMM) method and is comparable to the MCE/GPD-trained HMM method. The multilevel pruning scheme was also found to be very efficient.

Original languageEnglish
Pages (from-to)252-263
Number of pages12
JournalIEEE Transactions on Speech and Audio Processing
Volume9
Issue number3
DOIs
StatePublished - 1 Mar 2001

Keywords

  • MCE/GPD algorithms
  • Mandarin speech recognition
  • Modular recurrent neural networks

Fingerprint Dive into the research topics of 'A modular RNN-based method for continuous Mandarin speech recognition'. Together they form a unique fingerprint.

Cite this