Tone Recognition Of Continuous Mandarin Speech Assisted With Prosodic Information

Yih-Ru Wang, Sin-Horng Chen

Research output: Contribution to journalArticlepeer-review

17 Scopus citations

Abstract

In this paper, a simple recurrent neural network (SRNN) is employed to model the prosody of continuous Mandarin speech to assist tone recognition. For each syllable in continuous speech, several acoustic features carrying prosodic information are extracted and taken as inputs to the SRNN. If proper linguistic features extracted from the context of the syllable are set as output targets, the SRNN can learn to represent the prosodic state of the utterance at the syllable using its hidden nodes. Outputs of the hidden nodes then serve as additional recognition features to assist recognition of the tone of the syllable. The performance of the proposed tone recognition approach was examined by simulation on a multilayer perception (MLP)-based speaker-dependent tone recognition task. The recognition rate was improved from 91.38% to 93.10%. The SRNN prosodic model is further analyzed to exploit the linguistic meaning of prosodic states. By vector quantizing the outputs of the hidden nodes of the SRNN, a finite-state automata that roughly represents the mechanism of human prosody pronunciation can be obtained.

Original languageEnglish
Pages (from-to)2637-2645
Number of pages9
JournalJournal of the Acoustical Society of America
Volume96
Issue number5
DOIs
StatePublished - 1 Jan 1994

Fingerprint Dive into the research topics of 'Tone Recognition Of Continuous Mandarin Speech Assisted With Prosodic Information'. Together they form a unique fingerprint.

Cite this