Spectral and prosodic transformations of hearing-impaired Mandarin speech

Cheng Lung Lee, Wen-Whei Chang*, Yuan Chuan Chiang

*Corresponding author for this work

Research output: Contribution to journalArticle

10 Scopus citations

Abstract

This paper studies the combined use of spectral and prosodic conversions to enhance the hearing-impaired Mandarin speech. The analysis-synthesis system is based on a sinusoidal representation of the speech production mechanism. By taking advantage of the tone structure in Mandarin speech, pitch contours are orthogonally transformed and applied within the sinusoidal framework to perform pitch modification. Also proposed is a time-scale modification algorithm that finds accurate alignments between hearing-impaired and normal utterances. Using the alignments, spectral conversion is performed on subsyllabic acoustic units by a continuous probabilistic transform based on a Gaussian mixture model. Results of perceptual evaluation indicate that the proposed system greatly improves the intelligibility and the naturalness of hearing-impaired Mandarin speech.

Original languageEnglish
Pages (from-to)207-219
Number of pages13
JournalSpeech Communication
Volume48
Issue number2
DOIs
StatePublished - 1 Feb 2006

Keywords

  • Hearing-impaired speaker
  • Prosodic modification
  • Sinusoidal model
  • Spectral conversion
  • Voice conversion

Fingerprint Dive into the research topics of 'Spectral and prosodic transformations of hearing-impaired Mandarin speech'. Together they form a unique fingerprint.

Cite this