Perceptual cues of consonant sounds and impact of sensorineural hearing loss on speech perception

Li, Feipeng

Permalink

https://hdl.handle.net/2142/14603 Copy

Description

Title

Perceptual cues of consonant sounds and impact of sensorineural hearing loss on speech perception

Author(s)

Li, Feipeng

Issue Date

2010-01-06T16:13:48Z

Director of Research (if dissertation) or Advisor (if thesis)

Allen, Jont B.

Doctoral Committee Chair(s)

Allen, Jont B.

Committee Member(s)

• Jones, Douglas L.
• Hasegawa-Johnson, Mark A.
• Wickesberg, Robert E.
• Heinz, Michael

Department of Study

Electrical & Computer Eng

Discipline

Electrical & Computer Engr

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• speech perception
• hearing loss
• consonant
• perceptual cue

Abstract

This research investigates the impact of various types of cochlear hearing loss and mask- ing noise on the perception of basic speech sounds based on the information of identified speech cues. A psychoacoustic method, named three-dimensional deep search (3DDS), is developed to identify the perceptual cues of consonant sounds in natural speech. Unlike the conventional method of synthetic speech, which requires a prior hypothesis about the acoustic cues to generate the speech stimuli, the 3DDS measures the contribution of each subcomponent to speech perception as a function of time, frequency and intensity, without making any tacit assumptions about the speech cues to be identified. Using the 3DDS, we discovered that natural speech often contains conflicting cues that are characteristic of confusable sounds. For instance, a normal /ka/, dominated by a mid-frequency burst at 1–2 kHz, may also have an inaudible /ta/ burst above 3 kHz that promotes the /ka/→/ta/ confusion under noisy environments. Removal of the /ka/ burst may turn the sound into a solid /ta/. More than a dozen hearing-impaired ears were tested on consonant identification in noise. While the deterioration in performance for flat mild-to-moderate hearing loss can be well predicted by the loss of audibility, subjects with other types of hearing loss often show patterns of difficult sounds that can hardly be explained by the shift of hearing threshold. A subject with almost identical binaural hearing loss is nearly deaf to /ka/ in one ear due to a mid-frequency cochlear dead region. Among the 18 /ka/s produced by different talkers, the subject can only hear one /ka/ at an accuracy of 80% and three other /ka/s at 20–40%. Most /ka/s are highly confused with /ta/ because the subject is listening to the conflicting /ta/ burst in the high-frequency. The /ka/→/ta/ confusion is significantly reduced when the conflicting cue is removed. NAR-L improves the average score by 10%, but it may degrade a few consonants under certain circumstances.

Graduation Semester

2009-12

Permalink

http://hdl.handle.net/2142/14603

Copyright and License Information

Copyright 2009 Feipeng Li

Owning Collections