What Is Temporal Fine Structure and Why Is It Important?

다국어 초록 (Multilingual Abstract)

Complex sound like speech can be characterized as the sum of number of amplitude-modulated signals representing the outputs of an array of narrow frequency bands. Temporal information at the output of each band can be separated into temporal fine structure (TFS), the rapid oscillations close to the center frequency and temporal envelope (ENV), slower amplitude modulations superimposed on the TFS. TFS information can be carried in the pattern of phase locking to the stimulus waveform, while ENV by the changes in firing rate over time. The relative importance of temporal ENV and TFS information in understanding speech has been studied using various sound-processing techniques. A number of studies demonstrated that ENV cues are associated with speech recognition in quiet, while TFS cues are possibly linked to melody/pitch perception and listening to speech in a competing background. However, there are evidences that recovered ENV from TFS as well as TFS itself may be partially responsible for speech recognition. Current technologies used in cochlear implants (CI) are not efficient in delivering the TFS cues, and new attempts have been made to deliver TFS information into sound-processing strategy in CI. We herein discuss the current updated findings of TFS with a literature review.

참고문헌 (Reference)

1 Moore BC., "The role of temporal fine structure processing in pitch perception, masking, and speech perception for normal-hearing and hearing-impaired people" 9 : 399-406, 2008

2 Hopkins K., "The importance of temporal fine structure information in speech at different spectral regions for normal-hearing and hearing-impaired subjects" 127 : 1595-1608, 2010

3 Hopkins K., "The effect of compression speed on intelligibility : simulated hearing-aid processing with and without original temporal fine structure information" 132 : 1592-1601, 2012

4 Hopkins K., "The contribution of temporal fine structure to the intelligibility of speech in steady and modulated noise" 125 : 442-446, 2009

5 Moore BC., "The choice of compression speed in hearing AIDS : theoretical and practical considerations and the role of individual differences" 12 : 103-112, 2008

6 Gilbert G., "The ability of listeners to use recovered envelope cues from speech fine structure" 119 : 2438-2444, 2006

7 Won JH., "The ability of cochlear implant users to use temporal envelope cues recovered from speech frequency modulation" 132 : 1113-1119, 2012

8 Zeng FG., "Temporal pitch in electric hearing" 174 : 101-106, 2002

9 Shannon RV., "Speech recognition with primarily temporal cues" 270 : 303-304, 1995

10 Lorenzi C., "Speech perception problems of the hearing impaired reflect inability to use temporal fine structure" 103 : 18866-18869, 2006

11 Drullman R., "Speech intelligibility in noise : relative contribution of speech elements above and below the noise level" 98 : 1796-1798, 1995

12 Won JH., "Spectral-ripple resolution correlates with speech reception in noise in cochlear implant users" 8 : 384-392, 2007

13 Joris PX., "Responses to amplitude-modulated tones in the auditory nerve of the cat" 91 : 215-232, 1992

14 Xu L., "Relative contributions of spectral and temporal cues for phoneme recognition" 117 : 3255-3267, 2005

15 Rubinstein JT., "Pseudospontaneous activity : stochastic independence of auditory nerve fibers with electrical stimulation" 127 : 108-118, 1999

16 Ardoint M., "Perception of temporal fine-structure cues in speech with minimal envelope cues for listeners with mild-to-moderate hearing loss" 49 : 823-831, 2010

17 Ghitza O., "On the upper cutoff frequency of the auditory critical-band envelope detectors in the context of speech perception" 110 (110): 1628-1640, 2001

18 Zeng FG., "On the dichotomy in auditory perception between temporal envelope and fine structure cues" 116 : 1351-1354, 2004

19 Hopkins K., "Moderate cochlear hearing loss leads to a reduced ability to use temporal fine structure information" 122 : 1055-1068, 2007

20 Ernst SM., "Mechanisms underlying the detection of frequency modulation" 128 : 3642-3648, 2010

21 Gatehouse S., "Linear and nonlinear hearing aid fittings--1. Patterns of benefit" 45 : 130-152, 2006

22 Li X., "Improved perception of speech in noise and Mandarin tones with acoustic simulations of harmonic coding for cochlear implants" 132 : 3387-3398, 2012

23 Li X., "Improved perception of music with a harmonic based algorithm for cochlear implants" 21 : 684-694, 2013

24 Moore BC., "Factors affecting thresholds for sinusoidal signals in narrow-band maskers with fluctuating envelopes" 82 : 69-79, 1987

25 Nie K., "Encoding frequency modulation to improve cochlear implant performance in noise" 52 : 64-73, 2005

26 Qin MK., "Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers" 114 : 446-454, 2003

27 Hopkins K., "Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech" 123 : 1140-1153, 2008

28 Moore BC., "Development of a fast method for determining sensitivity to temporal fine structure" 48 : 161-171, 2009

29 Oxenham AJ., "Correct tonotopic representation is necessary for complex pitch perception" 101 : 1421-1425, 2004

30 Lacher-Fougère S., "Consequences of cochlear damage for the detection of interaural phase differences" 118 : 2519-2526, 2005

31 Schooneveldt GP., "Comodulation masking release(CMR) : effects of signal frequency, flanking-band frequency, masker bandwidth, flanking-band level, and monotic versus dichotic presentation of the flanking band" 82 : 1944-1956, 1987

32 Oxenham AJ., "Cochlear compression : perceptual measures and implications for normal and impaired hearing" 24 : 352-366, 2003

33 Smith ZM., "Chimaeric sounds reveal dichotomies in auditory perception" 416 : 87-90, 2002