Analysis of Korean Viseme System in Korean Standard Monosyllabic Word Lists

다국어 초록 (Multilingual Abstract)

Objectives: The purpose of this study was to investigate the speechreading abilities of the Korean population and verify the Korean viseme system by utilizing the Korean Standard Monosyllabic Word List for Adults (KS-MWL-A), a list of words selected in consideration of phonemic balance and frequency of everyday use. Methods: KS-MWL-A words spoken by both male and female speakers were filmed. The speechreading test with no auditory cues was performed on 32 subjects and the percent correct scores of words and phonemes were identified and analyzed using ANOVA. Three positions of phonemes, initial, medial and final, were classified according to a confusion matrix to determine the Korean viseme groups based on a criterion of a 60% correct response. Results: The results showed that the percent correct score of words was 13.00%. The percent correct scores of phonemes of initial, medial, and final positions were 19.04%, 48.26%, and 44.77%, respectively. The Korean visemes were classified as initial phonemes [/k, kh, k’, h, [ ]/, /n, d, t’, th, (s), [ ]/, /m, p, ph, p’/, /s, s’, ʨ, ʨh/], medial phonemes [/i, ɯ, ɯi/, /wi/, /o, jo/, /a, ja/, /u, ju/, /ʌ, jʌ/, /wa, Ø, (wε)/, /jε, æ, e/] and final phonemes [/[ ], k, ŋ/, /n, d/, /l/, /m, b/]. Conclusion: It was revealed that vowels affect both the initial and final position of consonants in the Korean viseme system. Furthermore, the sensitivity to the presence of the final consonant seemed to have the capability to affect the final consonant of the viseme system.

참고문헌 (Reference)

1 박혜진, "학령기 인공와우 착용 아동의 어휘력과 말지각 상관성" 한국언어청각임상학회 21 (21): 488-501, 2016

2 변성완, "전국의 수련 병원에서 사용하고 있는 한국어 단음절어음표의실태 및 어음 빈도 분석" 대한이비인후과학회 48 (48): 1086-1090, 2005

3 박무균, "어음청력검사 어음표의 주파수별 음향학적 특성에 관한 연구" 대한이비인후과학회 50 (50): 480-485, 2007

4 임예람, "스마트폰을 이용한 원격 독화 중재가 청년층 청각장애인의 독화 능력에 미치는 영향" 특수교육연구소 15 (15): 125-154, 2016

5 김종현, "국어표준화 독화기능 검사 개발을 위한 연구(1)" 한국언어치료학회 14 (14): 23-41, 2005

6 김종현, "국어 말읽기 기능 검사의 타당성 연구" 한국언어치료학회 25 (25): 57-66, 2016

7 Wozniak, V. D., "Visual vowel and diphthong perception from two horizontal viewing angles" 22 : 354-365, 1979

8 Lesner, S. A., "Visual vowel and diphthong perception across speakers" 14 : 252-258, 1981

9 Holden, E. J., "Visual speech recognition using cepstral images" 331-336, 2000

10 Lidestam, B., "Visual phonemic ambiguity and speechreading" 49 : 835-847, 2006

11 Erber, N. P., "Visual perception of speech by deaf children : recent developments and continuing needs" 39 : 178-185, 1974

12 Binnie, C. A., "Visual intelligibility of consonants : a lipreading screening test with implications for aural rehabilitation" 41 : 530-539, 1976

13 O’Neill, J. J., "Visual communication for the hard of hearing" Prentice-Hall 1981

14 Owens, E., "Visemes observed by hearing-impaired and normal-hearing adult viewers" 28 : 381-393, 1985

15 Leaner, S. A., "Training influences on visual consonant and sentence recognition" 8 : 283-287, 1987

16 Jackson, P. L., "The theoretical minimal unit for visual speech perception : visemes and coarticulation" 90 : 99-115, 1988

17 Kuk, M. K., "The effect of the lipreading programs on hearing-impaired children’s lipreading and voice" 5 : 99-122, 1997

18 Kuk, M. K., "The effect of lipreading program on a hearing-impaired adult’s lipreading" 21 : 107-118, 1998

19 Lee, J. H., "Standard pronunciation and real pronunciation of Korean" Acanet 2012

20 Jeffers, J., "Speechreading(lipreading)" Charles C. Thomas 1971

21 Mohammed, T., "Speechreading skill and visual movement sensitivity are related in deaf speechreaders" 34 : 205-216, 2005

22 Woll, B., "Speechreading revisited" 14 : 16-21, 2012

23 Auer, E. T., "Speechreading and the structure of the lexicon : computationally modeling the effects of reduced phonetic distinctiveness on lexical uniqueness" 102 : 3704-3710, 1997

24 Bernstein, L. E., "Speech perception without hearing" 62 : 233-252, 2000

25 Walden, B. E., "Some effects of training on speech recognition by hearing-impaired adults" 24 : 207-216, 1981

26 Montgomery, A. A., "Physical characteristics of the lips underlying vowel lipreading performance" 73 : 2134-2144, 1983

27 De Filippo, C. L., "New reflections on speechreading" 90 : 1-313, 1988

28 Hiki, S., "Negative effect of homophones on speechreading in Japanese" 1997

29 Cohen, M. M., "Models and techniques in computer animation" Springer Japan 139-156, 1993

30 Lee, K. S., "Language instruction and therapy method for deaf childhood" Daegu University 2006

31 Burnham, D., "Hearing eye II : the psychology of speechreading and auditory-visual speech East" Psychology Press 2013

32 Summerfield, Q., "Hearing by eye: the psychology of lip-reading" Lawrence Erlbaum 3-51, 1987

33 Dodd, B., "Hearing by eye : the psychology of lip-reading" Lawrence Erlbaum Associates 1987

34 Byun, S. W., "Frequencies of Korean phonemes and reliability of Korean phonetically balanced word lists" 44 : 485-489, 2001

35 Tye-Murray, N., "Foundations of aural rehabilitation : children, adults, and their family members. Stamford" Nelson Education 2014

36 Walden, B. E., "Effects of training on the visual recognition of consonants" 20 : 130-145, 1977

37 Auer, E. T., "Effects of phonetic variation and the structure of the lexicon on the uniqueness of words" 21-24, 1997

38 Montgomery, A. A., "Effects of consonantal context on vowel lipreading" 30 : 50-59, 1987

39 Kim, Y. W., "Effectiveness of speechreading cues for hearing impaired children" 57 : 69-108, 1993

40 Kricos, P. B., "Differences in visual intelligibility across talkers" 84 (84): 219-225, 1982

41 Kim, J. S., "Development of Korean Standard Monosyllabic Word Lists for Adults(KS-MWL-A)" 4 : 126-140, 2008

42 Fisher, C., "Confusions among visually perceived consonants" 11 : 796-804, 1968

43 Lee, S. C., "Comparison of speechreading abilities of adults with normal hearing and with hearing impairment" Nazarene University 2010

44 Benguerel, A. P., "Coarticulation effects in lipreading" 25 : 600-607, 1982

45 Grant, K. W., "Auditory-visual speech recognition by hearing impaired subjects : consonant recognition, sentence recognition, and auditory-visual integration" 103 : 2677-2690, 1998

46 Lamoré, P. J., "Auditory, visual and audiovisual perception of segmental speech features by severely hearing-impaired children" 37 : 396-419, 1998

47 Watson, C. S., "Auditory and visual speech perception: confirmation of a modality-independent source of individual differences in speech recognition" 100 : 1153-1162, 1996

48 Chen, T., "Audiovisual speech processing" 18 : 9-21, 2001

49 Chen, T., "Audio-visual integration in multimodal communication" 86 : 837-852, 1998

50 Kim, J. H., "An analysis of the factors constituting speechreading skill" Daegu University 1992

51 Park, S. L., "A study on the frequencies of consonants in adult conversational Korean" Ewha Womans University 1999

52 Kim, Y. W., "A study of the minimal lip-reading units in Korean phonemes" 14 : 55-72, 1997

53 Lee, K. S., "A review on primary factors of speechreading skill" 12 : 23-49, 1991