내용기반 음악검색 시스템의 비교 분석 = A Comparative Analysis of Content-based Music Retrieval Systems

다국어 초록 (Multilingual Abstract)

This study compared and analyzed 15 CBMR (Content-based Music Retrieval) systems accessible on the web in terms of DB size and type, query type, access point, input and output type, and search functions, with reviewing features of music information and techniques used for transforming or transcribing of music sources, extracting and segmenting melodies, extracting and indexing features of music, and matching algorithms for CBMR systems. Application of text information retrieval techniques such as inverted indexing, N-gram indexing, Boolean search, truncation, keyword and phrase search, normalization, filtering, browsing, exact matching, similarity measure using edit distance, sorting, etc. to enhancing the CBMR; effort for increasing DB size and usability; and problems in extracting melodies, deleting stop notes in queries, and using solfege as pitch information were found as the results of analysis.

국문 초록 (Abstract)

본 연구는 웹에서 접근 가능한 내용기반 음악검색(CBMR) 시스템들을 조사하여, 탐색질의의 종류, 접근점, 입출력, 탐색기능, 데이터베이스 성격과 크기 등의 관점에서 특성을 비교 분석하고자 하였다. 비교 분석에 사용된 특성을 추출하기 위해 내용기반 음악정보의 특성과 시스템 구축에 필요한 파일의 변환, 멜로디 추출 및 분할, 색인자질 추출과 색인, 매칭에 사용되는 기술들을 선행연구로 리뷰하였다. 15개의 시스템을 분석한 결과 다음과 같은 특성과 문제점이 분석되었다. 첫째, 도치색인, N-gram 색인, 불리언 탐색, 용어절단검색, 키워드 및 어구 탐색, 음길이 정규화, 필터링, 브라우징, 편집거리, 정렬과 같은 텍스트 정보 검색 기법이 CBMR에서도 검색성능을 향상시키는 도구로 사용되고 있었다. 둘째, 시스템들은 웹에서 크롤링하거나 탐색질의를 DB에 추가하는 등으로 DB의 성장과 실용성을 위한 노력을 하고 있었다. 셋째, 개선되어야 할 문제점으로 선율이나 주선율을 추출하는데 부정확성, 색인자질을 추출할 때 사용되는 불용음(stop notes)을 탐색질의에서도 자동 제거할 필요성, 옥타브를 무시한 solfege 검색의 문제점 등이 분석되었다.

참고문헌 (Reference)

1 유진희, "허밍 질의 처리 시스템의 성능 향상을 위한 효율적인 빈번 멜로디 인덱싱 방법" 한국정보과학회 34 (34): 283-303, 2007

2 구경이, "주제 선율 색인을 이용한 내용 기반 음악정보 검색 시스템" 19 (19): 34-45, 2003

3 노정순, "정보검색 : 이론과 실제" 글누리 2011

4 최윤재, "음악의 특성에 따른 피아노 솔로 음악으로 부터의 멜로디 추출" 한국정보과학회 15 (15): 923-927, 2009

5 박만수, "실제 잡음 환경에 강인한 오디오 핑거프린팅 기법" SK텔레콤 16 (16): 435-446, 2006

6 이윤주, "내용기반 음악정보 검색시스템을 위한 이용자 중심의 질의 인터페이스 설계에 관한 연구" 한국정보관리학회 23 (23): 5-19, 2006

7 Zhu, Y., "Warping indexes with envelops transforms for query by humming" 181-192, 2003

8 Roger, B., "Understanding search performance in query-by humming systems" 85-89, 2004

9 Lemström, K., "Transposition invariant pattern matching for multi-track strings" 10 : 185-205, 2003

10 McNab, R. J., "Towards the digital music library : tune retrieval from acoustic input" 11-18, 1996

11 Kornstädt, A., "Themefinder : A web-based melodic search tool" 11 : 231-236, 1998

12 Wang, A., "The Shazam music recognition service" 49 (49): 44-48, 2006

13 McNab, R. J., "The New Zealand Digital Library MELody inDEX" 3 (3): 4-15, 1997

14 Chandrasekhar, V., "Survey and evaluation of audio fingerprinting schemes for mobile query-by-example applications" 801-806, 2011

15 Typke, R., "Searching notated polyphonic music using transportation distances" 128-135, 2004

16 Doraisamy, S., "Robust polyphonic music retrieval with n-grams" 21 (21): 53-70, 2002

17 Tripathy, A., "Query by humming system" 2 (2): 373-379, 2009

18 Ghias, A., "Query by humming : Musical information retrieval in an audio database" 231-236, 1995

19 김무정, "Query By Humming 응용을 위한 Midi 파일에서의 자동 멜로디 트랙 선택방법" 38 (38): 405-408, 2011

20 David, G., "Pitch extraction and fundamental frequency: history and current techniques" 2003

21 Viro, V., "Peachnote : Music score search and analysis platform" 359-362, 2011

22 Hanna, P., "On optimizing the editing algorithms for evaluating similarity between monophonic musical sequences" 36 (36): 267-279, 2007

23 Lemström, K., "On comparing edit distance and geometric frameworks in content-based retrieval of symbolically encoded polyphonic music. Musicae Scientiae" 4 : 135-152, 2007

24 Pardo, B., "Name that tune : A pilot study in finding a melody from a sung query" 55 (55): 283-300, 2004

25 Wang, C., "N-gram inverted index structures on music data for theme mining and content-based information retrieval" 27 (27): 492-503, 2006

26 Typke, R., "Music retrieval based on melodic similarity" Universiteit Utrecht 2007

27 Bainbridge, D., "Music information retrieval research and its context at the University of Waikato" 55 (55): 1092-1099, 2004

28 Papadopoulos, H., "Modeling chord and key structure with Markov logic" 127-132, 2012

29 Chai, W., "Melody retrieval on the web" 226-, 2002

30 Cartwright, M. B., "Making searchable melodies: Human versus machine" 2011

31 Rho, S., "MUSEMBLE: A novel music retrieval system with automatic voice query transcription and reformulation" 81 (81): 1065-1080, 2008

32 Kan, M., "LyricAlly: Automatic synchronization of textual lyrics to acoustic music signals" 16 (16): 338-349, 2008

33 Bandera, C. de la, Barbancho, A. M., "Humming method for content-based music information retrieval" 49-54, 2011

34 Shiffrin, J., "HMM-based musical query retrieval" 295-300, 2002

35 Turetsky, R. J., "Ground truth transcriptions of real music from forcealligned MIDI syntheses" 445-448, 2003

36 Downie, S., "Evaluating a simple approach to music information retrieval: Conceiving melodic N-grams as text" Univ. of Western Ontario 1999

37 Hug, A., "Crowdsourcing a real-world on-line query by humming system" 2010

38 Wold, E., "Content-based classification, search, and retrieval of audio" 3 (3): 27-36, 1996

39 Wan, C., "Content-based audio retrieval with relevance feedback" 27 (27): 85-92, 2006

40 Duggan, B., "Compensating for expressiveness in queries to a content based music information retrieval system" 33-36, 2009

41 Melucci, M., "Combining melody processing and information retrieval techniques : Methodology, evaluation and system implementation" 55 (55): 1058-1066, 2004

42 Sheh, A., "Chord segmentation and recognition using EM-trained hidden Markov models" 2003

43 Chen, R., "Chord recognition using durationexplicit hidden Markov models" 445-450, 2012

44 Chew, E., "Challenging uncertainty in query by humming systems: A fingerprinting approach" 16 (16): 359-371, 2008

45 Arifi, V., "Automatic synchronization of music data in score-, MIDI-, and PCM-format" 2003

46 Mesaros, A., "Automatic recognition of lyrics in singing" 546047-, 2010

47 Cheng, H. T., "Automatic chord recognition for music classification and retrieval" 1505-1508, 2008

48 Kline, R. L., "Approximate matching algorithms for music information retrieval using vocal input" 130-139, 2003

49 Prechelt, M., "An interface for melody input" 6 (6): 133-149, 2001

50 Wang, A., "An industrial-strength audio search algorithm" 2003

51 Cilibrasi, R., "Algorithmic clustering of music based on string compression" 28 (28): 49-67, 2004

52 Lee, K., "Acoustic chord transcription and key extraction from audio using key-dependent HMMs trained on synthesized audio" 26 (26): 291-301, 2008

53 Typke, R., "A survey of music information retrieval systems" 153-160, 2005

54 Cano, P., "A review of audio fingerprinting" 41 : 271-284, 2005

55 Goto, M., "A real-time music-scene-description system: Predominant-F0 estimation for detecting melody and bass lines in real-world audio signals" 43 (43): 311-329, 2004

56 Nam, G. P., "A new query-by-humming system based on the score level fusion of two classifiers" 25 (25): 717-733, 1187

57 Dannenberg, R., "A Comparative evaluation of search techniques for query by humming using the MUSART testbed" 58 (58): 587-701, 2007