키로깅 방지를 위한 시각적 추상화 기반의 회전형 가상키보드시스템

백금옥 한국방송통신대학교 평생대학원 2010 국내석사

웹서비스의 이용이 증가함에 따라, 웹서비스의 취약점을 이용하여 타인의 개인 정보를 빼내고 이를 악의적으로 이용하는 사례들이 함께 늘고 있어 심각한 사회적 문제로 대두되고 있다. 특히 키로거(Keylogger) 등의 해킹 툴에 의하여 아이디나 비밀번호 등의 개인정보가 유출된다면, 로그인 후 다른 보안 프로그램에 의하여 보호를 받는다고 하더라도 보안의 치명적인 허점이 될 수 있다. 이러한 해킹 툴에 의한 개인 정보 유출을 방지하기 위한 솔루션으로써 다양한 방법들이 제안되었고, 그 대표적인 것이 마우스만으로 숫자나 문자를 입력하여 키보드를 대신함으로써 키로깅을 차단하는 가상 키보드 입력 방식이다. 현재 주로 사용되는 가상키보드는 난수생성기에 의하여 생성된 숫자나 문자가 무작위로 배열된 키패드를 마우스로 선택하는 방식이며, 4×3 배열 및 키보드 타입의 가상키보드가 주로 사용된다. 그런데 4×3 배열 및 키보드 타입의 가상키보드는 숫자나 문자를 무작위로 배열하므로 순차적인 배열에 비해 가독성이 떨어지므로 사용자의 입력시간이 지연되는 단점이 있다. 이에 본 논문에서는 이러한 단점을 보완하면서 적정 수준의 보안을 유지할 수 있는 시각적 추상화를 기반의 회전형 가상키보드시스템 (R-VKS; Rotary-type Virtual Keyboard System)을 제안한다. R-VKS는 숫자나 문자를 순차적으로 배열하여 사용자가 쉽게 인식할수 있도록 게슈탈트(Gestalt) 시지각 이론 중 근접성, 유사성, 연속성의 법칙을 적용하여 설계하였다. 이러한 시각적 추상화 기반의 R-VKS는 다른 가상키보드와 마찬가지로 키로깅과 마우스 위치 추적 등의 해킹 툴에 대한 적정 수준의 보안성을 제공한다. 또한 R-VKS는 기존의 다른 가상키보드와의 입력시간을 비교 평가한 결과 4×3 배열 가상키보드보다는 약 38.5% 정도의 입력시간을, 키보드타입 가상 키보드보다는 약 56.9% 정도의 입력시간을 단축하는 효과가 있었다. 하지만, 일반적으로 보안성과 편의성은 어느 한 쪽을 강조하면 나머지 다른 쪽은 취약해지는 서로 반비례 관계에 있다. 이에 R-VKS 또한 입력속도를 향상시켜 사용자의 편의성을 증진시켰지만, 훔쳐보기(Shoulder Surfing) 공격에 대한 한계는 완벽하게 극복하지 못하였다. As the use of web service is increasing recently, it also rises up that using personal information of others maliciously after stealing it by using vulnerability of web service. It becomes serious social problems. Particularly personal information such as ID or password can be leaked by hacking tools like keylogger so it results in showing the fatal weak point in spite of the protection by security program after login. A variety of ways are suggested as a solution preventing leaking personal information by such hacking tools like key logger. The typical example is that number or character is input only by mouse instead of keyboard. It is virtual keyboard input mode blocked backing risk. Recently mainly used virtual keyboard input mode is that number or security key pad of cracter is chosen by mouse. Especially, mostly used virtual keyboard of 4×3 matrix and keyboard type is arrayed number or character randomly by random number generator. However, number or character arrayed by random is less readability than sequential array so that input time of user is delayed. Therefore Rotary-type Virtual Keyboard System (R-VKS) based on Visual Abstraction is suggested to overcome this weakness and to maintain appropriate levels of security in this paper. R-VKS is designed by the application of "Law of Proximity", "Law of Similarity", "Law of Continuation" among Gestalt Visual Perception theory as it is sequentially arrayed number of character in order to help user's easy recognition. R-VKS based on such visual abstraction provides ropriate level of security for keylogging and hacking tools including mouse tracking like other virtual keyboard. The proposed R-VKS has effect on reducing time of about 38.5% compared with 4×3 matrix virtual keyboard, and of about 56.9% compared with virtual keyboard in keyboard type. Friendliness and security is, however, generally in inverse proportion so if one is emphasized, another is weakened. Hence, R-VKS improve user friendliness by rising input speed whereas it does not completely overcome the limitation of shoulder surfing attack.

A study on the design of finger position-aware virtual keyboards

Choi, Daewoong 고려대학교 대학원 2016 국내석사

As the number of touch screen devices increases, the virtual keyboards have become more common these days. Because those can be applied to any touch screen size, the virtual keyboards and touch screen devices have a symbiotic relationship. However, current virtual keyboards are known to be slower and less convenient than physical QWERTY keyboards because they simply imitate the traditional QWERTY keyboards on touchscreens. In order to improve virtual keyboards, I consider two reasonable assumptions based on the observation of skilled typists. First, the keys are already assigned to each finger for typing. Based on this assumption, I suggest restricting each finger to entering pre-allocated keys only. Second, non-touching fingers move in correlation with the touching finger because of the intrinsic structure of human hands. This paper checks whether the correlations between all fingers exist, and then suggests a novel virtual keyboard using two proposed observations. Finally, to show the effect of each observation, the new keyboard compared with existing virtual keyboards. Through three experiments, the proposed keyboard outperforms existing virtual keyboards with respect to the typing speed and accuracy. Therefore, this paper contributes to the design of future virtual keyboards.

텍스트 기반 음악 장르 구현을 위한 실시간 타이핑 멀티미디어 시스템 연구 : 멀티미디어 작품 <The Live Essay: undefined> 를 중심으로

김혜림 동국대학교 영상대학원 2026 국내석사

This study originates from a critical inquiry into the rise of technological fetishism and aesthetic homogenization brought about by the ubiquity of digital technology and the acceleration of artificial intelligence. As automation increasingly replaces the cognitive processes of human creativity, this research argues that the act of thinking, writing, and speaking—embodied in natural language—must be reasserted as the essential source of artistic generation. The decision to reintroduce text as a central artistic medium is therefore not a nostalgic return to linguistic art, but a philosophical practice aimed at recovering language as an act of cognition in an era where technology threatens to subsume human narrative. In response, this study constructs a novel text-based performance system that treats linguistic expression—specifically typing—as an artistic process, thereby realizing a new musical paradigm grounded in real-time interaction. Two conceptual frameworks organize this system. The first, Textronica, combines ‘text’ and ‘electronica’ to propose a form of real-time generative text-based music, where language, rhythm, sound, and image intersect as mutually generative structures. The second, Digital Jazz, extends the aesthetics of improvisation, indeterminacy, and post-narrativity into the digital domain, transforming human errors, hesitations, and rhythmic variations into creative variables that drive emergent AudioVisual outcomes. The system was implemented in the Max/MSP/Jitter environment. Centered on the textedit object, the performer’s typing is visualized in real time while simultaneously triggering multimedia data through jit.movie object, jit.playlist object and coll object. Probabilistic algorithms utilizing random object and counter object generate unique outcomes for every iteration, ensuring that no input is ever repeated. The rhythm, speed, and temporal spacing of keystrokes, as well as typos and deletions, operate as performative parameters that transform textual input into a narrative rhythm—a structure in which text functions as both linguistic and sonic material. Through this process, typing transcends its conventional role as data entry and becomes an AudioVisual act of thinking in real time. The final work, <The Live Essay: undefined>, embodies the integration of Textronica and Digital Jazz as an experimental performance. The term ‘undefined,’ borrowed from JavaScript, alludes to the notion of an open, non-fixed human subjectivity. The work inherits the lineage of Expanded Cinema, Interface Cinema, Collage Film, and Avant-garde Film, yet reconfigures their principles through a text-driven interactive system. Here, the performer’s typing visualizes performed thought, converting language into a live, improvisational essay where narrative unfolds as an event rather than a pre-written structure. The aesthetic achievement of this research lies not in technological spectacle but in redefining the computer keyboard as an instrument of cognition—a medium through which human rhythm, perception, and error are rendered audible and visible. Technology, in this context, is reframed not as a substitute for human creation but as an extension of cognition, a tool that amplifies the interplay between thought and expression. Within the discontinuity of digital on/off logic, moments of chance, intention, and hesitation become the generative conditions of art. Ultimately, this study restores the agency of the homo scriptus—the writing human—within digital systems. By transforming typing into a performative synthesis of language, sound, and image, Textronica and Digital Jazz establish a new artistic paradigm in which the rhythm of thought itself becomes the medium of creation. Through this work, the research redefines the relationship between technology and humanity, proposing a humanistic framework for art in the age of generative computation.

입력매체가 자기개방에 주는 영향 : 인지 작업부하와 글쓰기 속도의 매개효과

김수영 연세대학교 대학원 2016 국내석사

In this study, we explored the influence of different cognitive process caused by writing via various input media to writing property. Specifically, we investigated whether the level of self-disclosure in articles can be varied depending on types of input medium and what mediation factors influence on this. For this, we compared keyboard typing to handwriting in experiment 1 and (hard) keyboard typing to smart phone touch typing in experiment 2. In experiment 2, real community site is used for external validity. The result of experiment 1 showed that participants of keyboard typing condition disclosed themselves more than handwriting condition. In experiment 2, the participants of hard keyboard typing condition disclosed themselves more than smart phone touch typing condition. The result of experiment 1 & 2 showed that when mental workload is lesser or writing speed is faster, it makes more self-disclosure. This study is the first study to find out the relation between input media and self-disclosure. 본 연구는 다양한 입력매체로 글을 쓸 때 입력매체에 따라 글을 쓰는 과정에서 수반되는 인지과정의 차이로 인해 글의 속성이 어떻게 달라지는지 알아보는 연구이다. 구체적으로, 글의 속성 중 ‘자기개방’정도가 입력 매체에 따라 차이가 있는지, 이 때 영향을 주는 매개 요인이 무엇인지 알아보았다. 이를 위해, 실험 1에서는 손글쓰기와 키보드타이핑을 비교하였고 실험 2에서는 하드 키보드타이핑과 스마트폰 터치 타이핑을 비교하였다. 실험 2에서는 실제 커뮤니티 사이트에서 실험을 진행하였다. 실험 1의 결과, 참가자들이 키보드 타이핑으로 글을 쓸 때에 손글쓰기로 글을 쓸 때보다 자기개방을 많이 하는 것으로 나타났다. 또한 실험 2에서, 하드 키보드 타이핑을 할 때가 스마트폰 터치 타이핑하여 글을 쓸 때보다 자기개방을 많이 하는 것으로 나타났다. 그리고 실험1과 2 모두에서 글을 쓸 때 요구되는 인지 작업부하가 적을수록, 속도가 빠를수록 자기개방 정도가 높은 것으로 나타났다. 실험 결과를 바탕으로 손글쓰기, 하드 키보드 타이핑, 터치 타이핑 중 하드 키보드 타이핑 시에 인지 작업부하가 가장 적고, 속도가 빨라 자기개방을 가장 많이 하게 되는 것으로 나타났다. 본 연구는 입력매체와 자기개방의 관계를 밝힌 최초의 연구이다.

리스트의 <라 캄파넬라>와 세미오노프의 바얀 편곡작품 비교분석

포영연 수원대학교 2021 국내박사

Semionov's <La Campanella> is an arrangement of Liszt's <La Campanella> as a work for bayan. Bayan is a kind of button-type chromatic accordion developed in the late 19th century, which is a classical instrument in Europe. The accordion has the structure of the keyboard, and there are 12 notes adjusted to the average rate. Since all of these notes can be played, piano works are often arranged and played. The structure of the free bass bayan accordion consists of three parts: a button section on the right, a bass button section on the left, and a pin to the middle windpipe. The bayan's tone color has a charm that captivates the audience. Since the bayan can produce various tone colors according to the combination of the reed, it is possible to portray multiple types of music such as clarinet, oboe, bassoon, and violin. This dissertation compares Liszt's <La Campanella> for piano and the work arranged by Semionov for bayan (button-type chromatic accordion), and examines techniques used to emphasize the characteristic tone of two instruments. The technically demanding elements of Liszt's work, played on the piano can be played easy on the bayan. Furthermore, it is an advantage that bayan can express its' various tone colors in effective ways. It is the purpose of this dissertation to examine the characteristics of bayan that are easy to express various tones and complex techniques, required to play on the piano.