Semantic Vector Learning Using Pretrained Transformers in Natural Language Understanding

Sangkeun Jung 한국정보과학회 2020 Journal of Computing Science and Engineering Vol.14 No.4

Natural language understanding (NLU) is a core technology for implementing natural interfaces. To implement and support robust NLU, previous studies introduced a neural network approach to learn semantic vector representation by employing the correspondence between text and semantic frame texts as extracted semantic knowledge. In their work, long short-term memory (LSTM)-based text and readers were used to encode both text and semantic frames. However, there exists significant room for performance improvement using recent pretrained transformer encoders. In the present work, as a key contribution, we have extended Jung"s framework to work with pretrained transformers for both text and semantic frame readers. In particular, a novel semantic frame processing method is proposed to directly feed the structural form of the semantic frame to transformers. We conducted massive experiments by combining various types of LSTM- or transformer-based text and semantic frame readers on the ATIS, SNIPS, Sim-M, Sim-R, and Weather datasets to find the best suitable configurations for learning effective semantic vector representations. Through the experiments, we concluded that the transformer-based text and semantic frame reader show a stable and rapid learning curve as well as the best performance in similarity-based intent classification and semantic search tasks.

Is the Deployment of THAAD in South Korea a Right Choice?

Sangkeun Lee Ewha Institute of Unification Studies 2015 Journal of peace and unification Vol.5 No.1

Power Integrity and Shielding Effectiveness Modeling of Grid Structured Interconnects on PCBs

SangKeun Kwak,YoungSic Jo,JeongMin Jo,SoYoung Kim 대한전자공학회 2012 Journal of semiconductor technology and science Vol.12 No.3

In this paper, we investigate the power integrity of grid structures for power and ground distribution on printed circuit board (PCB). We propose the 2D transmission line method (TLM)-based model for efficient frequency-dependent impedance characterization and PCB-package-integrated circuit (IC) co-simulation. The model includes an equivalent circuit model of fringing capacitance and probing ports. The accuracy of the proposed grid model is verified with test structure measurements and 3D electromagnetic (EM) simulations. If the grid structures replace the plane structures in PCBs, they should provide effective shielding of the electromagnetic interference in mobile systems. An analytical model to predict the shielding effectiveness (SE) of the grid structures is proposed and verified with EM simulations.

King and Asia: The Influence of Gandhi’s Concept of Satyagraha on the Non-violence Theology of Martin Luther King, Jr

Sangkeun Kim 한국민중신학회 2011 Madang: Journal of Contextual Theology Vol.0 No.15

Dr. Martin Luther King, Jr. (1929-1968), perhaps the most famous martyr on the United States of the twentieth century, was not a mere social justice activist who demanded black rights. Rather his movement was an accumulated theoretical production of contemporary American theology, from the social gospel of Walter Rauschenbusch (1861-1918) to the Bostonian Personalism of Albert Knudson (1873-1953) and Edgar Brightman(1884-1953). Dr. King has interacted with many contemporary theologians through his personal contact or private readings of their theological works, such as the monographs of Walter Rauschenbusch, Reinhold Niebuhr, Paul Tillich and Karl Barth, throughout his intensive academic training from Morehouse College (B. A. in 1948) to Boston University (Ph. D. in 1955). King’s theological perspectives have also been sharpened and deepened by his visits to Africa, Central America, Europe and Asia throughout his short period of life time. As crossing cultural boundaries of other countries and continents, he had numerous opportunities to widen his theological horizon by having religious conversations with the leaders of other great religions. Through these cross-cultural experiences, King was able to claim not only the substantial particularity of his own Christian theology but also the universal dimension of his religious convictions. Among these inter-religious experiences of Martin Luther King, Jr., I would like to investigate his theological journey in Asia. It is my intension to expose the religious influence of Mahatma Gandhi’s concept of Satyagraha onto Dr. Martin Luther King’s theological formulation of the non-violence theology. The final reflection will be added, emphasizing the importance of the economic elements in Satyagraha at the age of globalization.

A Study on Separation of Woods from Construction Waste by the Double-cyclone Wind separator and High-precision Near Infrared Analysis System

( Sangkeun Kim ) 한국폐기물자원순환학회(구 한국폐기물학회) 2019 ISSE 초록집 Vol.2019 No.-

Waste wood contained in construction waste would possibly be used as a fuel or recycled material in other industries. The combustible materials including paper, textile, plastic, vinyl or synthetic resins could be used as subsidiary fuel or recycled material. In this study, we focus on developing a technique to classify and separate the combustible wastes(especially, woods) from the mixed construction and demolition (C&D) waste. Two systems are considered. The first one is composed of 1) cistern and airdrying separator to classify large sized combustible waste 2) rake-brush type separator to classify small sized combustible waste and 3) NIR method to separate wood waste. The second one is conducted under the dried condition and is composed of 1) Jaw & impact crusher to crash waste and 2) 2 stage-seperator & NIR method to maximize the efficiency of combustible waste separation. The NIR (Near Infrared) is part of the infrared range in the electromagnetic radiation spectrum, with wavelength limits at 0.8 and 2.5 μm. A large number of substances exhibit typical spectra for their composition and properties in this spectral range which can be measured with NIR spectrometers and interpreted qualitatively and quantitatively. NIR is a sophisticated system for automatically picking mixed potential recyclables and refuse. This system is equipped with a fast and high-precision near infrared analysis combined with a computer controlled discharging system. As a result of the evaluation on combustion characteristics, activation energy of wood pellet and timber wood are higher. Thus, it can be considered that timber wood would be a main factor as a combustion of mixing various kinds of wood.

초기 예수회 선교사 호세 데 아코스타와 로베르토 데노빌리의 저술에 나타난 타자의 이해에 대한 관점의 일반적인 특징에 대하여

Sangkeun Kim 한국선교신학회 2011 선교신학 Vol.26 No.-

선교 현지에 도착한 선교사들은 피선교지 주민을 향해 근본적인 질문을 제기할 수밖에 없다. 이들은 과연 누구인가? 이들은 우리와 무엇이 다른가? 이들은 과연 하나님을 받아들일 만한 지적 능력을 가지고 있는가? 이러한 “타자”에 대한 초기의 질문을 제기한 사람들이 바로16세기부터 선교현장으로 파견되었던 예수회 선교사들이다. 이 논문은 이러한 초기 질문을 16세기 후반 페루에서 제기했던 호세 데 아코스타(1572-1586)와 17세기 초반 남 인도에서 제기했던 로베르토 데노빌리(1606-1656)의 저술을 통해, 이들 선교사들이 어떻게 최초로 종교적 타자를 이해하고 분류했는지를 분석하고 있다. 호세 데 아코스타는 1590년에 편찬한HISTORIA란 책을 통해 페루 지역의 원주민들이 콜럼버스 이전부터 유지해 오던 토착 종교를 면밀하게분석했다. 아코스타는 이 책에서 이중적인 접근방식을 취한다. 아코스타에 의하면 페루 원주민들은 후아카스(HUACAS)라는 끔찍한 우상 숭배의 죄악에 빠져있지만, 동시에 하나님을 알수있는 능력을 내재하고 있다고 보았다. 이러한 이중적인 타자에 대한 이해는 그의 관찰의 프레임으로 작용하고 있는 스페인 시골 주민들의 미신에 가까운 가톨릭 신앙과연관이있다. 16세기 스페인 내부의 종교재판 기록과 아코스타의 페루 주민에 대한 비판을 비교해 보면 명백한 유사점이 발견된다. 깊은 종교성과 동시에 미신적인 의식을 선호했던 스페인 시골 주민들의 신앙에 대한 평가와 페루 주민의 종교성에 대한 평가가 흡사한 이유는, 아코스타가 페루 주민에 대한 해석에 사실상 스페인 시골 주민에 대한 이해를 투영시킨 결과이기 때문이다. 결국 아코스타에 있어서 타자에 대한 해석은 자기 정체성에 대한 내부적 이해와 결부되어 있었다는 것이다. 인도에서 활동하며 이른바 상류층 우선 접근 선교방식으로 큰 논쟁을 불러 일으켰던 로베르토 데노빌리의 경우에서도 같은 투영 현상이 나타난다. 데노빌리는 자신을 인도의 최상위 카스트인 브라민과 동일시하면서, 심지어 브라민의 신 이해를 자신의 신 이해와 일치시키는 신학적 대담성을 보이는 글을 발표했다. 이는 인도 사회에서 브라민 카스트가 차지하는 학문적, 사회적 위상을 자신이 포르투갈 출신의 선교사들과 차별되는 귀족 및 학자의 위상을 투영시킨 결과이다. 이 논문은 이러한 투영의 과정을 1613년 어간의 인도 선교 역사와 비교하면서 로베르토 데노빌리의 “타자”에 대한 이해를 분석한다. 결국 아코스타와 데노빌리와 같은 초기 선교사들은 종교적 타자에 대한 이해에 있어서 자기 정체성의 이해 정도를 투영시켜 타자를 규정하게 된다는 것을 선교 역사적 경험과 남겨진 초기 선교사 문헌을 통하여 확인할 수 있게 되었다.

Semantic Vector Learning and Visualization with Semantic Cluster Using Transformers in Natural Language Understanding

Sangkeun Jung 한국정보과학회 2022 Journal of Computing Science and Engineering Vol.16 No.2

Natural language understanding (NLU) is a fundamental technology for implementing natural interfaces. The embedding of sentences and correspondence between text and its extracted semantic knowledge, called semantic frame, has recently shown that a semantic vector representation is key in the implementation or support of robust NLU systems. Herein, we propose an extension of cluster-aware modeling with various types of pre-trained transformers for consideration of the many-to-1 relationships of text-to-semantic frames and semantic clusters. To attain this, we define the semantic cluster, and design the relationships between cluster members to learn semantically meaningful vector representations. In addition, we introduce novel ensemble methods to improve the semantic vector applications around NLU, i.e., similarity-based intent classification and a semantic search. Furthermore, novel semantic vector and corpus visualization techniques are presented. Using the proposed framework, we demonstrate that the proposed model can learn meaningful semantic vector representations in ATIS, SNIPS, SimM, and Weather datasets.

Using Utterance and Semantic Level Confidence for Interactive Spoken Dialog Clarification

Sangkeun Jung,Cheongjae Lee,Gary Geunbae Lee 한국정보과학회 2008 Journal of Computing Science and Engineering Vol.2 No.1

Spoken dialog tasks incur many errors including speech recognition errors, understanding errors, and even dialog management errors. These errors create a big gap between the user's intention and the system's understanding, which eventually results in a misinterpretation. To fill in the gap, people in human-to-human dialogs try to clarify the major causes of the misunderstanding to selectively correct them. This paper presents a method of clarification techniques to human-to-machine spoken dialog systems. We viewed the clarification dialog as a two-step problem - Belief confirmation and Clarification strategy establishment. To confirm the belief, we organized the clarification process into three systematic phases. In the belief confirmation phase, we consider the overall dialog system's processes including speech recognition, language understanding and semantic slot and value pairs for clarification dialog management. A clarification expert is developed for establishing clarification dialog strategy. In addition, we proposed a new design of plugging clarification dialog module in a given expert based dialog system. The experiment results demonstrate that the error verifiers effectively catch the word and utterance-level semantic errors and the clarification experts actually increase the dialog success rate and the dialog efficiency.

Electromagnetic Susceptibility Analysis of I/O Buffers Using the Bulk Current Injection Method

SangKeun Kwak,Wansoo Nah,SoYoung Kim 대한전자공학회 2013 Journal of semiconductor technology and science Vol.13 No.2

In this paper, we present a set of methodologies to model the electromagnetic susceptibility (EMS) testing of I/O buffers for mobile system memory based on the bulk current injection (BCI) method. An efficient equivalent circuit model is developed for the current injection probe, line impedance stabilization network (LISN), printed circuit board (PCB), and package. The simulation results show good correlation with the measurements and thus, the work presented here will enable electromagnetic susceptibility analysis at the integrated circuit (IC) design stage.

Compensation for the Body-Coupling in the 2-Gimballed Seeker Homing Loop on BTT Missile

Sangkeun Jeong,Eulgon Kim,Chanho Song,Hangju Cho 제어로봇시스템학회 2001 제어로봇시스템학회 국제학술대회 논문집 Vol.2001 No.10