Multimodal audiovisual speech recognition architecture using a three-feature multi-fusion method for noise-robust systems

전상훈,이지은,여도현,이용주,김승준 한국전자통신연구원 2024 ETRI Journal Vol.46 No.1

Exposure to varied noisy environments impairs the recognition performance of artificial intelligence-based speech recognition technologies. Degradedperformance services can be utilized as limited systems that assure good performance in certain environments, but impair the general quality of speech recognition services. This study introduces an audiovisual speech recognition (AVSR) model robust to various noise settings, mimicking human dialogue recognition elements. The model converts word embeddings and log-Mel spectrograms into feature vectors for audio recognition. A dense spatial–temporal convolutional neural network model extracts features from log-Mel spectrograms, transformed for visual-based recognition. This approach exhibits improved aural and visual recognition capabilities. We assess the signalto-noise ratio in nine synthesized noise environments, with the proposed model exhibiting lower average error rates. The error rate for the AVSR model using a three-feature multi-fusion method is 1.711%, compared to the general 3.939% rate. This model is applicable in noise-affected environments owing to its enhanced stability and recognition rate.

폐 Aspergillosis의 외과적 치료

전상훈,이종태,김규태,Jeon, Sang-Hun,Lee, Jong-Tae,Kim, Gyu-Tae 대한흉부심장혈관외과학회 1989 Journal of Chest Surgery (J Chest Surg) Vol.22 No.1

Eleven cases of pulmonary resection had been performed for pulmonary aspergilloma in the department of thoracic and cardiovascular surgery, School of Medicine, Kyungpook National University from August 1984 to July 1988. The patients were consisted of six males and five females and were evenly distributed from third decade to sixth decade. Hemoptysis was usually presenting symptom [72.2%] and the variable was the interval between symptom onset to surgical resection, which was ranged from few months to several years In the plane chest films, intracavitary fungus balls were noted in five cases [5/11] and upper lobe involvements were seven cases [7/11]. Aspergillus fumigatus was identified preoperatively in three cases among the eight cases of sputum culture. Mean preoperative FVC and FEV 1.0 values were in normal range. Eleven pulmonary resections were done by eight lobectomies, two segmentectomies and one pneumonectomy. The lesion was superimposed upon old tuberculosis in eight patients, in one upon bronchiectasis and in two upon tuberculous bronchiectasis. Five complications appeared postoperatively which included ARDS [1 case] bleeding [2 cases], persistent air leak[1 case], and dead space [1 case].

폐암환자에서의 기관지성형술을 이용한 폐엽절제술

전상훈 대한흉부심장혈관외과학회 1989 Journal of Chest Surgery (J Chest Surg) Vol.22 No.5

Sleeve lobectomy for bronchogenic carcinoma is an alternative to pneumonectomy. The extent and location of the tumor must be such that a sleeve procedure is feasible. The conservation of lung tissue benefits both compromised and uncompromised patients. From August 1988 to March 1989, five patients underwent sleeve lobectomy for bronchogenic carcinoma of the lung. The patients included four males and one female ranging in age from 52 years to 66 years. All patients were diagnosed as having squamous cell carcinoma. Operative procedures were right upper sleeve lobectomy in four cases and left upper sleeve lobectomy with pulmonary angioplasty in one case. Complications developed in one patient. An asthmatic attack necessitated ventilator support for one day. Bronchoscopic examinations were performed at two weeks and three months postoperatively in four patients. Anastomosis sites on all patients were intact, but in one case, nodules were noted. Pulmonary function tests were also checked at three months postoperatively, and showed good results. The reimplanted lobe or lobes contribute significantly to the overall remaining lung function. All patients are being followed up with satisfactory results, except one case of suspected local tumor recurrence. We think, therefore, that sleeve lobectomy is a safe and adequate procedure for patients with resectable lung cancer.

유아기 대동맥교약증의 외과적 치료

전상훈 대한흉부심장혈관외과학회 1989 Journal of Chest Surgery (J Chest Surg) Vol.22 No.5

Between September 1986, and August 1989, eight infants underwent operation for repair of coarctation of the aorta in the first year of life. The patients included 7 males and 1 female ranging in age 19 days and 9 months. Weights ranged from 3.5 Kg to 7 Kg [mean 5 Kg]. All patients had preductal coarctation of the aorta. Each infant had associated cardiac anomalies, including ventricular septal defect [7 infants] and patent ductus arteriosus [5 infants]. All had intractable congestive heart failure, despite aggressive medical therapy. Pressure gradient across the coarctation ranged from 10 mmHg to 60 mmHg. Operative techniques were subclavian flap aortoplasty in five cases, Gore-Tex patch aortoplasty in three cases. In addition to coarctation repair, six infants had concomitant banding of the pulmonary artery. Four infants required ventilator support for several days. There was no operative death. Complications developed in two. One infant had tracheal stenosis after a tracheostomy. Another infant had restenosis of the aorta revealed by cardiac catheterization 30 months after surgery. The pressure gradient was 30 mmHg, necessitating balloon dilatation aortoplasty. Results were satisfactory. During follow up, we performed total correction procedures [patch closure of the ventricular septal defect, infundibulectomy, pulmonary valvotomy and pulmonary artery angioplasty] in one case. Continuing follow-up finds all patients in good condition.

`초·중등교육에서 교권 보호 법제의 쟁점과 과제”에 대한 토론문 2

전상훈 한국교원교육학회 2016 한국교원교육학회 학술대회자료집 Vol.2016 No.11

교권은 교육활동을 가능케 하는 토대이며, 교권이 흔들리고 있다는 것은 단지 교사의 위기뿐만이 아니라 교육의 위기를 나타내는 하나의 징표라는 교수님의 의 견에 동감한다. 교육부가 발표한 교권 보호 대책 즉, 2012년 8월 28일에 발표한 ‘교권보호종합 대책’의 경우 학교 현장에 잘 알려지지 않았고, 그 실제적인 효과에 대해서도 의문 을 제기할 만한 수준으로, 교권보호를 위한 실질적이고 효과적인 새로운 시스템의 마련이 절실한 상황이다.

Epidermal Hydration Is Improved by Enhanced Ceramide Metabolism in Aged C57BL/6J Mice After Dietary Supplementation of Royal Jelly

전상훈,조윤희 한국식품영양과학회 2015 Journal of medicinal food Vol.18 No.9

Epidermal hydration is maintained by the epidermal lipid barrier, of which ceramide (Cer) is the major constituent. We examined the dietary effect of royal jelly (RJ) on epidermal hydration in aged mice. Altered Cer metabolism was further determined by measuring epidermal levels of individual Cer, glucosylceramide (GC), and sphingomyelin (SM) species, and of Cer-metabolizing enzymes. Aged C57BL/6J mice were fed a control diet (group AGED) or diets with 1% RJ harvested from two different areas (groups AGED+ RJ1:AGED + RJ2) for 16 weeks. Aged C57BL/6J mice with no dietary intervention (the control group: group C) represented the onset of aging. In group AGED, epidermal levels of hydration, Cer1/2/5/6/7, GC-A/B/C/D, SM1/2/3, and β-glucocerebrosidase (GCase) protein, an enzyme of GC hydrolysis for Cer generation, were lower than in group C; these levels, as well as those of Cer3/4 and acidic sphingomyelinase (aSMase) protein, an enzyme of SM hydrolysis for Cer generation, were higher in group AGED+ RJ1 than in group AGED. Despite increases in GC-B, SM1/2/3, and serine palmitoyltransferase2 protein, an enzyme of de novo Cer synthesis, in group AGED+ RJ2 to levels higher than in group AGED, epidermal levels of hydration, Cer1-7, GC-A/C/D, GCase, and aSMase proteins were similar in these two groups. Expression of GCase and aSMase mRNAs, and of Cer synthase3 and ceramidase proteins, enzymes of de novo Cer synthesis and degradation, did not differ among groups. Dietary RJ1 improved epidermal hydration by enhancing Cer metabolism with increased levels of all Cer, GC, and SM species, and of GCase and aSMase proteins.

ECM의 라인별 가중치를 이용한 TIMD 개선

전상훈,문기화,임성창,김재곤 한국방송∙미디어공학회 2024 방송공학회논문지 Vol.29 No.2

JVET은 VVC 표준화 완료 후, 새로운 비디오 압축 표준화를 위한 기술 탐색을 진행하고 있으며 이를 위한 탐색모델 소프트웨어로 ECM(Enhanced Compression Model)을 개발하고 있다. 현재 ECM에는 새로운 화면내 예측 부호화 기술의 하나로 TIMD (Template-based Intra Mode Derivation)가 채택되어 있다. TIMD는 현재블록 주변의 복원된 샘플들로 구성된 템플릿(template)과 MPM(Most Probable Mode) 리스트를 사용하여 화면내 예측 모드를 유도하는 기술이다. 본 논문은 TIMD의 예측 모드 결정을 위한 비용함수인 SATD(Sum of Absolute Transformed Difference) 계산에서 현재블록과 가까운 템플릿에 많은 가중치를 적용하여 보다 적절한 예측 모드를 유도하는 방법을 제안한다. 실험결과 ECM-10.0 대비 휘도성분에서 0.03% BD-rate 이득을 확인하였다. JVET is currently exploring potential technologies for a new video coding standardization after completion of the VVCstandardization, and is developing Enhanced Compression Model (ECM) as an exploration model software for this purpose. Currently, ECM incorporates a new technology called Template-based Intra Mode Derivation (TIMD) to enhance the intraprediction. TIMD utilizes a template consisting of reconstructed samples of the neighboring blocks and the Most Probable Mode(MPM) list to derive the intra prediction mode for the current block. This paper proposes a method of deriving a more appropriateprediction modes through line-wise weighting, applying greater weights to template lines close to the current block in the costfunction of TIMD mode prediction, Sum of Absolute Transformed Difference (SATD). Experimental results show that the proposedmethod gives a 0.03% BD-rate gain in luminance compared to ECM-10.0.

Improved optical performance of multi-layer MoS2 phototransistor with see-through metal electrode

전상훈,박성호,Jihyun Hur,Minho Ahn,Dipjyoti Das,Junghak Park 나노기술연구협의회 2019 Nano Convergence Vol.6 No.32

In recent years, MoS2 has emerged as a prime material for photodetector as well as phototransistor applications. Usually, the higher density of state and relatively narrow bandgap of multi-layer MoS2 give it an edge over monolayer MoS2 for phototransistor applications. However, MoS2 demonstrates thickness-dependent energy bandgap properties, with multi-layer MoS2 having indirect bandgap characteristics and therefore possess inferior optical properties. Herein, we investigate the electrical as well as optical properties of single-layer and multi-layer MoS2-based phototransistors and demonstrate improved optical properties of multi-layer MoS2 phototransistor through the use of see-through metal electrode instead of the traditional global bottom gate or patterned local bottom gate structures. The see-through metal electrode utilized in this study shows transmittance of more than 70% under 532 nm visible light, thereby allowing the incident light to reach the entire active area below the source and drain electrodes. The effect of contact electrodes on the MoS2 phototransistors was investigated further by comparing the proposed electrode with conventional opaque electrodes and transparent IZO electrodes. A position-dependent photocurrent measurement was also carried out by locally illuminating the MoS2 channel at different positions in order to gain better insight into the behavior of the photocurrent mechanism of the multi-layer MoS2 phototransistor with the transparent metal. It was observed that more electrons are injected from the source when the beam is placed on the source side due to the reduced barrier height, giving rise to a significant enhancement of the photocurrent.

F-46 Combined Airway Disease and Emphysema is a Poor Prognostic Factor in Chronic Obstructive Pulmonary Disease

전상훈,이재하,윤형규,오연목,이상도,이진국 대한결핵 및 호흡기학회 2016 대한결핵 및 호흡기학회 추계학술대회 초록집 Vol.121 No.-

COPD is a complex and heterogeneous disease. To develop treatment strategies, the traditional approach of dividing patients into airway dominant or emphysematous types has been challenged. This study was designed to evaluate risk of exacerbation according to airway and emphysema index in CT scan. We analyzed Korea Obstructive Lung Disease (KOLD) cohort patients (n = 354). By using CT data, mean wall area percentage (MWA%) and emphysema index (EI) were calculated. Patients were classified into four groups according to these data. Exacerbation was analyzed by longitudinal follow up data. The number of patients with low MWA% & low EI [A(-)E(-)] were 71, high MWA% & low EI [A(+)E(-)] were 78, low MWA% & high EI [A(-)E(+)] were 76, and high MWA% & high EI [A(+)E(+)] were 62. Mean follow up period of enrolled patients were 2,178 ± 56.02 days. Mean number of exacerbation per year differed significantly between four groups [A(-)E(-): 0.33 ± 0.05, A(+)E(-): 0.31 ± 0.04, A(-)E(+): 0.56 ± 0.06, and A(+)E(+): 0.52 ± 0.07, respectively, P < 0.01]. Mean number of severe exacerbation per year also differed significantly between four groups [A(-)E(-): 0.04 ± 0.01, A(+)E(-): 0.04 ± 0.02, A(-)E(+): 0.19 ± 0.04, and A(-)E(+): 0.25 ± 0.05, respectively, P < 0.01]. Time to first exacerbation was significantly different between four groups (P = 0.036 by Log Rank Test). COPD can be divided into four phenotypes according to MWA% & EI. Mean number of exacerbations were significantly differ between four groups. Combined airway disease and emphysema phenotype has high risk for exacerbation.

심폐관류에 따른 혈청칼슘의 변동

전상훈 대한흉부심장혈관외과학회 1988 Journal of Chest Surgery (J Chest Surg) Vol.21 No.2

This study was prospectively planned to realize the reduction of calcium ion in serum along with the cardiopulmonary bypass[CPB], to find out the cause of the reduction, and to verify the justification of the classical methods of calcium replacement. Nine patients with various open heart surgeries by CPB in 1987 wee selected at random. Calcium chloride was added as follows:: For each unit of ACD blood transfusion, 600mg of calcium chloride was added. In case of massive transfusion, 600 mg of calcium chloride was injected every 2 or 3 units of transfusion. On occasions such as weaning from CPB, or following defibrillation, or hypotension, weak myocardial contractility of the heart, calcium chloride was needed in an amount of 10 mg / kg. In ICU, calcium chloride was limited to use in low serum level or in emergency use. Total calcium decreased early bypass and progressively increased above the preoperative value during late bypass and three hours thereafter, Ionized calcium increased during late bypass and three hours following. Total and ionized calcium depicted similar patterns of change during open heart surgery. Decrease of the calcium at the early bypass was thought from reduction of total protein and alkalosis during bypass. Meanwhile, increase of both calciums during the end of surgery was presumably attributable to addition of calcium chloride in priming solution, injections of calcium chloride in the process of termination of bypass. We conclude that enough calcium was replaced by the classical methods of calcium supplement.