A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses

Chunhua Zheng,Wei Li,Wei-Min Liu,Kun Xu,Lei Peng,차석원 한국정밀공학회 2022 International Journal of Precision Engineering and Vol.9 No.3

An energy management strategy (EMS) plays an important role for hybrid vehicles, as it is directly related to the power distribution between power sources and further the energy saving of the vehicles. Currently, rule-based EMSs and optimizationbased EMSs are faced with the challenge when considering the optimality and the real-time performance of the control at the same time. Along with the rapid development of the artificial intelligence, learning-based EMSs have gained more and more attention recently, which are able to overcome the above challenge. A deep reinforcement learning (DRL)-based EMS is proposed for fuel cell hybrid buses (FCHBs) in this research, in which the fuel cell durability is considered and evaluated based on a fuel cell degradation model. The action space of the DRL algorithm is limited according to the efficiency characteristic of the fuel cell in order to improve the fuel economy and the Prioritized Experience Replay (PER) is adopted for improving the convergence performance of the DRL algorithm. Simulation results of the proposed DRL-based EMS for an FCHB are compared to those of a dynamic programming (DP)-based EMS and a reinforcement learning (RL)-based EMS. Comparison results show that the fuel economy of the proposed DRL-based EMS is improved by an average of 3.63% compared to the RL-based EMS, while the difference to the DP-based EMS is within an average of 5.69%. In addition, the fuel cell degradation rate is decreased by an average of 63.49% using the proposed DRL-based EMS compared to the one without considering the fuel cell durability. Furthermore, the convergence rate of the proposed DRL-based EMS is improved by an average of 30.54% compared to the one without using the PER. Finally, the adaptability of the proposed DRL-based EMS is validated on a new driving cycle, whereas the training of the DRL algorithm is completed on the other three driving cycles.

A Speedy Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Vehicles Considering Fuel Cell System Lifetime

Wei Li,Jiaye Ye,Yunduan Cui,김남욱,차석원,Chunhua Zheng 한국정밀공학회 2022 International Journal of Precision Engineering and Vol.9 No.3

A speedy reinforcement learning (RL)-based energy management strategy (EMS) is proposed for fuel cell hybrid vehicles (FCHVs) in this research, which approaches near-optimal results with a fast convergence rate based on a pre-initialization framework and meanwhile possesses the ability to extend the fuel cell system (FCS) lifetime. In the pre-initialization framework, well-designed power distribution-related rules are used to pre-initialize the Q-table of the RL algorithm to expedite its optimization process. Driving cycles are modeled as Markov processes and the FCS power difference between adjacent moments is used to evaluate the impact on the FCS lifetime in this research. The proposed RL-based EMS is trained on three driving cycles and validated on another driving cycle. Simulation results demonstrate that the average fuel consumption difference between the proposed EMS and the EMS based on dynamic programming is 5.59% on the training driving cycles and the validation driving cycle. Additionally, the power fluctuation on the FCS is reduced by at least 13% using the proposed EMS compared to the conventional RL-based EMS which does not consider the FCS lifetime. This is significantly beneficial for improving the FCS lifetime. Furthermore, compared to the conventional RL-based EMS, the convergence speed of the proposed EMS is increased by 69% with the pre-initialization framework, which presents the potential for realtime applications.

Beneficial effects of naringenin and morin on interleukin-5 and reactive oxygen species production in BALB/c mice with ovalbumin-induced asthma

Peng Qi,Chunhua Wei,Dianbo Kou 대한생리학회-대한약리학회 2021 The Korean Journal of Physiology & Pharmacology Vol.25 No.6

We investigated the effects of naringenin and morin on IL-5 and ROS production in PMA+ionomycin-treated EL-4 cells with the corroboration of their antioxidant and anti-inflammatory properties using an asthma-induced mouse model. The EL-4 cell line was used to study the outcomes of naringenin or morin, followed by cell viability studies. Western blot analysis and ELISA test were used to determine Th2 mediated cytokines. In vivo studies were carried out on BALB/c mice to induce allergic asthma using ovalbumin administered intraperitoneally. Intracellular ROS was determined using 2’,7’-dichlorodihydrofluorescein diacetate, followed by serum enzymatic (AST and ALT) estimations and inflammatory cell count in the bronchoalveolar lavage fluid (BALF) and lung tissues. Histopathological studies were conducted to examine lung tissue-stained architecture. Our findings suggested that naringenin and morin significantly suppressed IL-5 and ROS production via various pathways. Interestingly, by reducing NFAT activity, naringenin and morin stimulated HO-1 expression, thereby suppressing IL-5 secretion due to regulating the transcription factor Nrf2 via P13/Akt or ERK/JNK signalling pathways in EL-4 cells, demonstrating the involvement of HO-1 expression in inhibiting asthmatic inflammation. The increased inflammatory cells in the BALF were substantially decreased by both naringenin and morin, followed by inhibition in the elevated Th-2 cytokines levels. The TNF-α protein levels in an allergic asthma mouse model were significantly reduced by suppressing Akt phosphorylation and eosinophil formation. Recent findings confirmed that naringenin and morin possess the potential to control asthma-related immune responses through antioxidant and anti-inflammatory properties, indicating potential therapeutic agents or functional foods

Antioxidant Constituents from the Leaves ofCedrela sinensis A. Juss

Ik Soo Lee,Chunhua Wei,Phuong Thien Thuong,Kyung Sik Song,Yeon Hee Seong,배기환 한국약용작물학회 2006 한국약용작물학회지 Vol.14 No.5

Phytochemical study on the EtOAc fraction from the MeOH extract of the leaves of Cedrela sinensis led to the isolation of five known phenolic compounds (1-5), whose structures were identified as (+)-catechin (1), kaempferol-3-O-α-Lrhamnopyranoside (2), quercetin (3), quercetin-3-O-α-L-rhamnopyranoside (4), and quercetin-3-O-β-D-glucopyranoside (5), respectively, by comparing their spectral (UV, IR, 1H and 13C-NMR, and ESI-MS) and physicochemical data with those reported in the literature. Among the isolated compounds (1-5), compounds 1 and 3-5 exhibited significant DPPH radical scavenging effects with IC50 values ranging from 21.3 ± 1.4 to 38.1 ± 3.2 μM as well as superoxide anion radical scavenging effects with IC50 values ranging from 9.4 ± 0.7 to 21.2 ± 3.6 μM. Furthermore, compounds 1 and 3-5 also exhibited considerable inhibitory effects on LDL peroxidation induced by either Cu2+ or AAPH with IC50 values ranging from 1.4 ± 0.4 to 11.9 ± 1.4 μM. These results indicated that flavonoids are the major constituents of C. sinensis and considered to be antioxidant principles of this plant.

A Single-Arm Phase II Study of Nab-Paclitaxel Plus Gemcitabine and Cisplatin for Locally Advanced or Metastatic Biliary Tract Cancer

Ting Liu,Qing Li,Zhen Lin,Chunhua Liu,Wei Pu,Shasha Zeng,Jun Lai,Xuebin Cai,Lisha Zhang,Shuyang Wang,Miao Chen,Wei Cao,Hongfeng Gou,Qing Zhu 대한암학회 2024 Cancer Research and Treatment Vol.56 No.2

Purpose Patients with advanced biliary tract cancer (BTC) have a poor survival. We aim to evaluate the efficacy and safety of nab-paclitaxel plus gemcitabine and cisplatin regimen in Chinese advanced BTC patients.Materials and Methods Eligible patients with locally advanced or metastatic BTC administrated intravenous 100 mg/m² nab-paclitaxel, 800 mg/m² gemcitabine, and 25 mg/m² cisplatin every 3 weeks. The primary endpoint was progression-free survival (PFS). The secondary endpoints included overall survival (OS) and adverse events, while exploratory endpoint was the association of biomarkers with efficacy.Results After the median follow-up of 25.0 months, the median PFS and OS of 34 enrolled patients were 7.1 months (95% confidence interval [CI], 5.4 to 13.7) and 16.4 months (95% CI, 10.9 to 23.6), respectively. The most common treatment-related adverse events at ≥ 3 grade were neutropenia (26.5%) and leukopenia (26.5%). Survival analyses demonstrated that carcinoembryonic antigen (CEA) levels could monitor patients’ survival outcomes. A significant increase in the number of infiltrating CD4+ cells (p=0.008) and a decrease in programmed death-1–positive (PD-1+) cells (p=0.032) were observed in the response patients.Conclusion In advanced BTC patients, nab-paclitaxel plus gemcitabine and cisplatin regimen showed therapeutic potential. Potential prognostic factors of CEA levels, number of CD4+ cells and PD-1+ cells may help us maximize the efficacy benefit.

Self-Gated Late Gadolinium Enhancement at 7T to Image Rats with Reperfused Acute Myocardial Infarction

Lei Wang,Yushu Chen,Bing Zhang,Wei Chen,Chunhua Wang,Li Song,Ziqian Xu,Jie Zheng,Fabao Gao 대한영상의학회 2018 Korean Journal of Radiology Vol.19 No.2

Objective: A failed electrocardiography (ECG)-trigger often leads to a long acquisition time (TA) and deterioration in image quality. The purpose of this study was to evaluate and optimize the technique of self-gated (SG) cardiovascular magnetic resonance (CMR) for cardiac late gadolinium enhancement (LGE) imaging of rats with myocardial infarction/reperfusion. Materials and Methods: Cardiovascular magnetic resonance images of 10 rats were obtained using SG-LGE or ECG with respiration double-gating (ECG-RESP-gating) method at 7T to compare differences in image interference and TA between the two methods. A variety of flip angles (FA: 10°−80°) and the number of repetitions (NR: 40, 80, 150, and 300) were investigated to determine optimal scan parameters of SG-LGE technique based on image quality score and contrast-to-noise ratio (CNR). Results: Self-gated late gadolinium enhancement allowed successful scan in 10 (100%) rats. However, only 4 (40%) rats were successfully scanned with the ECG-RESP-gating method. TAs with SG-LGE varied depending on NR used (TA: 41, 82, 154, and 307 seconds, corresponding to NR of 40, 80, 150, and 300, respectively). For the ECG-RESP-gating method, the average TA was 220 seconds. For SG-LGE images, CNR (42.5 ± 5.5, 43.5 ± 7.5, 54 ± 9, 59.5 ± 8.5, 56 ± 13, 54 ± 8, and 41 ± 9) and image quality score (1.85 ± 0.75, 2.20 ± 0.83, 2.85 ± 0.37, 3.85 ± 0.52, 2.8 ± 0.51, 2.45 ± 0.76, and 1.95 ± 0.60) were achieved with different FAs (10°, 15°, 20°, 25°, 30°, 35°, and 40°, respectively). Optimal FAs of 20°−30° and NR of 80 were recommended. Conclusion: Self-gated technique can improve image quality of LGE without irregular ECG or respiration gating. Therefore, SG-LGE can be used an alternative method of ECG-RESP-gating.

New Analysis of Reduced-Version of Piccolo in the Single-Key Scenario

( Ya Liu ),( Liang Cheng ),( Fengyu Zhao ),( Chunhua Su ),( Zhiqiang Liu ),( Wei Li ),( Dawu Gu ) 한국인터넷정보학회 2019 KSII Transactions on Internet and Information Syst Vol.13 No.9

The lightweight block cipher Piccolo adopts Generalized Feistel Network structure with 64 bits of block size. Its key supports 80 bits or 128 bits, expressed by Piccolo-80 or Piccolo-128, respectively. In this paper, we exploit the security of reduced version of Piccolo from the first round with the pre-whitening layer, which shows the vulnerability of original Piccolo. As a matter of fact, we first study some linear relations among the round subkeys and the properties of linear layer. Based on them, we evaluate the security of Piccolo-80/128 against the meet-in-the-middle attack. Finally, we attack 13 rounds of Piccolo-80 by applying a 5-round distinguisher, which requires 2⁴⁴ chosen plaintexts, 2^67.39 encryptions and 2^64.91 blocks, respectively. Moreover, we also attack 17 rounds of Piccolo-128 by using a 7-round distinguisher, which requires 2⁴⁴ chosen plaintexts, 2¹²⁶ encryptions and 2^125.49 blocks, respectively. Compared with the previous cryptanalytic results, our results are the currently best ones if considering Piccolo from the first round with the pre-whitening layer.

Blood-Brain Barrier Disruption and Perivascular Beta-Amyloid Accumulation in the Brain of Aged Rats with Spontaneous Hypertension: Evaluation with Dynamic Contrast-Enhanced Magnetic Resonance Imaging

Yu Wang,Ruzhi Zhang,Chuanyuan Tao,Ziqian Xu,Wei Chen,Chunhua Wang,Li Song,Jie Zheng,Fabao Gao 대한영상의학회 2018 Korean Journal of Radiology Vol.19 No.3

Objective: Whether blood-brain barrier (BBB) disruption induced by chronic spontaneous hypertension is associated with beta-amyloid (Aβ) accumulation in the brain remains poorly understood. The purpose of this study was to investigate the relationship between BBB disruption and Aβ influx and accumulation in the brain of aged rats with chronic spontaneous hypertension. Materials and Methods: Five aged spontaneously hypertensive rats (SHRs) and five age-matched normotensive Wistar-Kyoto (WKY) rats were studied. The volume transfer constant (Ktrans) obtained from dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) was used to evaluate BBB permeability in the hippocampus and cortex in vivo. The BBB tight junctions, immunoglobulin G (IgG), Aβ, and amyloid precursor protein (APP) in the hippocampus and cortex were examined with immunohistochemistry. Results: As compared with WKY rats, the Ktrans values in the hippocampus and cortex of the SHRs increased remarkably (0.316 ± 0.027 min-1 vs. 0.084 ± 0.017 min-1, p < 0.001 for hippocampus; 0.302 ± 0.072 min-1 vs. 0.052 ± 0.047 min-1, p < 0.001 for cortex). Dramatic occludin and zonula occludens-1 losses were detected in the hippocampus and cortex of SHRs, and obvious IgG exudation was found there. Dramatic Aβ accumulation was found and limited to the area surrounding the BBB, without extension to other parenchyma regions in the hippocampus and cortex of aged SHRs. Alternatively, differences in APP expression in the hippocampus and cortex were not significant. Conclusion: Blood-brain barrier disruption is associated with Aβ influx and accumulation in the brain of aged rats with chronic spontaneous hypertension. DCE-MRI can be used as an effective method to investigated BBB damage.