클라우드 분산 파일 시스템 성능 개선 및 평가 = Performance Enhancement and Evaluation of Distributed File System for Cloud

다국어 초록 (Multilingual Abstract)

The choice of a suitable distributed file system is required for loading large data and high-speed processing through subsequent applications in a cloud environment. In this paper, we propose a write performance improvement method based on GlusterFS and evaluate the performance of MapRFS, CephFS and GlusterFS among existing distributed file systems in cloud environment. The write performance improvement method proposed in this paper enhances the response time by changing the synchronization level used by the synchronous replication method from disk to memory. Experimental results show that the distributed file system to which the proposed method is applied is superior to other distributed file systems in the case of sequential write, random write and random read.

국문 초록 (Abstract)

클라우드 환경에서 빅데이터 적재와 이후 애플리케이션을 통한 고속 처리를 위해서는 적합한 분산 파일 시스템의 선택이 요구된다. 본 논문에서는 GlusterFS 기반 쓰기 성능 향상 방법을 제안하고 클라우드 환경에서 기존 분산 파일 시스템 중 MapRFS, CephFS, GlusterFS와 성능을 비교 평가한다. 본 논문에서 제안한 쓰기 성능 향상 방법은 동기식 스토리지 복제 방식에서 사용하는 동기화 수준을 디스크에서 메모리로 변경함으로써 응답 시간을 향상 시킨다. 실험 결과는 본 논문의 제안 방법이 적용된 분산 파일 시스템이 순차 쓰기의 경우와 랜덤 쓰기와 랜덤 읽기가 혼합된 경우에서 다른 분산 파일 시스템 대비 성능이 우수함을 보인다.

참고문헌 (Reference)

1 K. Shvachko, "The hadoop distributed file system" 2010

2 M. A. Beyer, "The Importance of ‘Big Data’: A Definition"

3 S. Ghemawat, "The Google File System" 37 (37): 29-43, 2003

4 G. Donvito, "Testing of several distributed file-systems (HDFS, Ceph and GlusterFS) for supporting the HEP experiments analysis" 513 (513): 2014

5 "SysBench"

6 Z. Ren, "Realistic and scalable benchmarking cloud file systems: Practices and lessons from AliCloud" 28 (28): 3272-3285, 2017

7 L. M. Roch, "Performance analysis of open‐source distributed file systems for practical large‐scale molecular ab initio, density functional theory, and GW+ BSE calculations" 118 : 1-, 2018

8 "NFS-Ganesha"

9 Y. Wu, "Modeling of distributed file systems for practical performance analysis" 25 (25): 156-166, 2014

10 "MapRFS"

11 "GlusterFS"

12 "FIO"

13 D. Gudu, "Evaluating the performance and scalability of the ceph distributed storage system" 2014

14 M. Ferdman, "Clearing the clouds: a study of emerging scale-out workloads on modern hardware" 47 (47): 37-48, 2012

15 S. A. Weil, "Ceph: A scalable, high-performance distributed file system" 307-320, 2006

16 M. Shamma, "Capo: Recapitulating Storage for Virtual Desktops" 31-45, 2011

17 A. Ghazal, "BigBench V2: The New and Improved BigBench" 1225-1236, 2017

18 Cooper, "Benchmarking cloud serving systems with YCSB" ACM 143-154, 2010

19 T. Harter, "Analysis of HDFS under HBase : a facebook messages case study" 199-212, 2014

20 Y. Gong, "A Distributed File System with Variable Sized Objects for Enhanced Random Writes" 59 (59): 1536-1550, 2016