Distributed storage system also known as cloud storage solution was created to provide scalability and reliability to store large and complex amount of bigdata. In addition to the functionality of distributed storage system, QoS (Quality of Service) e...
Distributed storage system also known as cloud storage solution was created to provide scalability and reliability to store large and complex amount of bigdata. In addition to the functionality of distributed storage system, QoS (Quality of Service) especially to support different type of clients ranging from urgent time-critical to best-effort is one of criteria to gain more popularity and become a vital component in a distributed storage system.
We proposes a new resource management scheme that supports SLA (Service Level
Agreement) in a bigdata distributed storage system. Basically, it makes use of two modes,isolated mode and shared mode, in an adaptive manner. In specific, to ensure different QoS requirements among clients, it isolates storage devices into two regions, one for urgent clients and the other for normal clients. When there is no urgent client, it switches to the shared mode so that normal clients can access all storage devices, thus achieving full performance. To provide this adaptive mapping effectively, we devise two techniques, called logical cluster and normal inclusion.
In addition, we explore how to exploit heterogeneous storage devices, HDDs and SSDs, for supporting SLA. We observe that separating data and metadata into different devices gives a positive impact on the performance per price ratio. Real implementation-based evaluation results show that our proposal can prevent urgent clients from being interfered by normal clients while outperforms a fixed mapping based scheme.