Hadoop system was developed based on GFS and mapreduce technologies of Goolgle Inc., which was considered as the standard platform for processing the big data recently. A lot of modern systems with big data was designed to be based on Hadoop, which a...
Hadoop system was developed based on GFS and mapreduce technologies of Goolgle Inc., which was considered as the standard platform for processing the big data recently. A lot of modern systems with big data was designed to be based on Hadoop, which also have been adopted the R software as the analytic tool, because the R is flexible to other softwares and has many libraries for complex analysis.
In this thesis, we first introduced the R package, RHIPE for analysing the big data under the Hadoop system. We implemented the mapreduce program using R for multiple regression especially. In addition, we compared the computing speeds of our program with the other packages (ff and bigmemory) for processing the large data. The simulation results showed that our program was more fast than ff and bigmemory as the size of data are increased.