Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Master Thesis

Optimizing data storage for MapReduce applications in the Azure Clouds

Abstract : In this report, we address the problem of data management in clouds for the MapReduce programing model. In order to improve the performance of data-intensive applications, we designed a distributed file system deployed on the computation nodes of public clouds. This approach exploits the data locality principle by moving the data close to the computation. The read performance increases up to 2 times and the write performance increases up to 5 times, compared to the traditional remote storage techniques used in public clouds. Encouraged by these results, we developed a customized MapReduce platform, relying on our distributed file system, and optimized it for data-intensive applications. We illustrate the benefits of our approach using a joint genetics and neuroimaging application for studying the variability between individuals, based on univariate data analysis. By adjusting the design of our MapReduce platform to meet the requirements of this application, we were able to reduce its computation time by up to 4 times.
Complete list of metadata

Cited literature [19 references]  Display  Hide  Download
Contributor : Co-Responsables Du Mri V. Gouranton Et S. Blazy Connect in order to contact the contributor
Submitted on : Friday, October 28, 2011 - 12:59:23 PM
Last modification on : Monday, February 15, 2021 - 10:37:50 AM
Long-term archiving on: : Thursday, November 15, 2012 - 10:47:02 AM


  • HAL Id : dumas-00636818, version 1


Radu Tudoran. Optimizing data storage for MapReduce applications in the Azure Clouds. Performance [cs.PF]. 2011. ⟨dumas-00636818⟩



Record views


Files downloads