Skip to Main content Skip to Navigation
Master Thesis

On the benefit of dedicating cores to mask I/O jitter in HPC simulations

Abstract : With exascale computing on the horizon, the performance variability of I/O systems presents a key challenge in sustaining high performance. In many HPC applications, I/O is performed concurrently by all processes; this produces I/O bursts, which causes resource contention and substantial variability of I/O performance, significantly impacting the overall application performance. We here utilize the IOR benchmark to explore the influence of user-configurable parameters of the I/O stack on performance variability. We then propose a new approach, called Damaris, leveraging dedicated I/O cores on each multicore SMP node to efficiently perform asynchronous data processing and I/O. We evaluate our approach on two different platforms with the CM1 atmospheric model, one of the BlueWaters HPC applications. By gathering data into large files while avoiding synchronization between cores, our solution increases the I/O throughput by a factor of 6, hides all I/O-related costs, and enables a 600% compression ratio without any additional overhead.
Complete list of metadata

Cited literature [34 references]  Display  Hide  Download

https://dumas.ccsd.cnrs.fr/dumas-00636162
Contributor : Co-Responsables Du Mri V. Gouranton Et S. Blazy <>
Submitted on : Wednesday, October 26, 2011 - 10:11:30 PM
Last modification on : Monday, February 15, 2021 - 10:37:44 AM
Long-term archiving on: : Friday, January 27, 2012 - 2:36:22 AM

Identifiers

  • HAL Id : dumas-00636162, version 1

Citation

Matthieu Dorier. On the benefit of dedicating cores to mask I/O jitter in HPC simulations. Performance [cs.PF]. 2011. ⟨dumas-00636162⟩

Share

Metrics

Record views

385

Files downloads

506