23–28 Jun 2014
Columbia University
US/Eastern timezone

High-Performance I/O: HDF5 for Lattice QCD

24 Jun 2014, 18:10
2h
Low library

Low library

Board: 52
Poster Algorithms and Machines Poster session

Speaker

andre walker-loud (W&M)

Description

Practitioners of lattice quantum chromodynamics (LQCD) have been some of the primary pioneer users of the state-of-the-art HPC systems, and contribute towards the stress tests of such new machines as soon as they become available. As with all aspects of HPC, I/O is becoming an increasingly specialized component of these systems. In order to take advantage of the latest available high-performance I/O infrastructure, to ensure reliability and backwards compatibility of data files, and to help unify the data structures used in LQCD codes, we have incorporated parallel HDF5 I/O into the SciDAC supported USQCD software stack. Here we present the design and implementation of this I/O framework. The “out-of-the-box” HDF5 implementation outperforms optimized QIO at the 10-20% level, with room for significant improvement with dataset chunking.

Primary authors

Abhinav Sarje Dr Andrew Pochinsky (Massachusetts Institute of Technology) Dr Sergey Syritsyn (RIKEN-BNL Research Center) Thorsten Kurth andre walker-loud (W&M)

Presentation materials

There are no materials yet.