An overview of the HDF5 technology suite and its applications

By M. Folk, Gerd Heber, Q. Koziol, Elena Pourmal, Dana Robinson. AD '11, 2011

555 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Cooler: scalable storage for Hi-C data and other genomically-labeled arrays (2019, methodology): “Popular binary formats such as the current versions of MATLAB’s mat ﬁles and Unidata’s NetCDF4 are built as abstractions on top of HDF5 (28) and it has been used to store petabytes of mission critical data, such as NASA’s Earth Observation System, for decades (29).”
UNITY: Unified Memory and File Space (2017, background): “HDF5 [14] is a library that provides a rich data model for describing scientific data.”
Big Neural Networks Waste Capacity (2013, methodology): “We make use of HDF5 (Folk et al. , 2011) to load the dataset in a lazy fashion because of its large size.”
Labkit: Labeling and Segmentation Toolkit for Big Image Data (2021, methodology): “One such format is HDF5 (Folk et al., 2011), and LABKIT uses in particular the BigDataViewer HDF5+XML variant.”
PDEBENCH: An Extensive Benchmark for Scientific Machine Learning (2022, methodology): “The benchmark consists of different data ﬁles, one for each equation, type of initial condition, and PDE parameter, using the HDF5 [15] binary data format.”