HDF5 (Hierarchical Data Format)

Elena Pourmal, Director
The HDF Group
2:30 pm Sept 17 in Room 2890

Abstract:


Among the company's customers are government agencies such as NASA, NOAA, and DOE, academia, and many commercial companies such as financial, gas and oil, airspace and financial industries to name a few. The HDF Group also works with many international institutions including the Light Source Centers and Met Office in Europe.

HDF5 (Hierarchical Data Format) is a data model, I/O library, and file format for storing, managing and exchanging data. It supports variety of data types, and is designed for flexible and efficient HPC I/O of high volume and complex data. HDF5 is portable and is extensible, allowing applications to evolve in their use.

The HDF5 Technology suite includes tools and applications for managing, manipulating, viewing, and analyzing data in the HDF5 format.

In this presentation speaker will introduce The HDF Group (http://www.hdfgroup.org), located located in Champaign Illinois at the University of Illinois Research Park. The HDF Group - a non-for-profit organization with the mission to sustain current HDF technologies and to provide continual accessibility to data stored in HDF.

Elena will discuss the most powerful HDF5 features: portability, unlimited file sizes, flexible I/O including parallel I/O, and internal compression mechanism, that provide solutions for many computational and data problems. Several community standards such as HDF-EOS, netCDF-4, CGNS are built on top of the HDF5 library and underlying file format, making those standards very attractive to all kind of applications.


[References]
Presentation at The 13 th HDF and HDF - EOS Workshop
Chunking
Datatype
What will be new in HDF5