Monthly HPC Café: Efficient data handling and data formats (February 6, hybrid event)

Symbolic picture for the article. The link opens the image in a large view.

The next HPC Café takes place on Tuesday, February 6, 2024, at 4:00 p.m. as a hybrid event. As always, there will be plenty of time to get in touch with your favorite HPC group. We invite you to come to RRZE to have coffee and cake, just like old times.

The event will start with the open coffee chat and Q&A, at 4:00 p.m. At 4:30 p.m., the presentation will begin.

Topic:  Efficient data handling and data formats

Speakers: Markus Wittmann, NHR@FAU and Hadrian Reynaud, AIBE

Slides: Part 1, Part 2

 

Abstract:

This HPC Cafe provides a brief overview over our storage infrastructure, available data formats for storing ML/AI datasets, and how to use them efficiently on our systems.  Furthermore Hadrian Reynaud (AIBE) will present his experiences with WebDataset.

Material from past events is available at: https://hpc.fau.de/teaching/hpc-cafe/