NHR PerfLab Seminar: On-demand file systems: production use, use cases and lessons learned
Speaker: Dr. Mehmet Soysal (Karlsruhe Institute of technology)
Title: On-demand file systems: production use, use cases and lessons learned
Date and time: Tuesday, November 2, 2 p.m. – 3 p.m.
Abstract:
On many HPC systems, the parallel file system is becoming a primary bottleneck and there are several approaches to address this problem. A recent and increasingly popular method to overcome this bottleneck is the use of on-demand file systems. With this seminar talk we would like to give insight into production usage of on-demand file systems on our HPC systems. At SCC, we started evaluating on-demand file systems during the DFG Project “ADA-FS” and offer such a file system as a feature for our HPC users since 2017. Over the years we could gain some experience, which we would like to present here.
Short Bio:
Dr. Mehmet Soysal is a postdoc at the Steinbuch Centre for Computing (SCC) at Karlsruhe Institute of Technology (KIT). His research interests include HPC scheduling, file systems, data management and systems software. He completed his PhD in December 2020 with a thesis entitled “Exploring Scheduling for On-demand File Systems and Data Management within HPC Environments.”