Monthly HPC Café: Large Language Models for Dummies (March 11, hybrid)
The next HPC Café will take place on March 11 at 4:00 p.m. as a hybrid event. As always, there will be plenty of time to get in touch with your favorite HPC group. We invite you to come to NHR@FAU to enjoy coffee, cake, and computing.
The event starts at 4:00 p.m. with an open coffee chat, and at 4:30 p.m., we will start the presentation – Meeting this time in room 02.037 (E-Studio).
Topic: Large Language Models for Dummies
Speaker: Sebastian Wind, NHR@FAU
Abstract:
Large Language Models (LLMs) are revolutionizing the way we interact with artificial intelligence, and the open-source community plays a pivotal role in driving their accessibility and innovation. This talk delves into the inner workings of LLMs, exploring their foundational mechanisms and architectures. Additionally, we examine how these models can be efficiently trained on high-performance computing (HPC) systems, leveraging state-of-the-art scaling strategies and principles derived from scaling laws. By understanding these methodologies, attendees will gain valuable insights into the challenges and opportunities of developing and deploying LLMs in diverse computational environments.
Material from past events is available at: https://hpc.fau.de/teaching/hpc-cafe/