Summer Hangouts: Luis Morales-Navarro
Training very small language models on device
RDDSX space outside the Collaborative Classroom
Van Pelt-Dietrich Library, First Floor map
You can also join via Zoom — Join us on Zoom!
In this workshop we will explore different ways to train and run small language models on personal computers using GPUs. We will follow a step-by-step tutorial to train models using the nanoGPT/nanochat frameworks. Then we will use an adaptation of the framework to train and visualize the training process on the browser and explore some of the capabilities of transformers.js (a library that supports running models in the browser using WebGPU).
Training on-device works best with a GPU with CUDA support or an Apple Silicon chip (you should be able to run things on any CPU, but it will be slow). You can still participate even if you don't have an accessible GPU, as some of the activities will be on the browser.
Learn More About Luis Morales-Navarro, Penn AI Fellow
DDDI’s 2026 Summer Hangouts program offers students the opportunity to participate in informal, hands-on tutorials led by Penn AI fellows. These tutorials are open to students from all backgrounds and skill levels and cover various data science methods and topics.
Our Hangouts series this year explores machine learning, clinical AI, language models, and causal inference across disciplines. Hangouts will be held from June 9th through June 23rd. A pizza lunch will be provided.