---
title: "GPU MODE's Free 100-Episode Series Closes the Gap Between PyTorch and Real Hardware"
subtitle: "GPU MODE's open lecture series and GitHub repo bring real-world GPU kernel expertise to anyone willing to learn, for free"
url: "https://alphasignal.ai/news/gpu-mode-s-free-100-episode-series-closes-the-gap-between-pytorch-and-real"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-06-15T04:57:16.000Z"
updated: "2026-06-24T13:17:12.963Z"
type: "Repo"
topics:
  - "Gpus"
  - "Training Infra"
subtopics:
  - "Quantization"
upvotes: 75
source_url: "https://github.com/gpu-mode/lectures"
comments: 0
truncated: true
---

# GPU MODE's Free 100-Episode Series Closes the Gap Between PyTorch and Real Hardware

> GPU MODE's open lecture series and GitHub repo bring real-world GPU kernel expertise to anyone willing to learn, for free

There's a gap between knowing PyTorch and knowing what PyTorch is actually doing on the hardware. Most ML practitioners live comfortably on the Python side of that gap. [GPU MODE](https://github.com/gpu-mode/lectures) is a community-run initiative that wants to close it, and their free lecture series, now past 100 episodes, has become one of the most comprehensive open resources for GPU programming in the ML ecosystem.

## From reading group to 28,000-member community

GPU MODE is a GPU reading group and community created by Mark Saroufim and Andreas Köpf. What started as a structured read-through of the classic textbook _Programming Massively Parallel Processors_ (PMPP) has grown into something much larger. The GPU MODE Discord now has over 28,000 members, and the community-driven lecture series spans topics from profiling to kernels to CUTLASS to SASS (SASS is the low-level assembly that runs natively on NVIDIA GPUs).

Recordings of the weekly lectures are published on the YouTube channel, and material including code and slides for individual lectures can be found in the lectures repository. The GitHub repo itself has crossed 6,200 stars with over 620 forks, a signal that people aren't just watching but actually working through the material.

## What's actually in the curriculum

The lecture list reads like a tour of the entire GPU software stack. Early lectures ease you in with PyTorch integration and PMPP chapters. Then the series goes deep fast. A sampling of what's covered:

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [GPU MODE Lectures GitHub Repository](https://github.com/gpu-mode/lectures)
- [GPU MODE YouTube Channel](https://www.youtube.com/@GPUMODE)
- [GPU MODE Lecture Notes – Christian Mills](https://christianjmills.com/series/notes/cuda-mode-notes.html)
- [GPU Performance Engineering Resources](https://github.com/wafer-ai/gpu-perf-engineering-resources)
- [LeetGPU - The GPU Programming Challenge Platform](https://leetgpu.com/)
