The most intuitive explanation of floats I've ever come across, courtesy of @fabynou fabiensanglard.net/floating_point…
GPU MODE
258 posts
GPU MODE
@GPU_MODE
Your favorite GPU community
- Write a fast kernel and run it on Discord. See how you compare against the best! If you're familiar with Leetcode, Kaggle or Codeforces then this should feel right at home
- Final moments at the @JaneStreetGroup hackathon today, everyone monitoring the leaderboard before the winners are declared
- We're starting a series on Multi GPU talks on Aug 16 at noon PST On Aug 16 we'll have Jeff Hammond one of the maintainers of NCCL giving us a talk on Multi GPU programming, On Aug 22 we'll be hearing from Didem Unat who will give us a broad overview of all GPU centric
- My hope with GPU MODE is that you could all create a project as impactful as PyTorch
- Been excited about this talk for a while, @SonglinYang4 on efficient architecture! Just started! youtube.com/watch?v=j4zJbr…
- 1,000 registrations so far!Ready, Set, Go! 🏎️ Create something amazing at our Blackwell NVFP4 Kernel Hackathon with @GPU_MODE. 🎊 🏆 Compete in a 4-part performance challenge to optimize low-level kernels on NVIDIA Blackwell hardware. 🥇 3 winners per challenge will receive top-tier NVIDIA hardware.
- Join us tomorrow (Fri, Feb 28) at 12PM PST @Nouamanetazi on "THE* Ultra-Scale Playbook" - LLM training from 1-1000s GPUs. 3hr marathon covering everything about GPUs. Co-Host @gordic_aleksa. Bring questions & popcorn!
- If you'd like to win your own Dell Pro Max with GB300 we're launching a new kernel competition with @NVIDIAAI @sestercegroup @Dell to optimize NVF4 kernels on B200 2025 has seen a tremendous rise of pythonic kernel DSLs, we got on-prem hardware to have reliable ncu benchmarking
- Talk on PyTorch's new Kernel DSL Helion happening now
- We're going MULTI GPU MODE, we have over 215 networked B200 GPUs ready for our yearly event on Oct 24 in San Francisco courtesy of our generous sponsor Nebius If you'd like a handful of nodes then please tell us what you'll be working on forms.gle/wYvXE99bvdRiQD…
- Saturday, November 15, at 12:00 PM PST we have a special talk lined up. Paulius Micikevicius arguably the man most responsible behind the efficiency revolution in GPUs with low bit dtypes and sparsity will be speaking. Cohosting with @cHHillee
