GPU-NYU
an archive of posts in this category
| Oct 20, 2026 | Hopper GEMM in CUTLASS C++ and the CuTe DSL, part 2, the kernel [W4A8] |
|---|---|
| Oct 15, 2026 | Expert Parallel MoE in Decode - From a Padded Grid to a Persistent Grid |
| Oct 13, 2026 | Mixture of Experts in vLLM - From First Principles to fused_moe |
| Oct 13, 2026 | Hopper GEMM in CUTLASS C++ and the CuTe DSL, part 1, the layers and the builder [W4A8] |
| Jun 07, 2026 | CuTe DSL fundamentals and primitives [FA3] |
| May 15, 2026 | FlashAttention 3 - A Worklog |
| Apr 18, 2026 | CUTLASS WGMMA on Hopper - Notes |
| Apr 14, 2026 | Investigating Flaky `test_eagle_dp` — Batch Invariance Failure on L4 GPUs |
| Mar 29, 2026 | GEMM Kernel Optimization Notes |
| Mar 25, 2026 | SiLU+Mul+FP8 Block Quant Pattern Matching Pipeline - vLLM Notes |
| Mar 25, 2026 | Fused SiLU+Mul+FP8 Block Quantization CUDA Kernel - vLLM Notes |
| Dec 15, 2025 | Reading Notes from Aleksa Gordic's GPU BlogPost |
| Dec 11, 2025 | GPU Notes |
| Sep 23, 2025 | GPU Essentials - A Concise Technical Guide |