Oct 20, 2026 Hopper GEMM in CUTLASS C++ and the CuTe DSL, part 2, the kernel [W4A8] Oct 15, 2026 Expert Parallel MoE in Decode - From a Padded Grid to a Persistent Grid Oct 13, 2026 Mixture of Experts in vLLM - From First Principles to fused_moe Oct 13, 2026 Hopper GEMM in CUTLASS C++ and the CuTe DSL, part 1, the layers and the builder [W4A8] Sep 02, 2026 Large-Scale LLM Training Systems - How and Why Aug 23, 2026 LLM Inference Systems - From the Roofline to vLLM Internals Aug 23, 2026 LayerNorm and RMSNorm - Forward Pass, Backward Pass, and Every Derivative Aug 23, 2026 einsum - From Index Notation to Code Aug 20, 2026 A Simple MLP - Forward Pass, Backward Pass, and Every Derivative Jun 07, 2026 CuTe DSL fundamentals and primitives [FA3] May 22, 2026 Graduated from NYU with MSCS May 15, 2026 FlashAttention 3 - A Worklog Apr 18, 2026 CUTLASS WGMMA on Hopper - Notes Apr 14, 2026 Investigating Flaky `test_eagle_dp` — Batch Invariance Failure on L4 GPUs Mar 29, 2026 GEMM Kernel Optimization Notes Mar 25, 2026 SiLU+Mul+FP8 Block Quant Pattern Matching Pipeline - vLLM Notes Mar 25, 2026 Fused SiLU+Mul+FP8 Block Quantization CUDA Kernel - vLLM Notes Mar 10, 2026 Anatomy of a Spark Job Run Feb 13, 2026 Transformer Block FLOPs & Parameters Calculations