Data + ML

Concepts, Notes and Intuitions

GPU Essentials - A Concise Technical Guide

A concise, technical guide to GPU architecture and CUDA, showing how massive parallelism is achieved through threads, blocks, SMs, and memory hierarchies.

26 min read · 2025

Wrapping Up Our ML Foundations Journey

A reflection on our exploration of machine learning fundamentals, from mathematical prerequisites to gradient boosting.

3 min read · 2025

K4 in CuTe [FA3]

Covers in-depth CuTe walkthrough of K4(WGMMA mechanics, TV layouts, register handoff) and as part of FA3 Worklog.

37 min read · June 12, 2026

2026 · GPU · GPU-NYU
K3 in CuTe [FA3]

Covers in-depth CuTe walkthrough of K3(TMA, producer/consumer pipelines) and as part of FA3 Worklog.

20 min read · June 12, 2026

2026 · GPU · GPU-NYU
K2 in CuTe [FA3]

Covers in-depth CuTe walkthrough of K2(the tiled online softmax kernel) and as part of FA3 Worklog.

20 min read · June 12, 2026

2026 · GPU · GPU-NYU
K1 in CuTe [FA3]

Covers in-depth CuTe walkthrough of K1(the naive materialized attention baseline) and as part of FA3 Worklog.

9 min read · June 07, 2026

2026 · GPU · GPU-NYU
CuTe DSL fundamentals and primitives [FA3]

Covers CuTe DSL fundamentals and primitives and as part of FA3 Worklog.

64 min read · June 07, 2026

2026 · GPU · GPU-NYU

Data + ML

Concepts, Notes and Intuitions

GPU Essentials - A Concise Technical Guide

Wrapping Up Our ML Foundations Journey

K4 in CuTe [FA3]

K3 in CuTe [FA3]

K2 in CuTe [FA3]

K1 in CuTe [FA3]

CuTe DSL fundamentals and primitives [FA3]