CUDA Kernels, Chasing cuBLAS
A matrix-multiply kernel optimised rung by rung toward cuBLAS, ending with an honest account of why the last 15% is hard.
Each one has a writeup: how it works, what I tried that didn’t, and where the numbers came from.
6 projects
A matrix-multiply kernel optimised rung by rung toward cuBLAS, ending with an honest account of why the last 15% is hard.
GPT-2 inference written from scratch in C++, optimised as a measured ladder from a naive forward pass to int4 quantisation.
A crash-safe key-value store that real redis-cli connects to. The hard part is compaction that never loses a key.
A pipelined RV32I core on an FPGA, plus the constrained-random rig that proves it correct.
A preemptive real-time kernel written from the reset vector up, with context-switch latency measured on a logic analyzer.
A content-curation platform for a real client, migrated from JSX to TypeScript while it stayed live and kept shipping features.