LLM Inference Engine
GPT-2 inference written from scratch in C++, optimised as a measured ladder from a naive forward pass to int4 quantisation.
C++Python
Projects
Each one has a writeup: how it works, what I tried that didn’t, and where the numbers came from.
2 of 6 projects
LSM Storage Engine
A crash-safe key-value store that real redis-cli connects to. The hard part is compaction that never loses a key.
Rust