LLM Inference Engine
GPT-2 inference written from scratch in C++, optimised as a measured ladder from a naive forward pass to int4 quantisation.
C++Python
Projects
Each one has a writeup: how it works, what I tried that didn’t, and where the numbers came from.
1 of 6 projects