LLM Inference Engine
C++ / Python
GPT-2 inference in C++ with KV caching, SIMD kernels, and INT8/INT4 quantisation.
2 of 6 projects
C++ / Python
GPT-2 inference in C++ with KV caching, SIMD kernels, and INT8/INT4 quantisation.
SystemVerilog / Python
A pipelined RV32I core on a Basys 3 FPGA, checked against a reference simulator with constrained-random instruction sequences.