CUDA Matrix Multiplication
CUDA C++
CUDA matrix-multiply kernels using shared-memory tiling, register blocking, and vectorised loads, compared against cuBLAS.
2 of 6 projects
CUDA C++
CUDA matrix-multiply kernels using shared-memory tiling, register blocking, and vectorised loads, compared against cuBLAS.
C++ / Python
GPT-2 inference in C++ with KV caching, SIMD kernels, and INT8/INT4 quantisation.