LLM Inference Engine
C++ / Python
GPT-2 inference in C++ with KV caching, SIMD kernels, and INT8/INT4 quantisation.
2 of 6 projects
C++ / Python
GPT-2 inference in C++ with KV caching, SIMD kernels, and INT8/INT4 quantisation.
A Rust key-value store with Redis-compatible commands, write-ahead logging, and background compaction.