TokenSpeed is a speed-of-light LLM inference engine.
CPU-first, eager-execution tensor/autograd runtime and LLM inference engine written in pure Zig