avx2

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Fast inference engine for Transformer models

Visual Studio extension for assembly syntax highlighting and code completion in assembly files and the disassembly window

Implementations of SIMD instruction sets for systems which don't natively support them.