LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
A "standard library" of Triton kernels.
