inference-acceleration

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

[NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising

⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

📚 A curated list of Awesome Efficient dLLMs Papers with Codes