optimization
60 个项目 · ⭐ 216.4kBLAS-like Library Instantiation Software Framework
2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.
Optax is a gradient processing and optimization library for JAX.
Source code of PyGAD, a Python 3 library for building the genetic algorithm and training machine learning algorithms (Keras & PyTorch).
Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
Building blocks for rapid development of GenAI applications
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
Components that optimize Flutter fluency.(Flutter 流畅度优化的通用方案,轻松解决卡顿问题)
🤗 Optimum Intel: Accelerate inference with Intel optimization tools
Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
9 Different Ways to Optimize AI Agent Memories
共 60 条 · 第 2 / 3 页