A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.
Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
