foundation-models

Implementation dino v2 for remote sensing with huggingface transformers

Preprint: Asymmetry in Low-Rank Adapters of Foundation Models

This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"

A instruction data generation system for multimodal language models.

[NAACL 2025] Towards Rationality in Language and Multimodal Agents: A Survey

This is an official pytorch implementation for paper "A Unified Shape-Aware Foundation Model for Time Series Classification" (AAAI-26).

LC-PLM: long-context protein language model based on BiMamba-S architecture

[AAAI'25] The implementation of paper "Federated Foundation Models on Heterogeneous Time Series" | The first work to explore time series foundation models on federated setting.

[CVPR 2024 CVinW] Multi-Agent VQA: Exploring Multi-Agent Foundation Models on Zero-Shot Visual Question Answering

Investigating the role of pre-training dataset size and diversity on the performance of single-cell foundation models

A comprehensive GUI wrapper application for Apple's Foundation Models Adapter Training Toolkit, providing an intuitive interface for training LoRA adapters for Apple's on-device foundation models.

A comprehensive survey of Vision–Language Models: Pretrained models, fine-tuning, prompt engineering, adapters, and benchmark datasets

Semantic alignment of astronomical data with natural language using multi-modal models. (Jax) Code associated with https://arxiv.org/abs/2403.08851 (COLM 2023).

Library for Federated Emergence & Foundation Models

Recent papers and projects in multitask learning and their applications

Official codebase for RetFiner: A Vision-Language Refinement Scheme for Retinal Foundation Models