gpt4v

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

Control Any Computer Using LLMs.

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

Prompts of GPT-4V & DALL-E3 to full utilize the multi-modal ability. GPT4V Prompts, DALL-E3 Prompts.

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

Mark web pages for use with vision-language models

Chain of Images for Intuitively Reasoning