multimodal-agent

Mobile-Agent: The Powerful GUI Agent Family

[EMNLP-2024] Build multimodal language agents for fast prototype and production

AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.

🖼️ Workshop: Build a multimodal AI agent with Haystack & GPT-4o — featuring image understanding, document retrieval, conversational memory, and human-in-the-loop safety controls