blip2

[ICRA 2024] Chat with NeRF enables users to interact with a NeRF model by typing in natural language.

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

An offline AI-powered video analysis tool with object detection (YOLO), image captioning (BLIP), speech transcription (Whisper), audio event detection (PANNs), and AI-generated summaries (LLMs via Ollama). It ensures privacy and offline use with a user-friendly GUI.

Caption images across your datasets with state of the art models from Hugging Face and Replicate!