multimodal

[NeurIPS DB 2025] IR3D-Bench: Evaluating Vision-Language Model Scene Understanding as Agentic Inverse Rendering

Datasets in kazakh language for different tasks

Implementation of GATO style Generalist Multimodal model capable of image, text, RL and Robotics tasks

ccks2022 task9 subtask2 商品同款识别

Spring AI agent engineering project with Java, MCP, RAG, tool calling, multimodal workflows, and UI prototypes.

Your agent seeks what search can't find. A self-hosted perception MCP server that transcribes speech, reads behind logins, sees images and video frames, crosses languages, and remembers.

A collection of AI-driven tools designed to enhance productivity, streamline task automation, and make everyday work more manageable.

[MM 2025] A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning

Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve.

Baseline model for multimodal classification based on images and text. Text representation obtained from pretrained BERT base model and image representation obtained from VGG16 pretrained model.

Visual Instruction Tuning for Qwen2 Base Model

MODA: open fashion retrieval benchmark and models by Hopit AI. MODA (203M, open source), MODA Pro Lite (213M, open weights), MODA Pro (hosted). Full-corpus benchmarks vs FashionSigLIP, SigLIP-SO400M and ZooClaw — one harness, losses shown. #1 open model on LookBench.

An end-to-end image captioning project using a CNN encoder (ResNet-50) and LSTM decoder in PyTorch. Includes vocabulary building, preprocessing, training with BLEU evaluation, and inference. Generates natural language captions for images with saved metrics, model checkpoints, and visualization outputs.

Repository for the paper "MultiNERD: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguation)" (NAACL 2022).

该仓库存放了多模态情感分析实验的配套代码。

[NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"

[ACL 2024] An Easy-to-use Hallucination Detection Framework for LLMs.

A curated list of recent papers (2023–2025) on controllable generative models, covering diffusion-based architectures with fine-grained control, attention interpretation, spectral manipulation, and structure-preserving image editing. Ideal for researchers and developers exploring controllable synthesis.

telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large language models, such as llama3

[MobiCom 2022] InFi is a library for building input filters for resource-efficient inference.