benchmark

PhyX: Does Your Model Have the "Wits" for Physical Reasoning?

Benchmark your local LLMs.

:hugs: AeroPath: An airway segmentation benchmark dataset with challenging pathology

Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM.

Ollama with intel (i)GPU acceleration in docker and benchmark

KcBERT/KcELECTRA Fine Tune Benchmarks code (forked from https://github.com/monologg/KoELECTRA/tree/master/finetune)

[CVPR 2024 Highlight] ImageNet-D

Generate degraded speech datasets for noise-robust ASR benchmarking

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

MODA: open fashion retrieval benchmark and models by Hopit AI. MODA (203M, open source), MODA Pro Lite (213M, open weights), MODA Pro (hosted). Full-corpus benchmarks vs FashionSigLIP, SigLIP-SO400M and ZooClaw — one harness, losses shown. #1 open model on LookBench.

This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"

Embeddings: State-of-the-art Text Representations for Natural Language Processing tasks, an initial version of library focus on the Polish Language

ICLR 2026 | ChemEval: 4-level, 13-dimension, 62-task text/multimodal chemistry benchmark for evaluating LLMs and MLLMs.

Lynn GitHub 镜像仓 · Primary repository: https://github.com/MerkyorLynn/Lynn · Downloads: https://download.merkyorlynn.com/download.html

[CVPR 2026 Main] MultiBanana: A Challenging Benchmark for Multi-Reference Text-to-Image Generation

A lightweight library for normalizing speech transcripts before computing WER

For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and Lin Tan

Repository for the paper 'Enhancing Clinical Decision Support with Physiological Waveforms — A Multimodal Benchmark in Emergency Care'.

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

Probing the limitations of multimodal language models for chemistry and materials research