dataset

Models, data loaders and abstractions for language processing, powered by PyTorch

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

A quick guide (especially) for trending instruction finetuning datasets

We are building an open database of COVID-19 cases with chest X-ray or CT images.

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

🎁 7,400,000+ Unsplash images made available for research and machine learning

FMA: A Dataset For Music Analysis

收集和梳理垂直领域的开源模型、数据集及评测基准。

Semantic Segmentation Suite in TensorFlow. Implement, train, and test new Semantic Segmentation models easily!

180 free CSS3, Figma, Sketch & PSD gradients — plus a JSON dataset for design tools, generators, and AI agents.

ISO 3166-1 country lists merged with their UN Geoscheme regional codes in ready-to-use JSON, XML, CSV data sets

Objectron is a dataset of short, object-centric video clips. In addition, the videos also contain AR session metadata including camera poses, sparse point-clouds and planes. In each video, the camera moves around and above the object and captures it from different views. Each object is annotated with a 3D bounding box. The 3D bounding box describes the object’s position, orientation, and dimensions. The dataset contains about 15K annotated video clips and 4M annotated images in the following categories: bikes, books, bottles, cameras, cereal boxes, chairs, cups, laptops, and shoes

A comprehensive and up-to-date compilation of datasets, tools, methods, review papers, and competitions for remote sensing change detection.

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Basic Utilities for PyTorch Natural Language Processing (NLP)

Collaborate & label any type of data, images, text, or documents, in an easy web interface or desktop app.

fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.

A curated list of Graph/Transformer-based fraud, anomaly, and outlier detection papers & resources

A curated list of radar datasets, detection, tracking and fusion

A large annotated semantic parsing corpus for developing natural language interfaces.