beit

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

OpenMMLab Pre-training Toolbox and Benchmark

PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI