fairseq

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI