roberta

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

BertViz: Visualize Attention in Transformer Models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

🤖 A PyTorch library of curated Transformer models and their composable components

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

A flexible, adaptive classification system for dynamic text classification

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision

MinT: Minimal Transformer Library and Tutorials

Build a Large Language Model (From Scratch) book and Finetuned Models

Pytorch-Named-Entity-Recognition-with-transformers

A Dutch RoBERTa-based language model