natural-language-processing

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.

ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.

The data scientist's open-source choice to scale, assess and maintain natural language data. Treat training data like a software artifact.

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

🦙 Integrating LLMs into structured NLP pipelines

Curated visual catalog of 155+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

Create, Evaluate, and Connect AI Skills

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

[ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

Curated List: Practical Natural Language Processing done in Ruby

Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas

This Word Does Not Exist

Summarization Papers

[ACL 2023] Reasoning with Language Model Prompting: A Survey

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)