nlp

🦙 Integrating LLMs into structured NLP pipelines

An elegent pytorch implement of transformers

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

Neural Network Compression Framework for enhanced OpenVINO™ inference

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.

🤗 A list of wonderful open-source projects & applications integrated with Hugging Face libraries.

Curated List: Practical Natural Language Processing done in Ruby

Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

Summarization Papers

[ACL 2023] Reasoning with Language Model Prompting: A Survey

A Framework of Small-scale Large Multimodal Models

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

A complete, structured hub for learning Artificial Intelligence — covering AI, Machine Learning, Deep Learning, and Data Science with books, roadmaps, and curated resources from beginner to advanced.

从 NLP 到 LLM 的算法全栈教程，在线阅读地址：https://datawhalechina.github.io/base-llm/