nlp

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Large Language Model Text Generation Inference

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

This repository contains code examples for the Stanford's course: TensorFlow for Deep Learning Research.

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.

A PyTorch implementation of the Transformer model in "Attention is All You Need".

ModelScope: bring the notion of Model-as-a-Service to life.

The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

BertViz: Visualize Attention in Transformer Models

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with intuition.

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

An open source library for deep learning end-to-end dialog systems and chatbots.

A log of things I'm learning

Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML