nlp

Explore the use of DSPy for extracting features from PDFs 🔎

Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)

Automated machine learning for text classification

Speaker identification powered by pyannote and resemblyzer

Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundation) model.

Open-source, AI-enhanced CAT tool with multi-LLM support, translation memory, glossary management, 'Superlookup' concordance across TMs/glossaries/web resources, voice commands, Okapi sidecar for file extraction, and integration with leading CAT tools.

Kiwi 형태소 분석기를 활용한 딥러닝 언어 모델 실험실

This repository will show how Langchain🦜🔗 library can be used and integrated

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

Pre-training Language Models for Japanese

Fully Configurable RAG Pipeline for Bengali Language RAG Applications. Supports both Local and Huggingface Models, Built with Langchain.

重生之我是 AI 打工人。前世，我的身份默默无闻，来去匆匆，不知道自己将在何地出生。然而，命运给予了我难得的机会，让我重生为一名 AI 打工人。

TikTok video scraping and multimodal content analysis tool.

Links to Belarusian NLP and Speech resources

NLP model zoo for Russian

State-of-the-art NLP through transformer models in a modular design and consistent APIs.

Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.

Script Buddy v2 is a film script text generation tool built using film scripts from the world's most popular film scripts and GPT2.

Automated question generation and question answering from Turkish texts using text-to-text transformers

Experiments with Hugging Face 🔬 🤗