natural-language-processing

预训练模型知识量度量竞赛 Baseline F1 0.35 BERTForMaskedLM

Bug detection and fixing using prompt engineering and fine-tuning with Llama 3 and a custom mutation-based dataset. Includes a user-friendly interface and performance evaluation metrics.

An AI-powered search engine to interact with documentation using RAG and local LLMs. Privately deployable with vector search and a modern frontend.

Lightweight, Self-Hosted AI Guardrails Model based on ModernBERT.

Earth observations, especially satellite data, have produced a wealth of methods and results in meeting global challenges, often presented in unstructured texts such as papers or reports. Accurate extraction of satellite and instrument entities from these unstructured texts can help to link and reuse Earth observation resources.

CatIss is an intelligent tool for automatic categorization of issue reports based on the RoBERTa model.

Taxonomy Completion with Embedding Quantization and an LLM-based Pipeline: A Case Study in Computational Linguistics

Code and dataset for paper - Application of Deep Learning in Generating Structured Radiology Reports: A Transformer-Based Technique

Engineered an advanced deep learning model to automate the classification of financial documents, including Balance Sheets, Cash Flow and Income Statements using Bidirectional LSTM and TensorFlow. The model achieved an impressive accuracy of 96.2%, enhancing efficiency and reducing errors in document management for the finance and banking sectors.

Reward a Language Model with pancakes 🥞

Advance information retrieval system that combines advanced indexing, machine learning, and personalized search to enhance academic research and document discovery.

A curated collection of NLP and LLM resources. Covers essential papers and blogs on Transformers, Reinforcement Learning (RLHF, DPO, GRPO), Mechanistic Interpretability, Scaling Laws, and MLSys.

[CCL 2023] Revisiting k-NN for Fine-tuning Pre-trained Language Models