NVIDIA-NeMo/Curator

Scalable data pre processing and curation toolkit for LLMs

⭐ 1.7k ⑂ 320 Python Apache-2.0 · 1 天前推送

data data-processing data-quality deduplication fine-tuning large-language-models llm python data-curation data-prep data-preparation data-processing-pipelines datacuration datarecipes fast-data-processing large-scale-data-processing llm-data-quality llmapps semantic-deduplication

1.7k

Watchers

0

贡献者

0

Commits

0

Releases

279

Open Issues

1 天前

最近推送

原文中文

暂无 README