NVIDIA-NeMo/Curator · AI Repo StatsNVNVIDIA-NeMo/Curator
Scalable data pre processing and curation toolkit for LLMs
LLM & foundation modelsPython Apache-2.0 374created 2024-03-14 #data#data-curation#data-prep#data-preparation#data-processing#data-processing-pipelines#data-quality#datacuration#datarecipes#deduplication#fast-data-processing#fine-tuning#large-language-models#large-scale-data-processing#llm#llm-data-quality#llmapps#python#semantic-deduplication