tutorials

NeMo Curator Tutorials

Hands-on tutorials for curating data across all modalities with NeMo Curator. Complete working examples with detailed explanations.

Quick Start

New to NeMo Curator?

1. Install and run a modality quickstart from the documentation
2. Read Core Concepts to learn the pipeline architecture
3. Run quickstart.py for a hands-on example of Tasks, Stages, and Pipelines

Tutorials by Modality

Modality	Description	Key Tutorials
Text	Natural language processing and curation	Deduplication, Classification, Quality Assessment, Tokenization
Image	Computer vision and image processing	Aesthetic Classification, NSFW Detection, Deduplication
Video	Video processing and analysis	Clipping, Frame Extraction, Filtering
Audio	Speech and audio data curation	FLEURS Dataset Processing
Interleaved	Multimodal (text + image) data curation	Getting Started, PDF Extraction Pipeline (Nemotron-Parse)

Production Recipes

Complete, production-grade pipelines built on NeMo Curator:

Recipe	Description	Key Components
Nemotron-CC • SDG tutorial (in-repo)	Curate Common Crawl snapshots into an LLM-ready dataset, reproducing the Nemotron-CC datasets	CommonCrawlDownloadExtractStage • Language ID & Filtering • Exact/Fuzzy/Substring Dedup • Ensemble Quality Classification (1 fasttext + 2 FineWeb classifiers) • Synthetic Data Generation (4 tasks)

Core Concepts Example

The quickstart.py demonstrates NeMo Curator's foundational architecture:

• Task: Define data processing objectives
• ProcessingStage: Individual processing steps
• Pipeline: Orchestrate multiple stages

Documentation Links

Category	Links
Getting Started	Installation • Core Concepts
Modality Guides	Text Curation • Image Curation • Video Curation
Advanced	Custom Pipelines • Execution Backends • API Reference

Support

Documentation: Main Docs • GitHub Discussions