byfirecrawl· 131 skills
GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.
$npx -y skills add firecrawl/ai-research-skills --skill nemo-curatorInstalls into the current project.
Run `npx skills use "https://github.com/firecrawl/ai-research-skills" --skill "firecrawl/ai-research-skills/nemo-curator"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/firecrawl/ai-research-skills" that are relevant to the current task. Run `npx skills add "https://github.com/firecrawl/ai-research-skills"` and select the relevant skills, then follow their instructions.