onescience-parallel
byonescience-ai· 18 skills
将 PyTorch 模型改造为支持 Pipeline Parallelism (PP) + Tensor Parallelism (TP) 的分布式训练模型。 适用场景：单机单卡模型改多卡分布式、模型拆分为多个 pipeline stage、替换 nn.Linear 为并行线性层、 编写 forward_step_func / model_provider / dataset_provider、配置 PipelineTensorShapeConfig、 创建 Distributed 版本模块（DistributedFuser / DistributedAttention / DistributedMlp）。 当用户提到以下任何关键词时，务必使用此 skill： "流水线并行"、"pipeline parallel"、"模型并行改造"、"分布式训练"、"stage 拆分"、 "ColumnParallelLinear"、"RowParallelLinear"、"pretrain 接口"、"forward_step_func"、 "model_provider"、"TP 并行"、"张量并行"、"多卡训练"、"Megatron"。
How to install onescience-parallel?
onescience-ai/oneskills/onescience-parallel
$npx -y skills add onescience-ai/oneskills --skill onescience-parallelInstalls into the current project.
›Prefer a prompt? Paste this to your agent
Run `npx skills use "https://github.com/onescience-ai/oneskills" --skill "onescience-ai/oneskills/onescience-parallel"` and follow the generated skill instructions now. Read its complete output, redirecting it to a temporary file first if necessary. Resolve relative paths from the supporting-files directory it provides.
Use the skills in "https://github.com/onescience-ai/oneskills" that are relevant to the current task. Run `npx skills add "https://github.com/onescience-ai/oneskills"` and select the relevant skills, then follow their instructions.
Related
6 picksType
- azure-aiUse for Azure AI: Search, Speech, OpenAI, Document Intelligence. Helps with search, vector/hybrid search, speech-to-text, text-to-speech, transcription, OCR.Jul 2026
- ai-research-exploreRigor Explore compatible skill slug for meaningful and potentially novel deep learning research candidates.Jul 2026
- ai-research-reproductionRigor Reproduce compatible skill slug for README-first deep learning repository reproduction.Jul 2026
- explore-codeRigor Improve implementation leaf skill for auditable candidate implementation in deep learning research repositories.Jul 2026
- run-trainRigor Train skill for deep learning research repositories. Use when a documented or selected training command should be run conservatively for startup…Jul 2026
- explore-runRigor Improve / Rigor Explore run leaf skill for bounded exploratory evidence in deep learning research repositories.Jul 2026
