Loading listing…
pytorch-fsdp2
Security scan passedAdds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and d…
Part of AI Research Skills (Orchestra)Pack · 98 skills
What pytorch-fsdp2 does
About
Adds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU memory or when you need DTensor-based sharding with DeviceMesh.