We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 6757e4e commit d281dcdCopy full SHA for d281dcd
distributed/FSDP2/README.md
@@ -4,7 +4,7 @@ To run FSDP2 on transformer model:
4
cd distributed/FSDP2
5
torchrun --nproc_per_node 2 train.py
6
```
7
-* For 1st time, it creates a "checkpoints" folder and save state dicts there
+* For 1st time, it creates a "checkpoints" folder and saves state dicts there
8
* For 2nd time, it loads from previous checkpoints
9
10
To enable explicit prefetching
0 commit comments