Skip to content

Commit 468124c

Browse files
Update dist_overview with additional information. (#1155)
Summary: 1) Added DDP + RPC tutorial. 2) Added a pointer to PT Distributed CONTRIBUTING.md. Test Plan: Verified by loading the page locally. Reviewers: sentinel Subscribers: Tasks: Tags: Co-authored-by: pritam <pritam.damania@fb.com>
1 parent f1e682e commit 468124c

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

beginner_source/dist_overview.rst

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -195,3 +195,13 @@ RPC Tutorials are listed below:
195195
`@rpc.functions.async_execution <https://pytorch.org/docs/master/rpc.html#torch.distributed.rpc.functions.async_execution>`__
196196
decorator, which can help speed up inference and training. It uses similar
197197
RL and PS examples employed in the above tutorials 1 and 2.
198+
5. The `Combining Distributed DataParallel with Distributed RPC Framework <../advanced/rpc_ddp_tutorial.html>`__
199+
tutorial demonstrates how to combine DDP with RPC to train a model using
200+
distributed data parallelism combined with distributed model parallelism.
201+
202+
203+
PyTorch Distributed Developers
204+
------------------------------
205+
206+
If you'd like to contribute to PyTorch Distributed, please refer to our
207+
`Developer Guide <https://github.com/pytorch/pytorch/blob/master/torch/distributed/CONTRIBUTING.md>`_.

0 commit comments

Comments
 (0)