diff --git a/index.rst b/index.rst index 1ddba17d1bb..7781628c851 100644 --- a/index.rst +++ b/index.rst @@ -3,11 +3,11 @@ Welcome to PyTorch Tutorials **What's new in PyTorch tutorials?** -* `Using User-Defined Triton Kernels with torch.compile `__ -* `Large Scale Transformer model training with Tensor Parallel (TP) `__ -* `Accelerating BERT with semi-structured (2:4) sparsity `__ -* `torch.export Tutorial with torch.export.Dim `__ -* `Extension points in nn.Module for load_state_dict and tensor subclasses `__ +* `Introduction to Distributed Pipeline Parallelism `__ +* `Introduction to Libuv TCPStore Backend `__ +* `Asynchronous Saving with Distributed Checkpoint (DCP) `__ +* `Python Custom Operators `__ +* Updated `Getting Started with DeviceMesh `__ .. raw:: html diff --git a/intermediate_source/TCPStore_libuv_backend.rst b/intermediate_source/TCPStore_libuv_backend.rst index 34037b5be7c..1e285eba7c4 100644 --- a/intermediate_source/TCPStore_libuv_backend.rst +++ b/intermediate_source/TCPStore_libuv_backend.rst @@ -8,7 +8,8 @@ Introduction to Libuv TCPStore Backend .. grid:: 2 .. grid-item-card:: :octicon:`mortar-board;1em;` What you will learn - :class-card: card-prerequisites + :class-card: card-prerequisites + * What is the new TCPStore backend * Compare the new libuv backend against the legacy backend * How to enable to use the legacy backend diff --git a/intermediate_source/pipelining_tutorial.rst b/intermediate_source/pipelining_tutorial.rst index 3d6533cef2b..0c6fc798463 100644 --- a/intermediate_source/pipelining_tutorial.rst +++ b/intermediate_source/pipelining_tutorial.rst @@ -12,6 +12,7 @@ APIs. .. grid:: 2 .. grid-item-card:: :octicon:`mortar-board;1em;` What you will learn + :class-card: card-prerequisites * How to use ``torch.distributed.pipelining`` APIs * How to apply pipeline parallelism to a transformer model @@ -19,6 +20,7 @@ APIs. .. grid-item-card:: :octicon:`list-unordered;1em;` Prerequisites + :class-card: card-prerequisites * Familiarity with `basic distributed training `__ in PyTorch