From 34e965be80283f20c8e99f5270ccdcf4246c0682 Mon Sep 17 00:00:00 2001 From: Svetlana Karslioglu Date: Mon, 22 Jul 2024 13:46:29 -0700 Subject: [PATCH 1/2] Update what's new for 2.4 --- index.rst | 11 ++++++----- intermediate_source/TCPStore_libuv_backend.rst | 3 ++- intermediate_source/pipelining_tutorial.rst | 2 ++ 3 files changed, 10 insertions(+), 6 deletions(-) diff --git a/index.rst b/index.rst index 1ddba17d1bb..e68a88a6f9b 100644 --- a/index.rst +++ b/index.rst @@ -3,11 +3,12 @@ Welcome to PyTorch Tutorials **What's new in PyTorch tutorials?** -* `Using User-Defined Triton Kernels with torch.compile `__ -* `Large Scale Transformer model training with Tensor Parallel (TP) `__ -* `Accelerating BERT with semi-structured (2:4) sparsity `__ -* `torch.export Tutorial with torch.export.Dim `__ -* `Extension points in nn.Module for load_state_dict and tensor subclasses `__ +* `Introduction to Distributed Pipeline Parallelism + `__ +* `Introduction to Libuv TCPStore Backend `__ +* `Asynchronous Saving with Distributed Checkpoint (DCP) `__ +* `Python Custom Operators `__ +* Updated `Getting Started with DeviceMesh `__ .. raw:: html diff --git a/intermediate_source/TCPStore_libuv_backend.rst b/intermediate_source/TCPStore_libuv_backend.rst index 34037b5be7c..1e285eba7c4 100644 --- a/intermediate_source/TCPStore_libuv_backend.rst +++ b/intermediate_source/TCPStore_libuv_backend.rst @@ -8,7 +8,8 @@ Introduction to Libuv TCPStore Backend .. grid:: 2 .. grid-item-card:: :octicon:`mortar-board;1em;` What you will learn - :class-card: card-prerequisites + :class-card: card-prerequisites + * What is the new TCPStore backend * Compare the new libuv backend against the legacy backend * How to enable to use the legacy backend diff --git a/intermediate_source/pipelining_tutorial.rst b/intermediate_source/pipelining_tutorial.rst index 3d6533cef2b..0c6fc798463 100644 --- a/intermediate_source/pipelining_tutorial.rst +++ b/intermediate_source/pipelining_tutorial.rst @@ -12,6 +12,7 @@ APIs. .. grid:: 2 .. grid-item-card:: :octicon:`mortar-board;1em;` What you will learn + :class-card: card-prerequisites * How to use ``torch.distributed.pipelining`` APIs * How to apply pipeline parallelism to a transformer model @@ -19,6 +20,7 @@ APIs. .. grid-item-card:: :octicon:`list-unordered;1em;` Prerequisites + :class-card: card-prerequisites * Familiarity with `basic distributed training `__ in PyTorch From 48aacacb35826a4b1dc88f7e46a705c2198307c3 Mon Sep 17 00:00:00 2001 From: Svetlana Karslioglu Date: Wed, 24 Jul 2024 09:07:13 -0700 Subject: [PATCH 2/2] Update index.rst --- index.rst | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/index.rst b/index.rst index e68a88a6f9b..7781628c851 100644 --- a/index.rst +++ b/index.rst @@ -3,8 +3,7 @@ Welcome to PyTorch Tutorials **What's new in PyTorch tutorials?** -* `Introduction to Distributed Pipeline Parallelism - `__ +* `Introduction to Distributed Pipeline Parallelism `__ * `Introduction to Libuv TCPStore Backend `__ * `Asynchronous Saving with Distributed Checkpoint (DCP) `__ * `Python Custom Operators `__