Skip to content

Commit c881238

Browse files
transformer building blocks tutorial
1 parent 97b20b3 commit c881238

File tree

2 files changed

+637
-1
lines changed

2 files changed

+637
-1
lines changed

index.rst

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ Welcome to PyTorch Tutorials
66
* `torch.export AOTInductor Tutorial for Python runtime (Beta) <https://pytorch.org/tutorials/recipes/torch_export_aoti_python.html>`__
77
* `A guide on good usage of non_blocking and pin_memory() in PyTorch <https://pytorch.org/tutorials/intermediate/pinmem_nonblock.html>`__
88
* `Introduction to Distributed Pipeline Parallelism <https://pytorch.org/tutorials/intermediate/pipelining_tutorial.html>`__
9-
* `Introduction to Libuv TCPStore Backend <https://pytorch.org/tutorials/intermediate/TCPStore_libuv_backend.html>`__
9+
* `Introduction to Libuv TCPStore Backend <https://pytorch.org/tutorials/intermediate/TCPStore_libuv_backend.html>`__
1010
* `Asynchronous Saving with Distributed Checkpoint (DCP) <https://pytorch.org/tutorials/recipes/distributed_async_checkpoint_recipe.html>`__
1111
* `Python Custom Operators <https://pytorch.org/tutorials/advanced/python_custom_ops.html>`__
1212
* Updated `Getting Started with DeviceMesh <https://pytorch.org/tutorials/recipes/distributed_device_mesh.html>`__
@@ -686,6 +686,14 @@ Welcome to PyTorch Tutorials
686686
:link: beginner/knowledge_distillation_tutorial.html
687687
:tags: Model-Optimization,Image/Video
688688

689+
690+
.. customcarditem::
691+
:header: [Title TBD] Unbundling nn.Transformer modules for gains and profits
692+
:card_description: This tutorial goes over recommended best practices for implementing Transformers.
693+
:image: _static/img/thumbnails/cropped/pytorch-logo.png
694+
:link: intermediate/transformer_building_blocks.html
695+
:tags: Transformer
696+
689697
.. Parallel-and-Distributed-Training
690698
691699

0 commit comments

Comments
 (0)