Skip to content

Commit 84f11aa

Browse files
authored
Formatting cleanup
1 parent 05bee4b commit 84f11aa

File tree

1 file changed

+2
-4
lines changed

1 file changed

+2
-4
lines changed

recipes_source/regional_compilation.py

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@
1313
----------------
1414
1515
* Pytorch 2.5 or later
16+
1617
Setup
1718
-----
1819
Before we begin, we need to install ``torch`` if it is not already
@@ -116,6 +117,7 @@ def forward(self, x):
116117

117118
regional_compiled_model = Model(apply_regional_compilation=True).cuda()
118119

120+
#####################################################
119121
# Applying compilation to a repeated region, instead of full model, leads to
120122
# large savings in compile time. Here, we will just compile a layer instance and
121123
# then reuse it 64 times in the ``Model`` object.
@@ -165,7 +167,3 @@ def measure_latency(fn, input):
165167
# the repeated regions instead of more commonly used full model compilation. We
166168
# are continually working on reducing cold start compilation time.
167169
#
168-
# This feature is available with 2.5 release. If you are on 2.4, you can use a
169-
# config flag - `torch._dynamo.config.inline_inbuilt_nn_modules=True` to avoid
170-
# recompilations on the regional compilation. In 2.5, this flag is turned on by
171-
# default.

0 commit comments

Comments
 (0)