File tree Expand file tree Collapse file tree 1 file changed +2
-4
lines changed Expand file tree Collapse file tree 1 file changed +2
-4
lines changed Original file line number Diff line number Diff line change 13
13
----------------
14
14
15
15
* Pytorch 2.5 or later
16
+
16
17
Setup
17
18
-----
18
19
Before we begin, we need to install ``torch`` if it is not already
@@ -116,6 +117,7 @@ def forward(self, x):
116
117
117
118
regional_compiled_model = Model (apply_regional_compilation = True ).cuda ()
118
119
120
+ #####################################################
119
121
# Applying compilation to a repeated region, instead of full model, leads to
120
122
# large savings in compile time. Here, we will just compile a layer instance and
121
123
# then reuse it 64 times in the ``Model`` object.
@@ -165,7 +167,3 @@ def measure_latency(fn, input):
165
167
# the repeated regions instead of more commonly used full model compilation. We
166
168
# are continually working on reducing cold start compilation time.
167
169
#
168
- # This feature is available with 2.5 release. If you are on 2.4, you can use a
169
- # config flag - `torch._dynamo.config.inline_inbuilt_nn_modules=True` to avoid
170
- # recompilations on the regional compilation. In 2.5, this flag is turned on by
171
- # default.
You can’t perform that action at this time.
0 commit comments