diff --git a/recipes_source/regional_compilation.py b/recipes_source/regional_compilation.py index f0f0e7f3e3d..8b51d3ef516 100644 --- a/recipes_source/regional_compilation.py +++ b/recipes_source/regional_compilation.py @@ -3,6 +3,7 @@ ============================================================================ **Author:** `Animesh Jain `_ + As deep learning models get larger, the compilation time of these models also increases. This extended compilation time can result in a large startup time in inference services or wasted resources in large-scale training. This recipe @@ -23,7 +24,7 @@ pip install torch -.. note:: +.. note:: This feature is available starting with the 2.5 release. If you are using version 2.4, you can enable the configuration flag ``torch._dynamo.config.inline_inbuilt_nn_modules=True`` to prevent recompilations during regional compilation. In version 2.5, this flag is enabled by default.