Skip to content

Commit 42faa38

Browse files
committed
copy edits
Signed-off-by: Chris Abraham <cjyabraham@gmail.com>
1 parent 48751a5 commit 42faa38

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

_posts/2024-07-08-accelerated-pytorch-inference.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -238,11 +238,11 @@ Self CPU time total: 14.379ms
238238

239239
## Technical deep dive: What are the challenges and optimization details
240240

241-
Underpinning torch.compile are new technologies – TorchDynamo, AOTAutograd, PrimTorch and TorchInductor.
241+
Underpinning torch.compile are new technologies – TorchDynamo, AOTDispatcher, and TorchInductor.
242242

243243
**TorchDynamo** captures PyTorch programs safely using Python Frame Evaluation Hooks
244244

245-
**AOTAutograd** overloads PyTorch’s autograd engine as a tracing autodiff for generating ahead-of-time backward traces. **PrimTorch** canonicalizes ~2000+ PyTorch operators down to a closed set of ~250 primitive operators that developers can target to build a complete PyTorch backend.
245+
**AOTDispatcher** overloads PyTorch’s autograd engine as a tracing autodiff for generating ahead-of-time backward traces.
246246

247247
**TorchInductor** is a deep learning compiler that generates fast code for multiple accelerators and backends.
248248

0 commit comments

Comments
 (0)