Closed
Description
in Tutorials > Writing Distributed Applications with PyTorch
Point-to-Point Communication
writing to tensor after dist.isend() will result in undefined behaviour.
reading from tensor after dist.irecv() will result in undefined behaviour.
actually is reading from tensor [before] dist.irecv() will result in undefined behaviour?
cc @svekars @brycebortree @tstatler @wconstab @osalpekar @H-Huang @kwen2501