Skip to content

Update transformer tutorial #1197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Oct 27, 2020
Merged

Conversation

zhangguanheng66
Copy link
Contributor

This PR updates the transformer tutorial. In the new tutorial, we generate the src_mask tensor out of the forward function of the transformer. In this way, users are able to torch.jit.script TransformerModel. I have also run the tutorial locally and this PR doesn't change the results and performance.

@netlify
Copy link

netlify bot commented Oct 22, 2020

Deploy preview for pytorch-tutorials-preview ready!

Built with commit bb7e0f1

https://deploy-preview-1197--pytorch-tutorials-preview.netlify.app

@netlify
Copy link

netlify bot commented Oct 22, 2020

Deploy preview for pytorch-tutorials-preview failed.

Built with commit 24f5414

https://app.netlify.com/sites/pytorch-tutorials-preview/deploys/5f9838cc42af2b0008c9c57f

@brianjo brianjo merged commit 40f8027 into pytorch:master Oct 27, 2020
rodrigo-techera pushed a commit to Experience-Monks/tutorials that referenced this pull request Nov 29, 2021
* checkpoint

* checkpoint

Co-authored-by: Guanheng Zhang <zhangguanheng@devfair0197.h2.fair>
Co-authored-by: Brian Johnson <brianjo@fb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants