Skip to content

Update Language Modeling with nn.Transformer and TorchText tutorial #2074

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 9 commits into from

Conversation

subramen
Copy link
Contributor

@subramen subramen commented Oct 7, 2022

Fixes batchify to return tensor of shape [batch_size, seq_len] (instead of [seq_len, batch_size]).

Closes #1841

@netlify
Copy link

netlify bot commented Oct 7, 2022

Deploy Preview for pytorch-tutorials-preview ready!

Name Link
🔨 Latest commit cf4dc17
🔍 Latest deploy log https://app.netlify.com/sites/pytorch-tutorials-preview/deploys/6435cc041040300008f6d52b
😎 Deploy Preview https://deploy-preview-2074--pytorch-tutorials-preview.netlify.app/beginner/transformer_tutorial
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

@svekars
Copy link
Contributor

svekars commented Dec 9, 2022

This PR just constantly fails with:

Dec 09 22:10:55 torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 1.45 GiB (GPU 0; 7.43 GiB total capacity; 6.24 GiB already allocated; 537.62 MiB free; 6.25 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

@malfet any thoughts?

Copy link

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

@github-actions github-actions bot added the stale Stale PRs label Sep 26, 2024
@github-actions github-actions bot closed this Oct 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Batchify in Language Modeling
4 participants