Skip to content

SDPA tutorial requires newer CUDA, so host it on an A10G #2571

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Sep 25, 2023

Conversation

janeyx99
Copy link
Contributor

Description

Should fix the fact that I run into tutorial build issues when the sharding algorithm punts the tutorial to a different worker that has too old of a GPU.

RuntimeError: Found Tesla M60 which is too old to be supported by the triton GPU compiler, which is used as the backend. Triton only supports devices of CUDA Capability >= 7.0, but your device is of CUDA capability 5.2

Error logs: https://github.com/pytorch/tutorials/actions/runs/6281857867/job/17060687817

Checklist

  • The issue that is being fixed is referred in the description (see above "Fixes #ISSUE_NUMBER")
  • Only one issue is addressed in this pull request
  • Labels from the issue that this PR is fixing are added to this pull request
  • No unnecessary issues are included into this pull request.

@pytorch-bot
Copy link

pytorch-bot bot commented Sep 25, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/tutorials/2571

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 4af9d49 with merge base 677c1b6 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Copy link
Contributor

@malfet malfet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A bit ugly, but would work...

@janeyx99 janeyx99 marked this pull request as ready for review September 25, 2023 18:07
@janeyx99
Copy link
Contributor Author

@malfet is there a better solution

@janeyx99 janeyx99 merged commit fb43d92 into main Sep 25, 2023
@svekars svekars deleted the require-a10g-for-sdpa branch September 25, 2023 21:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants