Skip to content

Commit 51748d9

Browse files
committed
SDPA: fetch tutorials
ref) pytorch/tutorials#2549
1 parent ca5bd75 commit 51748d9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

โ€Žintermediate_source/scaled_dot_product_attention_tutorial.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -310,7 +310,7 @@ def generate_rand_batch(
310310
# ๋ถ„์„ ๊ฒฐ๊ณผ, ๋‘ ๋ชจ๋“ˆ ๋ชจ๋‘ GPU์—์„œ ์†Œ์š”๋œ ์‹œ๊ฐ„์˜ ๋Œ€๋ถ€๋ถ„์ด
311311
# ๋™์ผํ•œ ํ•จ์ˆ˜๋“ค์— ์ง‘์ค‘๋˜์–ด ์žˆ์Œ์„ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค.
312312
# PyTorch๊ฐ€ ํ”„๋ ˆ์ž„์›Œํฌ ์˜ค๋ฒ„ํ—ค๋“œ๋ฅผ ์ œ๊ฑฐํ•˜๋Š” ๋ฐ ๋งค์šฐ ํƒ์›”ํ•œ ``torch.compile`` ๋ฅผ
313-
# ์ œ๊ณตํ•˜๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค. ``CausaulSelfAttention`` ๊ฐ™์€ ๊ฒฝ์šฐ์ฒ˜๋Ÿผ ํฌ๊ณ , ํšจ์œจ์ ์ธ CUDA ์ปค๋„์„
313+
# ์ œ๊ณตํ•˜๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค. ``CausalSelfAttention`` ๊ฐ™์€ ๊ฒฝ์šฐ์ฒ˜๋Ÿผ ํฌ๊ณ , ํšจ์œจ์ ์ธ CUDA ์ปค๋„์„
314314
# ์‚ฌ์šฉํ•˜๋Š” ๋ชจ๋ธ์—์„œ PyTorch ์˜ค๋ฒ„ํ—ค๋“œ๋Š” ์ž‘์•„์งˆ ๊ฒƒ์ž…๋‹ˆ๋‹ค.
315315
#
316316
# ์‚ฌ์‹ค, ๋ชจ๋“ˆ์€ ๋ณดํ†ต ``CausalSelfAttention`` ๋ธ”๋Ÿญ ํ•˜๋‚˜๋งŒ์œผ๋กœ ๊ตฌ์„ฑ๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.

0 commit comments

Comments
ย (0)