Skip to content

Commit 215a0d3

Browse files
committed
convert-hf : fix Refact conversion
1 parent f2099c5 commit 215a0d3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert-hf-to-gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -999,7 +999,7 @@ def modify_tensors(self, data_torch: Tensor, name: str, bid: int | None) -> Iter
999999
ff_dim = multiple_of * ((hidden_dim + multiple_of - 1) // multiple_of)
10001000
n_head = self.hparams["n_head"]
10011001
n_head_kv = 1
1002-
head_dim = hidden_dim // n_head
1002+
head_dim = self.hparams["n_embd"] // n_head
10031003

10041004
tensors: list[tuple[str, Tensor]] = []
10051005

0 commit comments

Comments
 (0)