Skip to content

Commit 9cfbe94

Browse files
kalomazeteleprint-me
authored andcommitted
server : tweak default sampling parameters (ggml-org#4367)
* Set a more typical Top P setting as the default * Update temp max
1 parent 7a04ebf commit 9cfbe94

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

examples/server/public/index.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -223,7 +223,7 @@
223223
repeat_last_n: 256, // 0 = disable penalty, -1 = context size
224224
repeat_penalty: 1.18, // 1.0 = disabled
225225
top_k: 40, // <= 0 to use vocab size
226-
top_p: 0.5, // 1.0 = disabled
226+
top_p: 0.95, // 1.0 = disabled
227227
min_p: 0.05, // 0 = disabled
228228
tfs_z: 1.0, // 1.0 = disabled
229229
typical_p: 1.0, // 1.0 = disabled
@@ -762,7 +762,7 @@
762762
763763
<fieldset class="two">
764764
${IntField({ label: "Predictions", max: 2048, min: -1, name: "n_predict", value: params.value.n_predict })}
765-
${FloatField({ label: "Temperature", max: 1.5, min: 0.0, name: "temperature", step: 0.01, value: params.value.temperature })}
765+
${FloatField({ label: "Temperature", max: 2.0, min: 0.0, name: "temperature", step: 0.01, value: params.value.temperature })}
766766
${FloatField({ label: "Penalize repeat sequence", max: 2.0, min: 0.0, name: "repeat_penalty", step: 0.01, value: params.value.repeat_penalty })}
767767
${IntField({ label: "Consider N tokens for penalize", max: 2048, min: 0, name: "repeat_last_n", value: params.value.repeat_last_n })}
768768
${IntField({ label: "Top-K sampling", max: 100, min: -1, name: "top_k", value: params.value.top_k })}

0 commit comments

Comments
 (0)