Skip to content

Commit da3913d

Browse files
authored
batched: fix n_predict parameter (#8527)
1 parent d65a836 commit da3913d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/batched/batched.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ int main(int argc, char ** argv) {
3131
int n_parallel = params.n_parallel;
3232

3333
// total length of the sequences including the prompt
34-
int n_predict = 32;
34+
int n_predict = params.n_predict;
3535

3636
// init LLM
3737

0 commit comments

Comments
 (0)