File tree Expand file tree Collapse file tree 1 file changed +4
-4
lines changed Expand file tree Collapse file tree 1 file changed +4
-4
lines changed Original file line number Diff line number Diff line change @@ -425,13 +425,13 @@ Examples:
425
425
- Use device 0:
426
426
427
427
``` sh
428
- ZES_ENABLE_SYSMAN=1 ./build/bin/llama-cli -m models/llama-2-7b.Q4_0.gguf -p " Building a website can be done in 10 simple steps:" -n 400 -e -ngl 33 -sm none -mg 0
428
+ ZES_ENABLE_SYSMAN=1 ./build/bin/llama-cli -no-cnv - m models/llama-2-7b.Q4_0.gguf -p " Building a website can be done in 10 simple steps:" -n 400 -e -ngl 33 -sm none -mg 0
429
429
```
430
430
431
431
- Use multiple devices:
432
432
433
433
``` sh
434
- ZES_ENABLE_SYSMAN=1 ./build/bin/llama-cli -m models/llama-2-7b.Q4_0.gguf -p " Building a website can be done in 10 simple steps:" -n 400 -e -ngl 33 -sm layer
434
+ ZES_ENABLE_SYSMAN=1 ./build/bin/llama-cli -no-cnv - m models/llama-2-7b.Q4_0.gguf -p " Building a website can be done in 10 simple steps:" -n 400 -e -ngl 33 -sm layer
435
435
```
436
436
437
437
* Notes:*
@@ -697,13 +697,13 @@ Examples:
697
697
- Use device 0:
698
698
699
699
```
700
- build\bin\llama-cli.exe -m models\llama-2-7b.Q4_0.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e -ngl 33 -s 0 -sm none -mg 0
700
+ build\bin\llama-cli.exe -no-cnv - m models\llama-2-7b.Q4_0.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e -ngl 33 -s 0 -sm none -mg 0
701
701
```
702
702
703
703
- Use multiple devices:
704
704
705
705
```
706
- build\bin\llama-cli.exe -m models\llama-2-7b.Q4_0.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e -ngl 33 -s 0 -sm layer
706
+ build\bin\llama-cli.exe -no-cnv - m models\llama-2-7b.Q4_0.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 400 -e -ngl 33 -s 0 -sm layer
707
707
```
708
708
709
709
You can’t perform that action at this time.
0 commit comments