Skip to content

[User] Booting the avx512 version #879

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Closed
chille9 opened this issue Apr 10, 2023 · 1 comment
Closed

[User] Booting the avx512 version #879

chille9 opened this issue Apr 10, 2023 · 1 comment

Comments

@chille9
Copy link

chille9 commented Apr 10, 2023

Prerequisites

Expected Behavior

This may be a stupid question since im new to this, but I really enjoy the software thus far. I can run my start.bat file for avx2 using this code:

"title llama.cpp
:start
main -i --interactive-first -r "### Human:" --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m ggml-gpt4x-alpaca-unfiltered-q4_1.bin
pause
goto start"

Current Behavior

But if i run the avx512 the same start.bat file don´t work. Probably ive overlooked something simple here. I couldnt find too much info on how to run this version on here.

Environment and Context

Please provide detailed information about your computer setup. This is important in case the issue is not reproducible except for under certain specific conditions.

  • Physical (or virtual) hardware:
    Running windows with an Intel core i5 10600k

Logs

"llama>pause
Press any key to continue . . ."

@CRD716
Copy link
Contributor

CRD716 commented Apr 13, 2023

That CPU does not support AVX512.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants