Skip to content

[ERROR] Using "make" command #443

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Closed
Marssouss opened this issue Mar 23, 2023 · 3 comments
Closed

[ERROR] Using "make" command #443

Marssouss opened this issue Mar 23, 2023 · 3 comments
Labels
build Compilation issues hardware Hardware related

Comments

@Marssouss
Copy link

Marssouss commented Mar 23, 2023

Hello evryone,

I have an issue when i run "make" cmd :
I use Ubuntu 22.04 in VirtualBox
Make version : GNU Make 4.3

Here the return of cmd

I llama.cpp build info: 

I UNAME_S:  Linux

I UNAME_P:  x86_64

I UNAME_M:  x86_64

I CFLAGS:   -I.              -O3 -DNDEBUG -std=c11   -fPIC -pthread -mavx -mavx2 -msse3

I CXXFLAGS: -I. -I./examples -O3 -DNDEBUG -std=c++11 -fPIC -pthread

I LDFLAGS:  

I CC:       cc (Ubuntu 11.3.0-1ubuntu1~22.04) 11.3.0

I CXX:      g++ (Ubuntu 11.3.0-1ubuntu1~22.04) 11.3.0



cc  -I.              -O3 -DNDEBUG -std=c11   -fPIC -pthread -mavx -mavx2 -msse3   -c ggml.c -o ggml.o

In file included from /usr/lib/gcc/x86_64-linux-gnu/11/include/immintrin.h:101,

                 from ggml.c:158:

ggml.c: In function ‘ggml_vec_dot_f16’:

/usr/lib/gcc/x86_64-linux-gnu/11/include/f16cintrin.h:52:1: error: inlining failed in call to ‘always_inline’ ‘_mm256_cvtph_ps’: target specific option mismatch

   52 | _mm256_cvtph_ps (__m128i __A)

      | ^~~~~~~~~~~~~~~

ggml.c:936:33: note: called from here

  936 | #define GGML_F32Cx8_LOAD(x)     _mm256_cvtph_ps(_mm_loadu_si128((__m128i *)(x)))

      |                                 ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ggml.c:946:37: note: in expansion of macro ‘GGML_F32Cx8_LOAD’

  946 | #define GGML_F16_VEC_LOAD(p, i)     GGML_F32Cx8_LOAD(p)

      |                                     ^~~~~~~~~~~~~~~~

ggml.c:1340:21: note: in expansion of macro ‘GGML_F16_VEC_LOAD’

 1340 |             ay[j] = GGML_F16_VEC_LOAD(y + i + j*GGML_F16_EPR, j);

      |                     ^~~~~~~~~~~~~~~~~

In file included from /usr/lib/gcc/x86_64-linux-gnu/11/include/immintrin.h:101,

                 from ggml.c:158:

/usr/lib/gcc/x86_64-linux-gnu/11/include/f16cintrin.h:52:1: error: inlining failed in call to ‘always_inline’ ‘_mm256_cvtph_ps’: target specific option mismatch

   52 | _mm256_cvtph_ps (__m128i __A)

      | ^~~~~~~~~~~~~~~

ggml.c:936:33: note: called from here

  936 | #define GGML_F32Cx8_LOAD(x)     _mm256_cvtph_ps(_mm_loadu_si128((__m128i *)(x)))

      |                                 ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ggml.c:946:37: note: in expansion of macro ‘GGML_F32Cx8_LOAD’

  946 | #define GGML_F16_VEC_LOAD(p, i)     GGML_F32Cx8_LOAD(p)

      |                                     ^~~~~~~~~~~~~~~~

ggml.c:1339:21: note: in expansion of macro ‘GGML_F16_VEC_LOAD’

 1339 |             ax[j] = GGML_F16_VEC_LOAD(x + i + j*GGML_F16_EPR, j);

      |                     ^~~~~~~~~~~~~~~~~

In file included from /usr/lib/gcc/x86_64-linux-gnu/11/include/immintrin.h:101,

                 from ggml.c:158:

/usr/lib/gcc/x86_64-linux-gnu/11/include/f16cintrin.h:52:1: error: inlining failed in call to ‘always_inline’ ‘_mm256_cvtph_ps’: target specific option mismatch

   52 | _mm256_cvtph_ps (__m128i __A)

      | ^~~~~~~~~~~~~~~

ggml.c:936:33: note: called from here

  936 | #define GGML_F32Cx8_LOAD(x)     _mm256_cvtph_ps(_mm_loadu_si128((__m128i *)(x)))

      |                                 ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ggml.c:946:37: note: in expansion of macro ‘GGML_F32Cx8_LOAD’

  946 | #define GGML_F16_VEC_LOAD(p, i)     GGML_F32Cx8_LOAD(p)

      |                                     ^~~~~~~~~~~~~~~~

ggml.c:1339:21: note: in expansion of macro ‘GGML_F16_VEC_LOAD’

 1339 |             ax[j] = GGML_F16_VEC_LOAD(x + i + j*GGML_F16_EPR, j);

      |                     ^~~~~~~~~~~~~~~~~

In file included from /usr/lib/gcc/x86_64-linux-gnu/11/include/immintrin.h:101,

                 from ggml.c:158:

/usr/lib/gcc/x86_64-linux-gnu/11/include/f16cintrin.h:52:1: error: inlining failed in call to ‘always_inline’ ‘_mm256_cvtph_ps’: target specific option mismatch

   52 | _mm256_cvtph_ps (__m128i __A)

      | ^~~~~~~~~~~~~~~

ggml.c:936:33: note: called from here

  936 | #define GGML_F32Cx8_LOAD(x)     _mm256_cvtph_ps(_mm_loadu_si128((__m128i *)(x)))

      |                                 ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ggml.c:946:37: note: in expansion of macro ‘GGML_F32Cx8_LOAD’

  946 | #define GGML_F16_VEC_LOAD(p, i)     GGML_F32Cx8_LOAD(p)

      |                                     ^~~~~~~~~~~~~~~~

ggml.c:1340:21: note: in expansion of macro ‘GGML_F16_VEC_LOAD’

 1340 |             ay[j] = GGML_F16_VEC_LOAD(y + i + j*GGML_F16_EPR, j);

      |                     ^~~~~~~~~~~~~~~~~

In file included from /usr/lib/gcc/x86_64-linux-gnu/11/include/immintrin.h:101,

                 from ggml.c:158:

/usr/lib/gcc/x86_64-linux-gnu/11/include/f16cintrin.h:52:1: error: inlining failed in call to ‘always_inline’ ‘_mm256_cvtph_ps’: target specific option mismatch

   52 | _mm256_cvtph_ps (__m128i __A)

      | ^~~~~~~~~~~~~~~

ggml.c:936:33: note: called from here

  936 | #define GGML_F32Cx8_LOAD(x)     _mm256_cvtph_ps(_mm_loadu_si128((__m128i *)(x)))

      |                                 ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ggml.c:946:37: note: in expansion of macro ‘GGML_F32Cx8_LOAD’

  946 | #define GGML_F16_VEC_LOAD(p, i)     GGML_F32Cx8_LOAD(p)

      |                                     ^~~~~~~~~~~~~~~~

ggml.c:1339:21: note: in expansion of macro ‘GGML_F16_VEC_LOAD’

 1339 |             ax[j] = GGML_F16_VEC_LOAD(x + i + j*GGML_F16_EPR, j);

      |                     ^~~~~~~~~~~~~~~~~

In file included from /usr/lib/gcc/x86_64-linux-gnu/11/include/immintrin.h:101,

                 from ggml.c:158:

/usr/lib/gcc/x86_64-linux-gnu/11/include/f16cintrin.h:52:1: error: inlining failed in call to ‘always_inline’ ‘_mm256_cvtph_ps’: target specific option mismatch

   52 | _mm256_cvtph_ps (__m128i __A)

      | ^~~~~~~~~~~~~~~

ggml.c:936:33: note: called from here

  936 | #define GGML_F32Cx8_LOAD(x)     _mm256_cvtph_ps(_mm_loadu_si128((__m128i *)(x)))

      |                                 ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

ggml.c:946:37: note: in expansion of macro ‘GGML_F32Cx8_LOAD’

  946 | #define GGML_F16_VEC_LOAD(p, i)     GGML_F32Cx8_LOAD(p)

      |                                     ^~~~~~~~~~~~~~~~

ggml.c:1340:21: note: in expansion of macro ‘GGML_F16_VEC_LOAD’

 1340 |             ay[j] = GGML_F16_VEC_LOAD(y + i + j*GGML_F16_EPR, j);

      |                     ^~~~~~~~~~~~~~~~~

make: *** [Makefile:221 : ggml.o] Erreur 1

@Joelone
Copy link

Joelone commented Mar 23, 2023

I use Ubuntu 22.04 in VirtualBox

The VirtualBox causes the problem [1], you can try to use gcc:10.2 with Docker.
There are also a PR you may want to take a look: [2].

[1]. virtual box is the problem limiting the avx instructions.

[2].Dockerize llamacpp

@gjmulder gjmulder added hardware Hardware related build Compilation issues labels Mar 24, 2023
@sw
Copy link
Contributor

sw commented Apr 22, 2023

As the Makefile no longer sets specific instruction set options, but uses -march=native -mtune=native, this should no longer occur. Please reopen if you still have the problem with the latest master.

@sw sw closed this as completed Apr 22, 2023
@dcordi
Copy link

dcordi commented Jun 6, 2023

See issue comment for disable AVX2 : #1655 (comment)

Deadsg pushed a commit to Deadsg/llama.cpp that referenced this issue Dec 19, 2023
…terial-9.1.18

Bump mkdocs-material from 9.1.17 to 9.1.18
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
build Compilation issues hardware Hardware related
Projects
None yet
Development

No branches or pull requests

5 participants