Skip to content

Commit 01245f5

Browse files
foldlJudd
and
Judd
authored
llama : fix order of parameters (#8706)
usage of `aclrtGetMemInfo` is correct: https://www.hiascend.com/doc_center/source/zh/canncommercial/63RC2/inferapplicationdev/aclcppdevg/aclcppdevg_03_0103.html Co-authored-by: Judd <foldl@boxvest.com>
1 parent 01aec4a commit 01245f5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama.cpp

+1-1
Original file line numberDiff line numberDiff line change
@@ -2905,7 +2905,7 @@ static size_t llama_get_device_memory(const llama_model & model, int device) {
29052905
#elif defined(GGML_USE_CANN)
29062906
size_t total;
29072907
size_t free;
2908-
ggml_backend_cann_get_device_memory(device, &total, &free);
2908+
ggml_backend_cann_get_device_memory(device, &free, &total);
29092909
return free;
29102910
#else
29112911
return 1;

0 commit comments

Comments
 (0)