search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Build failed on macOS with concedo_experimental branch #915

Closed beebopkim closed 2 weeks ago

beebopkim commented 3 weeks ago

Commit hash: 4fddbab0248cfda4ae3852e3448483de2f250c88

Build log:

koboldcpp_dev % LLAMA_METAL=1 make
I llama.cpp build info: 
I UNAME_S:  Darwin
I UNAME_P:  arm
I UNAME_M:  arm64
I CFLAGS:   -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./include/vulkan -O3 -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG
I CXXFLAGS: -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./include/vulkan -O3 -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL
I LDFLAGS:   -ld_classic -framework Accelerate -framework Foundation -framework Metal -framework MetalKit -framework MetalPerformanceShaders
I CC:       Apple clang version 15.0.0 (clang-1500.3.9.4)
I CXX:      Apple clang version 15.0.0 (clang-1500.3.9.4)

Makefile:277: warning: overriding commands for target `ggml-metal.o'
/Users/******/test/koboldcpp_dev/Makefile.local:264: warning: ignoring old commands for target `ggml-metal.o'
I llama.cpp build info: 
I UNAME_S:  Darwin
I UNAME_P:  arm
I UNAME_M:  arm64
I CFLAGS:   -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL
I CXXFLAGS: -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL
I LDFLAGS:   -ld_classic -framework Accelerate -framework Foundation -framework Metal -framework MetalKit -framework MetalPerformanceShaders
I CC:       Apple clang version 15.0.0 (clang-1500.3.9.4)
I CXX:      Apple clang version 15.0.0 (clang-1500.3.9.4)

Makefile:398: warning: overriding commands for target `ggml.o'
/Users/******/test/koboldcpp_dev/Makefile.local:383: warning: ignoring old commands for target `ggml.o'
Makefile:400: warning: overriding commands for target `ggml_v4_openblas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:385: warning: ignoring old commands for target `ggml_v4_openblas.o'
Makefile:402: warning: overriding commands for target `ggml_v4_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:387: warning: ignoring old commands for target `ggml_v4_failsafe.o'
Makefile:404: warning: overriding commands for target `ggml_v4_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:389: warning: ignoring old commands for target `ggml_v4_noavx2.o'
Makefile:406: warning: overriding commands for target `ggml_v4_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:391: warning: ignoring old commands for target `ggml_v4_clblast.o'
Makefile:408: warning: overriding commands for target `ggml_v4_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:393: warning: ignoring old commands for target `ggml_v4_cublas.o'
Makefile:410: warning: overriding commands for target `ggml_v4_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:395: warning: ignoring old commands for target `ggml_v4_clblast_noavx2.o'
Makefile:412: warning: overriding commands for target `ggml_v4_vulkan.o'
/Users/******/test/koboldcpp_dev/Makefile.local:397: warning: ignoring old commands for target `ggml_v4_vulkan.o'
Makefile:418: warning: overriding commands for target `ggml-quants.o'
/Users/******/test/koboldcpp_dev/Makefile.local:401: warning: ignoring old commands for target `ggml-quants.o'
Makefile:420: warning: overriding commands for target `ggml-quants_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:403: warning: ignoring old commands for target `ggml-quants_noavx2.o'
Makefile:422: warning: overriding commands for target `ggml-quants_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:405: warning: ignoring old commands for target `ggml-quants_failsafe.o'
Makefile:434: warning: overriding commands for target `ggml-alloc.o'
/Users/******/test/koboldcpp_dev/Makefile.local:410: warning: ignoring old commands for target `ggml-alloc.o'
Makefile:456: warning: overriding commands for target `ggml_v3.o'
/Users/******/test/koboldcpp_dev/Makefile.local:416: warning: ignoring old commands for target `ggml_v3.o'
Makefile:458: warning: overriding commands for target `ggml_v3_openblas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:418: warning: ignoring old commands for target `ggml_v3_openblas.o'
Makefile:460: warning: overriding commands for target `ggml_v3_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:420: warning: ignoring old commands for target `ggml_v3_failsafe.o'
Makefile:462: warning: overriding commands for target `ggml_v3_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:422: warning: ignoring old commands for target `ggml_v3_noavx2.o'
Makefile:464: warning: overriding commands for target `ggml_v3_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:424: warning: ignoring old commands for target `ggml_v3_clblast.o'
Makefile:466: warning: overriding commands for target `ggml_v3_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:426: warning: ignoring old commands for target `ggml_v3_cublas.o'
Makefile:468: warning: overriding commands for target `ggml_v3_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:428: warning: ignoring old commands for target `ggml_v3_clblast_noavx2.o'
Makefile:472: warning: overriding commands for target `ggml_v2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:432: warning: ignoring old commands for target `ggml_v2.o'
Makefile:474: warning: overriding commands for target `ggml_v2_openblas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:434: warning: ignoring old commands for target `ggml_v2_openblas.o'
Makefile:476: warning: overriding commands for target `ggml_v2_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:436: warning: ignoring old commands for target `ggml_v2_failsafe.o'
Makefile:478: warning: overriding commands for target `ggml_v2_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:438: warning: ignoring old commands for target `ggml_v2_noavx2.o'
Makefile:480: warning: overriding commands for target `ggml_v2_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:440: warning: ignoring old commands for target `ggml_v2_clblast.o'
Makefile:482: warning: overriding commands for target `ggml_v2_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:442: warning: ignoring old commands for target `ggml_v2_cublas.o'
Makefile:484: warning: overriding commands for target `ggml_v2_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:444: warning: ignoring old commands for target `ggml_v2_clblast_noavx2.o'
Makefile:488: warning: overriding commands for target `ggml_v1.o'
/Users/******/test/koboldcpp_dev/Makefile.local:448: warning: ignoring old commands for target `ggml_v1.o'
Makefile:490: warning: overriding commands for target `ggml_v1_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:450: warning: ignoring old commands for target `ggml_v1_failsafe.o'
Makefile:494: warning: overriding commands for target `ggml-opencl.o'
/Users/******/test/koboldcpp_dev/Makefile.local:454: warning: ignoring old commands for target `ggml-opencl.o'
Makefile:496: warning: overriding commands for target `ggml_v2-opencl.o'
/Users/******/test/koboldcpp_dev/Makefile.local:456: warning: ignoring old commands for target `ggml_v2-opencl.o'
Makefile:498: warning: overriding commands for target `ggml_v2-opencl-legacy.o'
/Users/******/test/koboldcpp_dev/Makefile.local:458: warning: ignoring old commands for target `ggml_v2-opencl-legacy.o'
Makefile:500: warning: overriding commands for target `ggml_v3-opencl.o'
/Users/******/test/koboldcpp_dev/Makefile.local:460: warning: ignoring old commands for target `ggml_v3-opencl.o'
Makefile:504: warning: overriding commands for target `ggml-vulkan.o'
/Users/******/test/koboldcpp_dev/Makefile.local:464: warning: ignoring old commands for target `ggml-vulkan.o'
Makefile:508: warning: overriding commands for target `llama.o'
/Users/******/test/koboldcpp_dev/Makefile.local:468: warning: ignoring old commands for target `llama.o'
Makefile:510: warning: overriding commands for target `common.o'
/Users/******/test/koboldcpp_dev/Makefile.local:470: warning: ignoring old commands for target `common.o'
Makefile:514: warning: overriding commands for target `console.o'
/Users/******/test/koboldcpp_dev/Makefile.local:472: warning: ignoring old commands for target `console.o'
Makefile:516: warning: overriding commands for target `grammar-parser.o'
/Users/******/test/koboldcpp_dev/Makefile.local:474: warning: ignoring old commands for target `grammar-parser.o'
Makefile:518: warning: overriding commands for target `expose.o'
/Users/******/test/koboldcpp_dev/Makefile.local:476: warning: ignoring old commands for target `expose.o'
Makefile:535: warning: overriding commands for target `gpttype_adapter_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:481: warning: ignoring old commands for target `gpttype_adapter_failsafe.o'
Makefile:537: warning: overriding commands for target `gpttype_adapter.o'
/Users/******/test/koboldcpp_dev/Makefile.local:483: warning: ignoring old commands for target `gpttype_adapter.o'
Makefile:539: warning: overriding commands for target `gpttype_adapter_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:485: warning: ignoring old commands for target `gpttype_adapter_clblast.o'
Makefile:541: warning: overriding commands for target `gpttype_adapter_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:487: warning: ignoring old commands for target `gpttype_adapter_cublas.o'
Makefile:543: warning: overriding commands for target `gpttype_adapter_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:489: warning: ignoring old commands for target `gpttype_adapter_clblast_noavx2.o'
Makefile:545: warning: overriding commands for target `gpttype_adapter_vulkan.o'
/Users/******/test/koboldcpp_dev/Makefile.local:491: warning: ignoring old commands for target `gpttype_adapter_vulkan.o'
Makefile:550: warning: overriding commands for target `clean'
/Users/******/test/koboldcpp_dev/Makefile.local:494: warning: ignoring old commands for target `clean'
Makefile:556: warning: overriding commands for target `main'
/Users/******/test/koboldcpp_dev/Makefile.local:497: warning: ignoring old commands for target `main'
Makefile:565: warning: overriding commands for target `gguf'
/Users/******/test/koboldcpp_dev/Makefile.local:503: warning: ignoring old commands for target `gguf'
Makefile:572: warning: overriding commands for target `koboldcpp_default'
/Users/******/test/koboldcpp_dev/Makefile.local:508: warning: ignoring old commands for target `koboldcpp_default'
Makefile:576: warning: overriding commands for target `koboldcpp_openblas'
/Users/******/test/koboldcpp_dev/Makefile.local:512: warning: ignoring old commands for target `koboldcpp_openblas'
Makefile:587: warning: overriding commands for target `koboldcpp_failsafe'
/Users/******/test/koboldcpp_dev/Makefile.local:523: warning: ignoring old commands for target `koboldcpp_failsafe'
Makefile:595: warning: overriding commands for target `koboldcpp_noavx2'
/Users/******/test/koboldcpp_dev/Makefile.local:531: warning: ignoring old commands for target `koboldcpp_noavx2'
Makefile:610: warning: overriding commands for target `koboldcpp_clblast'
/Users/******/test/koboldcpp_dev/Makefile.local:546: warning: ignoring old commands for target `koboldcpp_clblast'
Makefile:612: warning: overriding commands for target `koboldcpp_clblast_noavx2'
/Users/******/test/koboldcpp_dev/Makefile.local:548: warning: ignoring old commands for target `koboldcpp_clblast_noavx2'
Makefile:620: warning: overriding commands for target `koboldcpp_cublas'
/Users/******/test/koboldcpp_dev/Makefile.local:556: warning: ignoring old commands for target `koboldcpp_cublas'
Makefile:628: warning: overriding commands for target `koboldcpp_hipblas'
/Users/******/test/koboldcpp_dev/Makefile.local:564: warning: ignoring old commands for target `koboldcpp_hipblas'
Makefile:643: warning: overriding commands for target `koboldcpp_vulkan'
/Users/******/test/koboldcpp_dev/Makefile.local:572: warning: ignoring old commands for target `koboldcpp_vulkan'
Makefile:652: warning: overriding commands for target `quantize_gptj'
/Users/******/test/koboldcpp_dev/Makefile.local:579: warning: ignoring old commands for target `quantize_gptj'
Makefile:654: warning: overriding commands for target `quantize_gpt2'
/Users/******/test/koboldcpp_dev/Makefile.local:581: warning: ignoring old commands for target `quantize_gpt2'
Makefile:656: warning: overriding commands for target `quantize_neox'
/Users/******/test/koboldcpp_dev/Makefile.local:583: warning: ignoring old commands for target `quantize_neox'
Makefile:658: warning: overriding commands for target `quantize_mpt'
/Users/******/test/koboldcpp_dev/Makefile.local:585: warning: ignoring old commands for target `quantize_mpt'
Makefile:664: warning: overriding commands for target `simpleclinfo'
/Users/******/test/koboldcpp_dev/Makefile.local:589: warning: ignoring old commands for target `simpleclinfo'
Makefile:667: warning: overriding commands for target `build-info.h'
/Users/******/test/koboldcpp_dev/Makefile.local:593: warning: ignoring old commands for target `build-info.h'
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c ggml.c -o ggml.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c otherarch/ggml_v3.c -o ggml_v3.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c otherarch/ggml_v2.c -o ggml_v2.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c otherarch/ggml_v1.c -o ggml_v1.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c expose.cpp -o expose.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
expose.cpp:208:24: warning: 'generate' has C-linkage specified, but returns user-defined type 'generation_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    generation_outputs generate(const generation_inputs inputs)
                       ^
expose.cpp:217:27: warning: 'sd_generate' has C-linkage specified, but returns user-defined type 'sd_generation_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    sd_generation_outputs sd_generate(const sd_generation_inputs inputs)
                          ^
expose.cpp:226:32: warning: 'whisper_generate' has C-linkage specified, but returns user-defined type 'whisper_generation_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    whisper_generation_outputs whisper_generate(const whisper_generation_inputs inputs)
                               ^
expose.cpp:278:25: warning: 'token_count' has C-linkage specified, but returns user-defined type 'token_count_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    token_count_outputs token_count(const char * input, bool addbos)
                        ^
4 warnings generated.
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c gpttype_adapter.cpp -o gpttype_adapter.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
In file included from gpttype_adapter.cpp:18:
In file included from ./otherarch/llama_v2.cpp:9:
./otherarch/llama_v2.h:171:33: warning: 'legacy_llama_v2_tokenize' has C-linkage specified, but returns user-defined type 'std::vector<llama_v2_token>' (aka 'vector<int>') which is incompatible with C [-Wreturn-type-c-linkage]
    std::vector<llama_v2_token> legacy_llama_v2_tokenize(struct llama_v2_context * ctx, const std::string & text, bool add_bos);
                                ^
In file included from gpttype_adapter.cpp:23:
./otherarch/gptj_v2.cpp:298:52: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                   ^~~~~~~~~~~~~
./otherarch/gptj_v2.cpp:298:67: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                                  ^~~~~~~~~~~~~
In file included from gpttype_adapter.cpp:24:
./otherarch/gptj_v3.cpp:308:52: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                   ^~~~~~~~~~~~~
./otherarch/gptj_v3.cpp:308:67: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                                  ^~~~~~~~~~~~~
In file included from gpttype_adapter.cpp:26:
./otherarch/gpt2_v2.cpp:291:48: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                        __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                               ^~~~~~~~~~~~~
./otherarch/gpt2_v2.cpp:291:63: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                        __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                              ^~~~~~~~~~~~~
In file included from gpttype_adapter.cpp:28:
./otherarch/rwkv_v2.cpp:370:103: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    RWKV_V2_ASSERT_NULL(emb->ne[0] == model->n_embed, "Unexpected dimension of embedding matrix %ld", emb->ne[0]);
                                                                                                ~~~   ^~~~~~~~~~
                                                                                                %lld
./otherarch/rwkv_v2.cpp:39:29: note: expanded from macro 'RWKV_V2_ASSERT_NULL'
            fprintf(stderr, __VA_ARGS__); \
                            ^~~~~~~~~~~
./otherarch/rwkv_v2.cpp:371:103: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    RWKV_V2_ASSERT_NULL(emb->ne[1] == model->n_vocab, "Unexpected dimension of embedding matrix %ld", emb->ne[1]);
                                                                                                ~~~   ^~~~~~~~~~
                                                                                                %lld
./otherarch/rwkv_v2.cpp:39:29: note: expanded from macro 'RWKV_V2_ASSERT_NULL'
            fprintf(stderr, __VA_ARGS__); \
                            ^~~~~~~~~~~
9 warnings generated.
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c otherarch/sdcpp/sdtype_adapter.cpp -o sdcpp_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
In file included from otherarch/sdcpp/sdtype_adapter.cpp:15:
In file included from ./otherarch/sdcpp/stable-diffusion.cpp:1:
./otherarch/sdcpp/ggml_extend.hpp:84:43: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                  ~~~                     ^~~~~~~~~~~~~
                  %lld
./otherarch/sdcpp/ggml_extend.hpp:84:58: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                       ~~~                               ^~~~~~~~~~~~~
                       %lld
./otherarch/sdcpp/ggml_extend.hpp:84:73: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                            ~~~                                         ^~~~~~~~~~~~~
                            %lld
./otherarch/sdcpp/ggml_extend.hpp:84:88: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                                 ~~~                                                   ^~~~~~~~~~~~~
                                 %lld
In file included from otherarch/sdcpp/sdtype_adapter.cpp:15:
In file included from ./otherarch/sdcpp/stable-diffusion.cpp:14:
./otherarch/sdcpp/tae.hpp:194:17: warning: field 'decode_only' is uninitialized when used here [-Wuninitialized]
          taesd(decode_only),
                ^
In file included from otherarch/sdcpp/sdtype_adapter.cpp:34:
./otherarch/sdcpp/thirdparty/stb_image_resize.h:760:31: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(scale <= 1);
                        ~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:778:31: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(scale <= 1);
                        ~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1041:56: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(in_last_pixel - in_first_pixel <= (int)ceil(stbir__filter_info_table[filter].support(1/scale) * 2)); // Taken directly from stbir__get_coefficient_width() which we can't call because we don't know if we're horizontal or vertical.
                        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1046:41: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(contributor->n1 >= contributor->n0);
                        ~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1064:128: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(stbir__filter_info_table[filter].kernel((float)(in_last_pixel + 1) + 0.5f - in_center_of_out, 1/scale) == 0);
                        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1066:38: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(total_filter > 0.9);
                        ~~~~~~~~~~~~ ^ ~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1067:38: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(total_filter < 1.1f); // Make sure it's not way off.
                        ~~~~~~~~~~~~ ^ ~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1089:59: warning: expression result unused [-Wunused-value]
     STBIR__DEBUG_ASSERT(out_last_pixel - out_first_pixel <= (int)ceil(stbir__filter_info_table[filter].support(scale_ratio) * 2)); // Taken directly from stbir__get_coefficient_width() which we can't call because we don't know if we're horizontal or vertical.
                         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1094:41: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(contributor->n1 >= contributor->n0);
                        ~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1103:133: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(stbir__filter_info_table[filter].kernel((float)(out_last_pixel + 1) + 0.5f - out_center_of_in, scale_ratio) == 0);
                        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1138:35: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(total > 0.9f);
                            ~~~~~ ^ ~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1139:35: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(total < 1.1f);
                            ~~~~~ ^ ~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1427:47: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(ring_buffer_index != stbir_info->ring_buffer_begin_index);
                            ~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1459:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n1 >= n0);
                            ~~ ^  ~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1460:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n0 >= -stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1461:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n1 >= -stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1462:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n0 < stbir_info->input_w + stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1463:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n1 < stbir_info->input_w + stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1471:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1480:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1490:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1501:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1514:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1537:25: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(!stbir__use_width_upsampling(stbir_info));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1555:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1576:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1598:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1621:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1646:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2005:25: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(!stbir__use_height_upsampling(stbir_info));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2079:66: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(in_last_scanline - in_first_scanline <= stbir_info->vertical_filter_pixel_width);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2171:25: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(!stbir__use_height_upsampling(stbir_info));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2180:68: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(out_last_scanline - out_first_scanline <= stbir_info->vertical_filter_pixel_width);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2382:92: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT((size_t)STBIR__NEXT_MEMPTR(info->encode_buffer, unsigned char) == (size_t)tempmem + tempmem_size_in_bytes);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2390:90: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT((size_t)STBIR__NEXT_MEMPTR(info->ring_buffer, unsigned char) == (size_t)tempmem + tempmem_size_in_bytes);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
otherarch/sdcpp/sdtype_adapter.cpp:267:73: warning: result of comparison of constant 244 with expression of type 'char' is always true [-Wtautological-constant-out-of-range-compare]
        if (static_cast<unsigned char>(ch) <= 0x7F || (ch >= 0xC2 && ch <= 0xF4)) {
                                                                     ~~ ^  ~~~~
otherarch/sdcpp/sdtype_adapter.cpp:267:59: warning: result of comparison of constant 194 with expression of type 'char' is always false [-Wtautological-constant-out-of-range-compare]
        if (static_cast<unsigned char>(ch) <= 0x7F || (ch >= 0xC2 && ch <= 0xF4)) {
                                                       ~~ ^  ~~~~
42 warnings generated.
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c otherarch/whispercpp/whisper_adapter.cpp -o whispercpp_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c examples/llava/clip.cpp -o llavaclip_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c examples/llava/llava.cpp -o llava.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-backend.c -o ggml-backend_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-alloc.c -o ggml-alloc.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c ggml-quants.c -o ggml-quants.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c unicode.cpp -o unicode.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c unicode-data.cpp -o unicode-data.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL  -c sgemm.cpp -o sgemm.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c common/common.cpp -o common.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c common/sampling.cpp -o sampling.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c common/grammar-parser.cpp -o grammar-parser.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
== Preparing merged Metal file ==
cc -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-metal.m -o ggml-metal.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-backend.c -o ggml-backend.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL  ggml.o ggml_v3.o ggml_v2.o ggml_v1.o expose.o gpttype_adapter.o sdcpp_default.o whispercpp_default.o llavaclip_default.o llava.o ggml-backend_default.o ggml-alloc.o ggml-quants.o unicode.o unicode-data.o sgemm.o common.o sampling.o grammar-parser.o ggml-metal.o ggml-backend.o -shared -o koboldcpp_default.so  -ld_classic -framework Accelerate -framework Foundation -framework Metal -framework MetalKit -framework MetalPerformanceShaders
ld: warning: -s is obsolete
ld: warning: option -s is obsolete and being ignored
duplicate symbol '_ggml_backend_tensor_copy' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_copy' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_new' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_new' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_is_cpu' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_is_host' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_is_host' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_get_count' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_get_alignment' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_alignment' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_get_alignment' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_view_init' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_init' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_init' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_wait' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_reset' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_reset' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_set' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_get' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_n_splits' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_n_copies' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_set_n_threads' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_init_backend_from_str' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_buffer_from_ptr' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_copy_tensor' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_init_tensor' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_register' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_is_multi_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_multi_buffer_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_clear' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_supports_op' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_offload_op' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_set_abort_callback' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_set_eval_callback' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_alloc_graph' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_get_max_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_max_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_get_max_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_buffer_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_get_alloc_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_alloc_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_synchronize' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_synchronize' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_synchronize' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_reserve' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_plan_compute' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_compute' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_graph_compute' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_plan_create' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_base' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_buffer_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_get_default_buffer_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_get_default_buffer_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_find_by_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_get_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_multi_buffer_set_usage' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_set_usage' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_copy_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_plan_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_record' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_init_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_supports_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_set_tensor_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_tensor_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_compare_graph_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_guid' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_alloc' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_copy_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_set_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_get_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_compute_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_graph_compute_async' in:
    ggml-backend_default.o
    ggml-backend.o
ld: 84 duplicate symbols for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [koboldcpp_default] Error 1
koboldcpp_dev %

Same error was happend with LLAMA_METAL=1 make koboldcpp_default too.

beebopkim commented 2 weeks ago

Oh my bad. This is my fault. I happened to create a backup file called Makefile.local a while ago, but it was so old that I forgot about it, and it became a problem this time.

LostRuins commented 2 weeks ago

Ah alright. This was probably triggered because of https://github.com/LostRuins/koboldcpp/pull/896

Is it working fine for you now then?

LostRuins commented 2 weeks ago

Hi @beebopkim , could I trouble you to see if the latest concedo_experimental builds and works on macOS with both regular Accelerate and also LLAMA_METAL=1?

llama.cpp recently restructured openblas/accelerate out to a different backend, and also removed clblast in https://github.com/ggerganov/llama.cpp/pull/7735, so I've had to do a little bit of changes myself to preserve CLBlast. Just want to confirm that I didn't accidentally break macOS builds in the process.

beebopkim commented 2 weeks ago

I have no problems now. I renamed the backup in Makefile and the problem went away. There is no problem building with LLAMA_METAL=1 on macOS.

LostRuins commented 1 week ago

okay great, that means the Accelerate refactor works