antimatter15 / alpaca.cpp

Locally run an Instruction-Tuned Chat-Style LLM
MIT License
10.25k stars 907 forks source link

It Just kind of does nothing. #46

Open Baggette opened 1 year ago

Baggette commented 1 year ago

image After running the command it loads the model and then does nothing and exits. Not sure what the issue is

Baggette commented 1 year ago

even if I build from source the same thing happens

envyvan commented 1 year ago

image Me too, seems like same as you are. I'm using win10

simple6502 commented 1 year ago

image Same issue here, I am also using Windows 10

envyvan commented 1 year ago

Hmm. Seems like I get some compile error with Cmake. I can run the chat on linux with no error with my laptop.

PS C:\llama\alpaca.cpp> cmake . -- Building for: Visual Studio 16 2019 -- Selecting Windows SDK version 10.0.19041.0 to target Windows 10.0.19045. -- The C compiler identification is MSVC 19.29.30146.0 -- The CXX compiler identification is MSVC 19.29.30146.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/BuildTools/VC/Tools/MSVC/14.29.30133/bin/Hostx64/x64/cl.exe - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/BuildTools/VC/Tools/MSVC/14.29.30133/bin/Hostx64/x64/cl.exe - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- CMAKE_SYSTEM_PROCESSOR: AMD64 -- x86 detected -- Configuring done (6.0s) -- Generating done (0.1s) -- Build files have been written to: C:/llama/alpaca.cpp PS C:\llama\alpaca.cpp> cmake --build . --config Release 用于 .NET Framework 的 Microsoft (R) 生成引擎版本 16.11.2+f32259642 版权所有(C) Microsoft Corporation。保留所有权利。

Checking Build System Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt ggml.c C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\um\winbase.h(9531,5): warning C5105: 生成“已定义”的宏扩展具有未定义的行为 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(413,13): warning C4101: “pp”: 未引用的局部变量 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(637,1): warning C4244: “初始化”: 从“double”转换到“const uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(638,1): warning C4244: “初始化”: 从“double”转换到“const uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1257,14): warning C4244: “=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1293,14): warning C4244: “=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1679,23): warning C4244: “=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1904,125): warning C4244: “=”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1906,127): warning C4244: “=”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1916,72): warning C4244: “return”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1945,29): warning C4244: “return”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1978,13): warning C4244: “=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1990,10): warning C4244: “=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(1996,125): warning C4244: “=”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2390,37): warning C4244: “函数”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2750,71): warning C4244: “函数”: 从“int32_t”转换到“const float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2782,71): warning C4244: “函数”: 从“float”转换到“const int8_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2789,73): warning C4244: “函数”: 从“float”转换到“const int16_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2796,73): warning C4244: “函数”: 从“float”转换到“const int32_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2803,77): warning C4244: “函数”: 从“float”转换到“const int32_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2850,77): warning C4244: “return”: 从“float”转换到“int32_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2855,52): warning C4244: “return”: 从“float”转换到“int32_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2863,16): warning C4244: “return”: 从“float”转换到“int32_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2894,54): warning C4244: “函数”: 从“int32_t”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2899,53): warning C4244: “=”: 从“int32_t”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2931,54): warning C4244: “return”: 从“int32_t”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2965,54): warning C4244: “=”: 从“float”转换到“int8_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2970,55): warning C4244: “=”: 从“float”转换到“int16_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(2975,55): warning C4244: “=”: 从“float”转换到“int32_t”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(3933,25): warning C4267: “=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(3934,25): warning C4267: “=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(3935,25): warning C4267: “=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(3936,25): warning C4267: “=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5410,31): warning C4244: “=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5414,1): warning C4244: “初始化”: 从“double”转换到“const float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5494,1): warning C4244: “初始化”: 从“double”转换到“const float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5576,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5577,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5578,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5579,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5581,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5582,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5583,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5584,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5586,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5587,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5588,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5589,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5751,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5821,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5822,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5823,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5824,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5826,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5827,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5828,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5829,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5831,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5832,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5833,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(5834,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6056,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6127,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6128,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6129,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6130,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6132,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6133,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6134,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6135,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6137,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6138,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6139,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6140,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6356,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6427,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6428,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6429,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6430,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6432,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6433,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6434,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6435,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6437,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6438,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6439,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6440,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(6656,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7157,38): warning C4244: “函数”: 从“ggml_float”转换到“const float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7241,62): warning C4244: “=”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7242,62): warning C4244: “=”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7214,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7215,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7216,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7217,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7297,80): warning C4244: “函数”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7298,80): warning C4244: “函数”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7271,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7272,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7273,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7274,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7361,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7362,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7363,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7366,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7367,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7372,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7481,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7482,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7483,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7486,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7487,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7492,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7629,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7630,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7631,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7634,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7635,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7640,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7749,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7750,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7751,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7754,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7755,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7760,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8046,35): warning C4244: “+=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8053,26): warning C4244: “=”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7899,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7900,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7901,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7902,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7904,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7905,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7906,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7907,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7909,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7910,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7911,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7912,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7914,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7915,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7916,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7917,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(7971,1): warning C4244: “初始化”: 从“double”转换到“const float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8272,35): warning C4244: “+=”: 从“ggml_float”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8279,26): warning C4244: “=”: 从“double”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8108,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8109,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8110,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8111,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8113,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8114,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8115,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8116,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8118,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8119,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8120,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8121,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8123,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8124,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8125,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8126,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8180,1): warning C4244: “初始化”: 从“double”转换到“const float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8395,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8396,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8397,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8398,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8400,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8401,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8402,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8403,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8405,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8410,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8411,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8412,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8413,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8415,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8420,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8421,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8422,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(8423,1): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(9498,83): warning C4267: “函数”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(9763,17): warning C4996: 'fopen': This function or variable may be unsafe. Consider using fopen_s instead. To disable deprecation, us e _CRT_SECURE_NO_WARNINGS. See online help for details. [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(10018,71): warning C4244: “函数”: 从“int”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] C:\llama\alpaca.cpp\ggml.c(10019,71): warning C4244: “函数”: 从“int”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj] ggml.vcxproj -> C:\llama\alpaca.cpp\Release\ggml.lib Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt chat.cpp C:\llama\alpaca.cpp\chat.cpp(202,58): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(204,58): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(206,58): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(208,68): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(210,67): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(211,67): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(212,67): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(213,67): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(215,68): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(217,65): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(218,65): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(219,65): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(221,72): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(222,72): warning C4244: “+=”: 从“float”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(540,34): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(540,34): warning C4267: “初始化”: 从“size_t”转换到“const int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(559,40): warning C4244: “初始化”: 从“double”转换到“size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(559,35): warning C4244: “初始化”: 从“double”转换到“const size_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(813,27): warning C4244: “=”: 从“time_t”转换到“int32_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(933,65): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(962,30): warning C4267: “+=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(967,39): warning C4244: “初始化”: 从“int32_t”转换到“float”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(967,31): warning C4244: “初始化”: 从“int32_t”转换到“const float”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(979,128): warning C4244: “参数”: 从“const float”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(1034,49): warning C4267: “=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(1068,98): warning C4267: “-=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(1047,25): warning C4996: 'scanf': This function or variable may be unsafe. Consider using scanf_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\chat.cpp(1049,29): warning C4996: 'scanf': This function or variable may be unsafe. Consider using scanf_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [C:\llama\alpaca.cpp\chat.vcxproj] utils.cpp C:\llama\alpaca.cpp\utils.cpp(160,28): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(248,28): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(285,28): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(297,62): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(319,28): warning C4267: “-=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(373,44): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(545,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(545,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(546,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] C:\llama\alpaca.cpp\utils.cpp(546,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj] 正在生成代码... chat.vcxproj -> C:\llama\alpaca.cpp\Release\chat.exe Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt quantize.cpp utils.cpp C:\llama\alpaca.cpp\utils.cpp(160,28): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(248,28): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(285,28): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(297,62): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(319,28): warning C4267: “-=”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(373,44): warning C4267: “初始化”: 从“size_t”转换到“int”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(545,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(545,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(546,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] C:\llama\alpaca.cpp\utils.cpp(546,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”,可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj] 正在生成代码... quantize.vcxproj -> C:\llama\alpaca.cpp\Release\quantize.exe Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt

siavashtest1 commented 1 year ago

I have the same issue

simple6502 commented 1 year ago

After some experimentation, on windows 11 it works out of the box, but not on windows 10, or at least the version that is running for me.

simple6502 commented 1 year ago

After some experimentation, on windows 11 it works out of the box, but not on windows 10, or at least the version that is running for me.

After looking into it more, I was using Windows 10 IoT Enterprise LTSC so most likely there is something that the OS might not have compared to newer versions of Windows 10 & 11 because of it being in a long term support channel, not sure what it is exactly.

liulirun commented 1 year ago

same issue here, windows 10

ZanziPanzi commented 1 year ago

Had a same issue on Intel 2600k CPU.

Found reason in Win10 events: CPU doesn't support AVX2 instructions. Changed CMakeLists.txt to use AVX only instructions in section:

if (${CMAKE_SYSTEM_PROCESSOR} MATCHES "arm" OR ${CMAKE_SYSTEM_PROCESSOR} MATCHES "aarch64")
    message(STATUS "ARM detected")
else()
    message(STATUS "x86 detected")
    if (MSVC)
        set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /arch:AVX") # Changed to AVX
        set(CMAKE_CXX_FLAGS_RELEASE "${CMAKE_CXX_FLAGS_RELEASE} /arch:AVX") # Changed to AVX
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} /arch:AVX") # Changed to AVX
    else()
        if(NOT LLAMA_NO_AVX)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx")
        endif()
        if(NOT LLAMA_NO_AVX2)
            # set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx2") # Commented string
        endif()
        if(NOT LLAMA_NO_FMA)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mfma")
        endif()
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mf16c")
    endif()
endif()

Recompiled project. Now all works.

liulirun commented 1 year ago

Had a same issue on Intel 2600k CPU.

Found reason in Win10 events: CPU doesn't support AVX2 instructions. Changed CMakeLists.txt to use AVX only instructions in section:

if (${CMAKE_SYSTEM_PROCESSOR} MATCHES "arm" OR ${CMAKE_SYSTEM_PROCESSOR} MATCHES "aarch64")
    message(STATUS "ARM detected")
else()
    message(STATUS "x86 detected")
    if (MSVC)
        set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /arch:AVX") # Changed to AVX
        set(CMAKE_CXX_FLAGS_RELEASE "${CMAKE_CXX_FLAGS_RELEASE} /arch:AVX") # Changed to AVX
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} /arch:AVX") # Changed to AVX
    else()
        if(NOT LLAMA_NO_AVX)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx")
        endif()
        if(NOT LLAMA_NO_AVX2)
            # set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx2") # Commented string
        endif()
        if(NOT LLAMA_NO_FMA)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mfma")
        endif()
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mf16c")
    endif()
endif()

Recompiled project. Now all works.

This solution works for me. but interactive chat speed is really slow though.. type "give me python script example", takes more than 3 mins to responde

ZanziPanzi commented 1 year ago

This solution works for me. but interactive chat speed is really slow though.. type "give me python script example", takes more than 3 mins to responde

Yeah, same for me. I will try to use different compiler options, and reply if will find solution for speed. But it's seems like the code speed depends on AVX2 instructions, so maybe there is no solutions for old CPU's.

liulirun commented 1 year ago

Yeah, same for me. I will try to use different compiler options, and reply if will find solution for speed. But it's seems like the code speed depends on AVX2 instructions, so maybe there is no solutions for old CPU's.

thanks for the update, @ZanziPanzi

GrahamboJangles commented 1 year ago

This problem occurs for me sometimes if I overload the program with too high parameters. It may be your system isn't powerful enough. Try lowering the default launch options, like the --ctx_size, or the --batch_size. You can also try allocating more threads with --threads

8bit-coder commented 1 year ago

Weird thing is I have an i7-3770, and it supports AVX2. So why is mine having the same issue?

ZanziPanzi commented 1 year ago

Weird thing is I have an i7-3770, and it supports AVX2. So why is mine having the same issue?

Your CPU doesn't support AVX2 instructions (you have only AVX). AVX2 instructions in Intel CPUs started from Haswell microarchitecture (i7-4770 for example first series that supported AVX2).

ZanziPanzi commented 1 year ago

I haven't found solution for speed on CPU without AVX2. Saw posts that AVX2 really important for it, rebuilding my system to i7-13700k + a lot of RAM. It's funny to play with it, want to continue. Mine 2600k is still great at work and before this moment I didn't have reason for upgrade.

The time has come.

8bit-coder commented 1 year ago

Yeah after my (admittedly dumb) contribution to this, I tried recompiling but without AVX2 and it works! Just . . . veeery slowly. I'm doing research right now on if SSE3 being enabled helps at all, but so far anything related to SSE in the CMakeLists.txt does nothing so I'm doing more testing.

GrahamboJangles commented 1 year ago

Just use https://github.com/ggerganov/llama.cpp/releases the launch options work there. You have to use convert.py to convert the models but it works