Open saeid93 opened 1 month ago
I am also facing the same error on windows, I followed the step by step from readme but on make chat -j gives me error
(TinyChatEngine) C:\Users\linuxdev\Desktop\Projects\TinyChatEngine\llm>gcc --version gcc (Rev6, Built by MSYS2 project) 13.2.0 Copyright (C) 2023 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
(TinyChatEngine) C:\Users\linuxdev\Desktop\Projects\TinyChatEngine\llm>make chat -j The system cannot find the path specified. CUDA is unavailable! process_begin: CreateProcess(NULL, uname -m, ...) failed. Makefile:72: pipe: Bad file descriptor process_begin: CreateProcess(NULL, uname -m, ...) failed. Makefile:90: pipe: Bad file descriptor process_begin: CreateProcess(NULL, uname -p, ...) failed. Makefile:102: pipe: Bad file descriptor src/GPTBigCodeGenerate.cc src/GPTBigCodeTokenizer.cc src/Generate.cc src/LLaMATokenizer.cc src/OPTGenerate.cc src/OPTTokenizer.cc src/interface.cc src/utils.cc src/nn_modules/Fp32CLIPAttention.cc src/nn_modules/Fp32CLIPEncoder.cc src/nn_modules/Fp32CLIPEncoderLayer.cc src/nn_modules/Fp32CLIPVisionTransformer.cc src/nn_modules/Fp32GPTBigCodeAttention.cc src/nn_modules/Fp32GPTBigCodeDecoder.cc src/nn_modules/Fp32GPTBigCodeDecoderLayer.cc src/nn_modules/Fp32GPTBigCodeForCausalLM.cc src/nn_modules/Fp32OPTAttention.cc src/nn_modules/Fp32OPTDecoder.cc src/nn_modules/Fp32OPTDecoderLayer.cc src/nn_modules/Fp32OPTForCausalLM.cc src/nn_modules/Fp32llamaAttention.cc src/nn_modules/Fp32llamaDecoder.cc src/nn_modules/Fp32llamaDecoderLayer.cc src/nn_modules/Fp32llamaForCausalLM.cc src/nn_modules/Int4GPTBigCodeAttention.cc src/nn_modules/Int4GPTBigCodeDecoder.cc src/nn_modules/Int4GPTBigCodeDecoderLayer.cc src/nn_modules/Int4GPTBigCodeForCausalLM.cc src/nn_modules/Int4OPTAttention.cc src/nn_modules/Int4OPTDecoder.cc src/nn_modules/Int4OPTDecoderLayer.cc src/nn_modules/Int4OPTForCausalLM.cc src/nn_modules/Int8OPTAttention.cc src/nn_modules/Int8OPTDecoder.cc src/nn_modules/Int8OPTDecoderLayer.cc src/nn_modules/MistralGenerate.cc src/nn_modules/OPTForCausalLM.cc src/ops/BMM_F32T.cc src/ops/BMM_S8T_S8N_F32T.cc src/ops/BMM_S8T_S8N_S8T.cc src/ops/Conv2D.cc src/ops/Gelu.cc src/ops/LayerNorm.cc src/ops/LayerNormQ.cc src/ops/LlamaRMSNorm.cc src/ops/RotaryPosEmb.cc src/ops/W8A8B8O8Linear.cc src/ops/W8A8B8O8LinearReLU.cc src/ops/W8A8BFP32OFP32Linear.cc src/ops/arg_max.cc src/ops/batch_add.cc src/ops/embedding.cc src/ops/linear.cc src/ops/softmax.cc ../kernels/matmul_imp.cc ../kernels/matmul_int4.cc ../kernels/matmul_int8.cc ../kernels/pthread_pool.cc src/nn_modules/non_cuda/Int4llamaAttention.cc src/nn_modules/non_cuda/Int4llamaDecoder.cc src/nn_modules/non_cuda/Int4llamaDecoderLayer.cc src/nn_modules/non_cuda/Int4llamaForCausalLM.cc src/nn_modules/non_cuda/LLaMA3Generate.cc src/nn_modules/non_cuda/LLaMAGenerate.cc src/nn_modules/non_cuda/LLaVAGenerate.cc ../kernels/ref/matmul_ref_fp32.cc ../kernels/ref/matmul_ref_int4.cc ../kernels/ref/matmul_ref_int8.cc The syntax of the command is incorrect. make: [Makefile:180: build/transformer/src/GPTBigCodeGenerate.o] Error 1 make: Waiting for unfinished jobs.... The syntax of the command is incorrect. make: *** [Makefile:180: build/transformer/src/GPTBigCodeTokenizer.o] Error 1
Follwoing the documentation using:
I get the following error:
Could you please let me know what I might be doing wrong here?