Closed iSach closed 6 months ago
Hi, it would have to be added to the linker flags, for example adding to the line
target_link_libraries(gemma hwy hwy_contrib sentencepiece)
in CMakeLists.txt, then rm -rf the build directory.
Hi, it would have to be added to the linker flags, for example adding to the line
target_link_libraries(gemma hwy hwy_contrib sentencepiece)
in CMakeLists.txt, then rm -rf the build directory.
Thank you for your answer. It worked! For those interested, here is the fixed line:
target_link_libraries(gemma hwy hwy_contrib sentencepiece "stdc++fs")
When running the model, I get the following error, do you know why?
Abort at /home/sach/llm/gemma.cpp/util/app.h:39: Assert 0 == sched_setaffinity(0, sizeof(cset), &cset)
[1] 1019925 abort (core dumped) ./gemma --tokenizer tokenizer.spm --model 2b-pt --compressed_weights 2b-pt.sb
I've correctly compiled for bfloat16 weights.
Glad to hear compiling works. Huh, I have not yet seen setaffinity fail, but it is possible. Do you have any cpushield or offline CPUs? What kind of platform/CPU is it? You can safely comment out the assert part, or even the entire line (assert+setaffinity).
I do this to solve:
Glad to hear compiling works. Huh, I have not yet seen setaffinity fail, but it is possible. Do you have any cpushield or offline CPUs? What kind of platform/CPU is it? You can safely comment out the assert part, or even the entire line (assert+setaffinity).
Thanks, it works perfectly without the assert.
This is a Slurm job instance, that might be why I guess! Thanks again for your help and time.
Glad to hear compiling works. Huh, I have not yet seen setaffinity fail, but it is possible. Do you have any cpushield or offline CPUs? What kind of platform/CPU is it? You can safely comment out the assert part, or even the entire line (assert+setaffinity).
Thanks, it works perfectly fine with the assert commented.
This is run within a Slurm job, which probably causes this, as it's restricted in terms of accessible CPUs?
Thanks for sharing. That makes sense, changing to an fprintf warning.
When compiling with
make -j4 gemma
, I get the following error.I am not sure how to fix this, I tried adding
-lsdtdc++fs
in CMakeCache.txt but it does not seem to have any effect, where should it be added?Thanks in advance.