Where is the server

[hassanzadeh]

Hey Guys, Question, so how is the executable server created? Is it done by llama.cpp project?

[psugihara]

Yes, the server is llama.cpp/examples/server running on localhost.

I make a universal binary by compiling it on an arm and intel machine then combining them with: lipo -create server server_x86 -output freechat-server

[hassanzadeh]

Interesting when you say compile, you mean running "make -j +[arch related args]" in llama.cpp ?

[psugihara]

yes but just "make"

[hassanzadeh]

Got it thanks, This is a really interesting work, Congrats!