search

skeskinen / bert.cpp

ggml implementation of BERT
MIT License
463 stars 58 forks source link

Is it possible to make multiple socket connection at the same time from same machine. #44

Open ZTAP0011 opened 7 months ago

ZTAP0011 commented 7 months ago

We ran one fast api on a machine on two different port. The API make socket connection to the bert.cpp socket server. In this only first app is connected and when second is started it just hangs after the socket.connect method. Is it possible to make multiple socket connection at the same time from same machine?

skeskinen commented 7 months ago

You need to have a new socket (and a thread) for each incoming connection.