traindb-project / traindb-ml

Remote ML Model Serving Component for TrainDB
Apache License 2.0
6 stars 2 forks source link

Threads hangs after training #33

Closed kihyuk-nam closed 2 years ago

kihyuk-nam commented 2 years ago

Ref: #30 #32

Server hangs when calling '/estimate' right after '/train'

The 'ps' of that moment shows dozens of main processes (main.py which started up the service) running in parallel.

Suspect that the multiprocessing(threading) mechanism of the learning process doesn't finish normally or conflicts with FastAPI.

Currently the main.py needs to be restarted after '/train' call.

issue_32

kihyuk-nam commented 2 years ago

moved to the traindb-model