Scheduler cannot find forward latency

uwsampl / nexus

Other

82 stars 22 forks source link

Scheduler cannot find forward latency #21

Open levulinh opened 3 years ago

levulinh commented 3 years ago

Hi, I followed the latest example to run Nexus on docker. However when I start the frontend, the scheduler collapsed and says "F0322 14:16:14.132954 14 model_db.cpp:96] Cannot find forward latency: model=tensorflow:resnet_0:1:224x224 batch=1". Detail in the images below.

Please help me with this, thank you.

levulinh commented 3 years ago

Not sure if it helps anyone but when I run it on a machine with GPU GTX 1080, the scheduler works fine and it found the batch size of 324 (I think). Before that, I ran it on GTX 1060 and it found the batch size of 0 so maybe that's reason why the schedule cannot load the model.