I trained the model from scratch with one of my dataset. When I perform the inference, the actual call takes around 23ms. Why is it so slow? BisNet runs with 9ms. GPU is a Titan RTX.
Code snippet:
model.eval()
with torch.no_grad():
t = time.time()
pr_mask = model.forward(x_tensor)
print(time.time() - t)
x_tensor.shape is torch.Size([1, 3, 2080, 2464])
Hi all,
I trained the model from scratch with one of my dataset. When I perform the inference, the actual call takes around 23ms. Why is it so slow? BisNet runs with 9ms. GPU is a Titan RTX.
Code snippet:
Thank you in advance.