i try model.half() and input.half() for speeding up the inference, the time decrease from 65ms to 53ms, although, it does not speed up too much, but i find that the model's output is empty, which means it can't detect the objs in the image. it's so weird. any help is appreciated.
i try model.half() and input.half() for speeding up the inference, the time decrease from 65ms to 53ms, although, it does not speed up too much, but i find that the model's output is empty, which means it can't detect the objs in the image. it's so weird. any help is appreciated.