Open yangtianyu92 opened 4 years ago
Is it possible to use the FP16 approach to speed up the inference of the model? How can I do it if I want to accelerate so much? Thank you.
self.half() , add this code in sentence-transformers.py def init last line
Is it possible to use the FP16 approach to speed up the inference of the model? How can I do it if I want to accelerate so much? Thank you.