kitzeslab / opensoundscape

Open source, scalable software for the analysis of bioacoustic recordings
http://opensoundscape.org
MIT License
127 stars 14 forks source link

consider moving preprocessing "into model" #500

Open sammlapp opened 2 years ago

sammlapp commented 2 years ago

With Tensorflow, preprocessing actions can be added into the model and run on GPU - can we do this in Pytorch? How much flexibility would we sacrifice with preprocessing options? Would it allow us to export models in a shareable cross-platform way?

sammlapp commented 1 year ago

Initial experiments show that tensor operations could happen on GPU within the pytorch module and that this would make them very fast.

sammlapp commented 1 year ago

Additionally, having preprocessing (in particular FFT) inside the PyTorch model object will help when we want to make the models shareable between platforms/packages (eg with ONNX)

sammlapp commented 1 year ago

see #556