Quantization for faster inference - Githubissues

Doodleverse / segmentation_zoo

A collection of geoscientific image segmentation models

MIT License

7 stars 3 forks source link

Quantization for faster inference #34

Open ebgoldstein opened 1 year ago

ebgoldstein commented 1 year ago

tfmot : https://www.tensorflow.org/model_optimization
quantization in the future for TF: https://blog.tensorflow.org/2023/05/google-io-2023-whats-new-in-tensorflow-and-keras.html
TensorRT https://developer.nvidia.com/tensorrt