search

huggingface / exporters

Export Hugging Face models to Core ML and TensorFlow Lite
Apache License 2.0
611 stars 44 forks source link

[WIP] Allow fixed shapes #37

Closed pcuenca closed 1 year ago

pcuenca commented 1 year ago

Given that Core ML does not utilize the GPU or ANE when using flexible shapes, it becomes important to allow fixed shapes to be enforced for some use cases. One yet-to-be-tested idea is to use enumerated shapes that cover the range of the target model.

pcuenca commented 1 year ago

I finally ended up using fixed shapes by default. Users can still use their own custom configurations to override if they need to.