search

laclouis5 / uform-coreml-converters

CLI for converting UForm models to CoreML.
MIT License
3 stars 0 forks source link

New optimizations for ANE #1

Open aalexlee opened 4 months ago

aalexlee commented 4 months ago

Hello, Louis.

Currently, I've been using uform-coreml-converters to convert uform models, and they're running great. uform-coreml-converters is indeed a fantastic project, and I'm very grateful for your development efforts.

I noticed that uform-coreml-converters has added optimizations for ANE. I also noticed that Apple proposed a new method last month for deploying vision transformers on ANE. I'm wondering if this new method can also be applied to uform-coreml-converters.

Apple's ml-vision-transformers-ane https://github.com/apple/ml-vision-transformers-ane

laclouis5 commented 4 months ago

Hi @aalexlee, thanks for linking this great article!

I'll take a look if this is research is appli angle to the ViT encoder used in the UForm model.

I don't have a recent iOS device to test the speed-up tough. Have you been able to observe an improvement in latency on a modern device using the ANE optimisations already implemented in this repo?