huggingface / exporters

Export Hugging Face models to Core ML and TensorFlow Lite
Apache License 2.0
622 stars 46 forks source link

mlpackage vs mlmodel for Falcon 7B #46

Open LexiestLeszek opened 1 year ago

LexiestLeszek commented 1 year ago

Hi! Sorry for a noob question, but I've had an experience using BERT in .mlmodel format, where I just added it to my project, created a .swift file with its Class and it worked on iOS. Now, when I use exporters, they create MLPackage files and I don't understand how to use it.

I want to use Falcon 7B locally and don't understand how to convert it to *.mlmodel and how to use it in my iPhone app.

pcuenca commented 1 year ago

Hi @LexiestLeszek! mlpackage is just the new and recommended format, you would use it the same way you use mlmodel files. Adding it to your Xcode project should also auto-generate a swift class for you.