How to run compiled model?

freedomtan / coreml_to_ane_hwx

a quick and dirty little program to convert Apple CoreML model to ANE hwx file

BSD 3-Clause "New" or "Revised" License

26 stars 4 forks source link

Open ghost opened 1 year ago

ghost commented 1 year ago

how to execute .hwx model?

freedomtan commented 1 year ago

how to execute .hwx model?

That's a billion dollar question. Fortunately, @geohot answered that already, if you don't know where to start, please check https://github.com/geohot/tinygrad/blob/master/accel/ane/3_run/test.mm

ghost commented 1 year ago

Thanks a lot

Is that reliable?

Is there any way to know if the an ANE model has been compiled when i normally run a model using CoreML? Is there any way to remove model from cache?