Unity-Technologies / barracuda-release

Other
564 stars 76 forks source link

Models take a long time to import into Unity #313

Open elephantpanda opened 1 year ago

elephantpanda commented 1 year ago

When adding an onnx asset to Unity, it takes a very long time for Baracuda to preprocess it. This is because it reads the onnx and writes out all the inputs, layer names etc.

For a large onnx like 2GB this can take several minutes.

Is this really necessary? There should be a way to import the onnx file without all the preprocessing, or at least to delay this until the user wants to use the onnx file.

I just want to be able to drag an Onnx file into the Assets folder without it taking 5 minutes.

Perhaps the developers could come up with a solution to this problem?

(Also is it doing this preprocessing on the CPU or GPU? It should be GPU-accelerated if possible!)

Actually, if you are doing this on a computer without a graphics card, you probably don't want it to do any preprocessing. But later when you open the project on a computer with a GPU you do. - Or maybe you don't since loading the onnx onto the GPU could take a long time.

cullenwire1 commented 1 year ago

Hey @pauldog I noticed you are pretty active on this repo. If you would like to talk to Unity directly about this please grab a time w/ me here, or email me at bill dot cullen at unity3d dot com. I am seeking feedback about Barracuda to inform our future plans.