search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.46k stars 2.9k forks source link

[Build] Where is official build for Unity? #19964

Open ibobak opened 7 months ago

ibobak commented 7 months ago

Describe the issue

I've found a repo https://github.com/asus4/onnxruntime-unity where this respectable author built a Unity plugin of ONNX runtime. Apart from this one, I did not find any other one, neither I found in ONNX documentation of how to build this runtime for Unity.

This is very sad to realize that the most popular game framework doesn't have an official plugin supported by ONNX team or at least some page in documentation which describes how to build it for Unity and to make something similar as in the mentioned above repo.

Urgency

No response

Target platform

Unity

Build script

-

Error / output

+

Visual Studio Version

No response

GCC / Compiler Version

No response

baijumeswani commented 7 months ago

While there isn't an official ONNX Runtime plugin for Unity from the ONNX Runtime team, Unity offers its ML toolkit called ML-Agents (https://github.com/Unity-Technologies/ml-agents). This toolkit is actively maintained and supported by Unity and is their recommended framework of choice for the Unity environment.

github-actions[bot] commented 6 months ago

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

ibobak commented 6 months ago

@baijumeswani correct me if I am wrong: ML-Agents is a totally different thing in comparison to ONNX runtime. Am I right?

With ONNX runtime I can serialize a scikit-learn pipeline and then re-play it on a mobile device in Unity. Can ML-Agents do the same thing?

SetoKaiba commented 6 months ago

@baijumeswani correct me if I am wrong: ML-Agents is a totally different thing in comparison to ONNX runtime. Am I right?

With ONNX runtime I can serialize a scikit-learn pipeline and then re-play it on a mobile device in Unity. Can ML-Agents do the same thing?

Actually unity there is a similar package called sentis. But compared to onnxruntime, it will block the main thread for scheduling jobs. Instead, onnxruntime can totally run in sub thread.