search

xboot / libonnx

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
MIT License
560 stars 101 forks source link

Inference on GPU #25

Open drvshavva opened 2 years ago

drvshavva commented 2 years ago

Hi, Can I build and use libonnx on gpu ?

jianjunjiang commented 2 years ago

Need write a struct onnx_resolver_t, and the pass to onnx_context_alloc_from_file function

drvshavva commented 2 years ago

thanks for answer :)

drvshavva commented 2 years ago

hi again, you are saying that we need to write a struct onnx_resolver_t to infer on the gpu. Is it enough ? Is there any other need? And finally how do I change this struct onnx_resolver_t, what structure, what should I do? Many thanks in advance for all the replies :)

jianjunjiang commented 2 years ago

Writing a solver requires a lot of work, you can refer to the default version of the solver implementation