search

SHI-Labs / OneFormer

OneFormer: One Transformer to Rule Universal Image Segmentation, arxiv 2022 / CVPR 2023
https://praeclarumjj3.github.io/oneformer
MIT License
1.51k stars 135 forks source link

Onnx conversion and C++ implementation. #72

Closed zhaochunguang1993 closed 1 year ago

zhaochunguang1993 commented 1 year ago

Thank you for your efforts in OneFormer's research work. I am currently trying to implement the Instance segmentation in C++ using oneformer.

  1. The easiest way is to convert the oneformer model to onnx and use it. I have looked carefully at what has been discussed here and I have tried converting, but failed. https://github.com/SHI-Labs/OneFormer/issues/16

This is the screenshot. image

  1. Next I try to use the libtorch library, but I haven't been successful yet.

My question are:

  1. Are there any achievements in the work to convert the model to onnx?
  2. Is there a demo source code for c++ implementation?

Thanks in advance

praeclarumjj3 commented 1 year ago

Hi, @janebittner09, thanks for your interest. Unfortunately, I haven't had the opportunity to work on the conversion to ONNX format myself yet. Presently, we don't have any plans to work on a C++ demo.

About the error you are facing, what is the GPU memory on your machine? It seems you need more memory which might be leading to the Segmentation Fault error.

zhaochunguang1993 commented 1 year ago

Thanks for your reply.