Information about tracing models

edufschmidt commented 1 week ago

Hi @ShunChengWu, I'm trying to trace the models you provide in this repo to use them on ONNX in SceneGraphFusion, but am struggling a bit due to several factors. It seems that a few of the modules the code relies on don't have the necessary trace function implemented. Also, for the models built on pytorch-geometric, it seems that tracing is not supported due to the utilization of pytorch-scatter, which in turn uses functions that don't play well with ONNX. I'm wondering if you could confirm that it is possible and you have traced the models for utilization with SceneGraphFusion. If so, where can I find instructions on how to reproduce that? If not, what do you suggest one should do in order to be able to integrate the provided models with SceneGraphFusion? Thanks in advance!

edufschmidt commented 5 days ago

Ok, I was able to trace at least one of the models by:

upgraded pretty much every module to its latest version;
changed the onnx opset (>18) used when exporting;
modified the 3DSSG code a bit;
monkeypatched pytorch’s min and max operators;

I am now struggling with using the traced model with SceneGraphFusion. Specifically, I couldn't find instructions to generate the args.json SceneGraphFusion seems to rely on. Any help would be much appreciated.

ShunChengWu commented 4 days ago

The newer version of this repo is not supported. You will have to use the cvpr21 branch to be compatible with the SceneGraphFusion repo

ShunChengWu / 3DSSG

Information about tracing models #66