search

cvg / LightGlue

LightGlue: Local Feature Matching at Light Speed (ICCV 2023)
Apache License 2.0
3.15k stars 291 forks source link

Compatibility Issue with GridSample and ONNX Opset 15 on NXP i.MX 93 NPU #112

Open ubergeekNZ opened 4 months ago

ubergeekNZ commented 4 months ago

Hi,

I'm currently working on deploying the LightGlue model from this repository on the NXP i.MX 93 NPU using the EIQ toolkit. However, I've encountered a challenge: the toolkit supports only ONNX opset 15, which seems not to include support for the GridSample layer used in the PyTorch model.

Could you suggest any alternatives to the GridSample operation that would be compatible with ONNX opset 15, or any other workaround that might help in converting and running this model on the specified NPU?

Cheers Paul

Phil26AT commented 3 months ago

I am not experienced in ONNX, so I can not really help here. The grid sample in python is basically an interpolation of the descriptor map, you could try to port the interpolation from PixLoc.