openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
https://docs.openvino.ai
Apache License 2.0
6.54k stars 2.12k forks source link

Can support 3d LiDAR detection network voxelnext? #21849

Open zyxcambridge opened 7 months ago

zyxcambridge commented 7 months ago

Request Description

https://github.com/dvlab-research/VoxelNeXt

cpu run in i9 ,

100ms

pointcloud

input 30W

Feature Use Case

No response

Issue submission checklist

zyxcambridge commented 7 months ago

spconv

https://github.com/mit-han-lab/bevfusion/tree/main/mmdet3d/ops/spconv

vurusovs commented 7 months ago

@mlukasze @andrei-kochin please, take a look

rkazants commented 7 months ago

Hi @zyxcambridge,

Can you please elaborate more your request or issue? Is your model not converted or not inferred using OpenVINO? Try take a look at documentation how to convert PyTorch models: https://docs.openvino.ai/2023.2/openvino_docs_OV_Converter_UG_prepare_model_convert_model_Convert_Model_From_PyTorch.html

Best regards, Roman

zyxcambridge commented 7 months ago

pth is here https://drive.google.com/file/d/1IV7e7G9X-61KXSjMGtQo579pzDNbhwvf/view?usp=share_link

infrence code is here https://github.com/dvlab-research/VoxelNeXt/blob/master/tools/demo.py

unsupport os is called spconv https://github.com/mit-han-lab/bevfusion/tree/main/mmdet3d/ops/spconv ;

the network is smilar to pointpillars ,but now openvino not support any of op in voxelnext ?

rkazants commented 7 months ago

pth is here https://drive.google.com/file/d/1IV7e7G9X-61KXSjMGtQo579pzDNbhwvf/view?usp=share_link

infrence code is here https://github.com/dvlab-research/VoxelNeXt/blob/master/tools/demo.py

unsupport os is called spconv https://github.com/mit-han-lab/bevfusion/tree/main/mmdet3d/ops/spconv ;

the network is smilar to pointpillars ,but now openvino not support any of op in voxelnext ?

Hi @zyxcambridge,

Can you please share your logs you received during convert_model to see a concrete list of unsupported ops?

Best regards, Roman