Data preparation, weights and TRT deployment

YoushaaMurhij commented 1 year ago

Thanks for sharing this amazing work! Could you please provide the steps to generate gt data from Waymo original dataset? Are you willing to provide the pertained models if the user sends his agreement to Waymo dataset licence? Do you plan to publish a sample deployment script to TRT?

Thanks

Haiyang-W commented 1 year ago

Thanks for your interests!

We use the same data generation as OpenPCDet, so you can follow the GetStart for more details of data processing.
As for the model sharing, actually I'm not familiar with it and only know that waymo weights are generally not shared due to the licence limitation. However I believe you can easily achieve the performance reported in our paper by the released codes. Moreover, we also provide the training log of all the experiments for easy reproduction.
Deployment code is a bit complex and detailed, and we probably won't share it. Very sorry for that.

Hope that can ease your concerns.

Haiyang

d33dler commented 1 year ago

@Haiyang-W Funny you say "Deployment code is a bit complex and detailed" yet in the paper you mention "[...] DSVT can be easily deployed by TensorRT with real-time inference speed (27Hz) " . In any case at least some directives would be nice. Nevertheless good work.

Haiyang-W commented 1 year ago

Thanks for sharing this amazing work! Could you please provide the steps to generate gt data from Waymo original dataset? Are you willing to provide the pertained models if the user sends his agreement to Waymo dataset licence? Do you plan to publish a sample deployment script to TRT?

Thanks

Deployment is a highly intricate process that involves multiple steps and procedures. However, if you require the TRT code urgently, we can provide you with a relatively unrefined version. Regarding the model weights, we would be delighted to share them with you upon receipt of the Waymo dataset license agreement.

Best regrads, Haiyang

Haiyang-W commented 1 year ago

@Haiyang-W Funny you say "Deployment code is a bit complex and detailed" yet in the paper you mention "[...] DSVT can be easily deployed by TensorRT with real-time inference speed (27Hz) " . In any case at least some directives would be nice. Nevertheless good work.

Deployment is a complex and detailed process that requires multiple steps and procedures for all the methods (not just about DSVT), which needs a domain-specific expert to do it. If you require it, we would be happy to assist you, such as providing a relatively unrefined version of TRT codes. Please let us know how we can best support you.

Best regards, Haiyang

Haiyang-W commented 1 year ago

The main reason why the TRT code has not been released is because the deployment process is complex and involves multiple human interventions, which are not directly related to our method. We also want to maintain the cleanliness of our code.

If someone wants to deploy, you can follow the official TensorRT deployment process to complete the steps.

torch->onnx: https://pytorch.org/docs/stable/onnx.html
onnx->tensorrt: https://developer.nvidia.com/zh-cn/blog/tensorrt-trtexec-cn/

If anyone wants the original unrefined deployment codes, please send me an email.

Best, Haiyang

dinvincible98 commented 1 year ago

@Haiyang-W Hi, can I get a unrefined deployment code for reference? This is my email: mingqingyuan98@gmail.com. Thank you!

Haiyang-W commented 1 year ago

@Haiyang-W Hi, can I get a unrefined deployment code for reference? This is my email: mingqingyuan98@gmail.com. Thank you!

I have emailed it to you. We are working on writing some docs of TensorRT to guide DSVT deployment. Please be patient. We'll release it soon.

zizhengu commented 1 year ago

I have trained a DSVT model and want to further deploy it for it's amazing performance. Can I get a unrefined deployment code for reference? This is my email: [zizhengu@163.com]. Thank you very much!

Haiyang-W commented 1 year ago

zizhengu@163.com

The unrefined version has been emailed. :)

The doc of TRT guidance will be completed as soon as possible.

Haiyang

LinuxCup commented 1 year ago

I tried to deploy, but failed which TensorRT not support some torch operators directly. Can I get your deployment codes? if so, email: 1321504124@qq.com. thx

Haiyang-W commented 1 year ago

I tried to deploy, but failed which TensorRT not support some torch operators directly. Can I get your deployment codes? if so, email: 1321504124@qq.com. thx

The unrefined version has been emailed. :) Haiyang

superpigforever commented 1 year ago

Hi, can you share the deployment codes? My email: sw3197@nyu.edu

Haiyang-W commented 1 year ago

sw3197@nyu.edu

The unrefined version has been emailed. :)

superpigforever commented 1 year ago

sw3197@nyu.edu

The unrefined version has been emailed. :)

Hi I'm sorry, the attachment is removed by the filter. can you resend the attachment to the following email:

wsy1301145977@gmail.com

Haiyang-W commented 1 year ago

sw3197@nyu.edu

The unrefined version has been emailed. :)

Hi I'm sorry, the attachment is removed by the filter. can you resend the attachment to the following email:

wsy1301145977@gmail.com

Have resent it. :)

Best

ihaohe commented 1 year ago

@Haiyang-W Thanks for your nice work! Could you please share the unrefined deployment code? Thank you. My email: ihaohe@hotmail.com

Haiyang-W commented 1 year ago

@Haiyang-W Thanks for your nice work! Could you please share the unrefined deployment code? Thank you. My email: ihaohe@hotmail.com

We have released the TRT code of backbone3D (DSVT), please refer here.

gauthamnarayan commented 1 year ago

@Haiyang-W Thank you very much for your work and for releasing the partial deployment code for backbone 3d in tensorrt. It would be really helpful if you can share the unrefined full deployment code to tecplot123@gmail.com. Thanks a lot for this!

Haiyang-W commented 1 year ago

@Haiyang-W Thank you very much for your work and for releasing the partial deployment code for backbone 3d in tensorrt. It would be really helpful if you can share the unrefined full deployment code to tecplot123@gmail.com. Thanks a lot for this!

Have already sent. Wish you all the best!

ihaohe commented 1 year ago

@Haiyang-W Thank you very much for your work and for releasing the partial deployment code for backbone 3d in tensorrt. It would be really helpful if you can share the unrefined full deployment code to tecplot123@gmail.com. Thanks a lot for this!

Have already sent. Wish you all the best!

Thanks again for releasing the partial deployment code. I've the same need of the unrefined full deployment code. It would be very helpful if you send the code to ihaohe@hotmail.com.

Haiyang-W commented 1 year ago

@Haiyang-W Thank you very much for your work and for releasing the partial deployment code for backbone 3d in tensorrt. It would be really helpful if you can share the unrefined full deployment code to tecplot123@gmail.com. Thanks a lot for this!

Have already sent. Wish you all the best!

Thanks again for releasing the partial deployment code. I've the same need of the unrefined full deployment code. It would be very helpful if you send the code to ihaohe@hotmail.com.

Have already sent it. :)

mincheoree commented 1 year ago

@Haiyang-W Thank you very much for your work and for releasing the partial deployment code for backbone 3d in tensorrt. It would be really helpful if you can share the unrefined full deployment code to tecplot123@gmail.com. Thanks a lot for this!

@Haiyang-W Thanks for your amazing works on releasing DSVT! Thanks for releasing the partial deployment codes. I also have the same need of unrefined full deployment code. It would be really helpful if you can share the unrefined full deployment codes to mincheoljang522@gmail.com. Thanks a lot for sharing!

Haiyang-W commented 1 year ago

@Haiyang-W Thank you very much for your work and for releasing the partial deployment code for backbone 3d in tensorrt. It would be really helpful if you can share the unrefined full deployment code to tecplot123@gmail.com. Thanks a lot for this!

@Haiyang-W Thanks for your amazing works on releasing DSVT! Thanks for releasing the partial deployment codes. I also have the same need of unrefined full deployment code. It would be really helpful if you can share the unrefined full deployment codes to mincheoljang522@gmail.com. Thanks a lot for sharing!

Have already sent it. :)

d33dler commented 10 months ago

@Haiyang-W could you send the unrefined full deployment as well? Thank you! r.rebeja@student.rug.nl

Haiyang-W commented 10 months ago

r.rebeja@student.rug.nl

Have sent it :)

cyhasuka commented 9 months ago

Hello, Thanks again for releasing the partial deployment code. I have trained a DSVT model with nuscenes and want to further deploy it. It would be very helpful if you send the code to cyhasuka@gmail.com. My Google account above has already been registered with Waymo's official platform, and have agreed to the Waymo dataset license. If you can provide a pre-trained model to me, I would greatly appreciate it. Thank you and wish you all the best!

Haiyang-W commented 9 months ago

Hello, Thanks again for releasing the partial deployment code. I have trained a DSVT model with nuscenes and want to further deploy it. It would be very helpful if you send the code to cyhasuka@gmail.com. My Google account above has already been registered with Waymo's official platform, and have agreed to the Waymo dataset license. If you can provide a pre-trained model to me, I would greatly appreciate it. Thank you and wish you all the best!

The unrefined full deployment code of DSVT-waymo (centerhead) has been sent to your mailbox. Nuscenes is the Transfusion head version, which I'm sure shouldn't be too hard.

As for the pre-trained weights, I have sent a Google Drive link to you, including the DSVT-Pillar and DSVT-3D on waymo dataset.

best, Haiyang

gcunhase commented 2 months ago

Hi @Haiyang-W could you please share the unrefined full deployment codes to gwena.cs@gmail.com as well please? Can you also please direct me to the batch_dict.pth file? Thanks.

Haiyang-W commented 2 months ago

Hi @Haiyang-W could you please share the unrefined full deployment codes to gwena.cs@gmail.com as well please? Can you also please direct me to the batch_dict.pth file? Thanks.

Have sent it. :)

But I suggest you use the deployment code in the repo to deploy, or this repo.

Haiyang-W / DSVT

Data preparation, weights and TRT deployment #9