Haiyang-W / DSVT

[CVPR2023] Official Implementation of "DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets"
https://arxiv.org/abs/2301.06051
Apache License 2.0
353 stars 28 forks source link

full deployment code #71

Closed CodeWorldChanged closed 4 months ago

CodeWorldChanged commented 4 months ago

Thank you very much for your work and for releasing the partial deployment code for backbone 3d in tensorrt. It would be really helpful if you can share the unrefined full deployment code to 1107315077@qq.com. Thanks a lot for this!

Haiyang-W commented 4 months ago

I have sent it to your email. But I recommend you to use fully tensorRT repo.

jacoblambert commented 3 weeks ago

@Haiyang-W Thanks for your work. Have you used that repository? They report very slow inference speed compared to your paper, and users report inconsistent inference results differing greatly from your paper. So I'm not sure it's good to recommend it. Their environment is old but still, very very far from your reported 27hz.

one frame takes about 0.7 seconds on my laptop with Intel(R) Core(TM) i5-7300HQ and NVIDIA GeForce GTX 1050 Mobile(1050ti)

As such, can I also ask for the full deployment code? I think everyone would appreciate if you share full deployment code in this repo, also since "The speeds provided in the paper are the results of full deployment", you should share it for reproducibility; I don't really understand the universality argument. If there is a reason you can't share it, I'd like to ask to please share it to me at jacob.lambert@g.sp.m.is.nagoya-u.ac.jp .

All the best.

Haiyang-W commented 3 weeks ago

@Haiyang-W Thanks for your work. Have you used that repository? They report very slow inference speed compared to your paper, and users report inconsistent inference results differing greatly from your paper. So I'm not sure it's good to recommend it. Their environment is old but still, very very far from your reported 27hz.

one frame takes about 0.7 seconds on my laptop with Intel(R) Core(TM) i5-7300HQ and NVIDIA GeForce GTX 1050 Mobile(1050ti)

As such, can I also ask for the full deployment code? I think everyone would appreciate if you share full deployment code in this repo, also since "The speeds provided in the paper are the results of full deployment", you should share it for reproducibility; I don't really understand the universality argument. If there is a reason you can't share it, I'd like to ask to please share it to me at jacob.lambert@g.sp.m.is.nagoya-u.ac.jp .

All the best.

I haven't used this repo, but it looks pretty good. The GPU you deployed might be inferior; we deploy on 3090, and all our experimental data is tested on 3090. You can refer to the deployment code in our official repo; it should be very fast on a 3090. Regarding the Head, if you are familiar with TensorRT, you should be able to write the deployment code in a few hours. Our fully deployed code is quite messy and not refined, so it can only serve as a reference and probably can't be used directly. If you need it, I can send it to you, but I think you will still need to rewrite the head deployment.

Best, Haiyang

jacoblambert commented 3 weeks ago

Thanks for your reply @Haiyang-W . I'll give the other repo a try and let you know how it goes for future reference. Still I'd appreciate if you could share your code as reference because I'm not experienced with deployment and looking at your deployment code I think I'd have a hard with doing the head from scratch; I think it'll greatly help with the learning process. I'll look into TensorRT but If you have any other learning resources that'd be great. If I get it to run and get good results, I'll make a PR.

Best, Jacob

Haiyang-W commented 3 weeks ago

Thanks for your reply @Haiyang-W . I'll give the other repo a try and let you know how it goes for future reference. Still I'd appreciate if you could share your code as reference because I'm not experienced with deployment and looking at your deployment code I think I'd have a hard with doing the head from scratch; I think it'll greatly help with the learning process. I'll look into TensorRT but If you have any other learning resources that'd be great. If I get it to run and get good results, I'll make a PR.

Best, Jacob

It has been sent to your email. Please combine it with the deployment method provided by our repo to deploy the head.

Thanks for your potential deployment contribution and good luck.

Best, Haiyang