search

NVlabs / Deep_Object_Pose

Deep Object Pose Estimation (DOPE) – ROS inference (CoRL 2018)
Other
1.03k stars 287 forks source link

Step by step on how to run DOPE on low-end device #362

Open KennethEladistu opened 5 months ago

KennethEladistu commented 5 months ago

Hello I have a question, can I run this model without using ROS/ROS2 and ubuntu, I just downloaded the trained weights from your Github and also downloaded the HOPE 3D models.

I made an environment in anaconda prompt, git cloned your repo and installed the needed requirements from requirements.txt. I loaded the downloaded trained weights in the file folder together with the HOPE 3D models. May I ask the next step on how to run the trained weights on my laptop's camera for testing? I'm new to deep learning and just wanna make sure my progress is right thank you!

TontonTremblay commented 5 months ago

https://github.com/NVlabs/Deep_Object_Pose/tree/master/inference You can follow the steps here, you can run without ros.

KennethEladistu commented 5 months ago

https://github.com/NVlabs/Deep_Object_Pose/tree/master/inference You can follow the steps here, you can run without ros.

image

hello I have run the

python inference.py --weights D:/Deep_Object_Pose/weights/pretrained_weights.pth --data D:/Deep_Object_Pose/sample_data --object cracker command and this is the output. Am I in the right track? May I ask what is the next step if I want to run it on my laptop's camera without using ROS, do you have any sample for the Configuration Files/projection matrix that I can use to run it on my laptop? thank you for the help.

TontonTremblay commented 5 months ago

This looks like it ran nicely, do you see an output? I dont remember the interface to the inference script. You are currently running without ROS. So you should be able to replicate this on your laptop.

KennethEladistu commented 5 months ago

This looks like it ran nicely, do you see an output? I don't remember the interface to the inference script. You are currently running without ROS. So you should be able to replicate this on your laptop.

Hello, no there is no output, I just run the python inference.py --weights D:/Deep_Object_Pose/weights/pretrained_weights.pth --data D:/Deep_Object_Pose/sample_data --object cracker Found 10 weights. on my Anaconda Prompt and it loaded the 10 models and after that no output, my laptop's camera did not open or any output at all. Thank you.

TontonTremblay commented 5 months ago

I think you need to tell it to open the webcam. Check the arguments you can pass in the script.

KennethEladistu commented 5 months ago

I think you need to tell it to open the webcam. Check the arguments you can pass in the script.

oh okay okay is this for the inference.py script?

KennethEladistu commented 5 months ago

I think you need to tell it to open the webcam. Check the arguments you can pass in the script.

image Hello, currently I modified my inference.py code and I have laptop camera working and the models are loading, but when I tried to show my camera the Cheez-IT picture it does not detect anything, may I ask if I am doing the right thing for testing? thank you.

TontonTremblay commented 5 months ago

yeah I dont think you loaded the weights for the cracker, you dont need to load objects you are not going to detect, it just slows down the process. I think you have the bbq sauce loaded that I can see, https://www.ebay.com/itm/124572623487 try these images.

KennethEladistu commented 5 months ago

yeah I dont think you loaded the weights for the cracker, you dont need to load objects you are not going to detect, it just slows down the process. I think you have the bbq sauce loaded that I can see, https://www.ebay.com/itm/124572623487 try these images.

image

this is my current result on my Iphone are the results bad for testing?

TontonTremblay commented 5 months ago

@nv-jeff I think this is the same problem that your changes introduced?

KennethEladistu commented 5 months ago

@nv-jeff I think this is the same problem that your changes introduced?

good morning is there an update for this one? thank you

TontonTremblay commented 5 months ago

We are at an NVIDIA even this week. I think Jeff told me he had a solution but did not have time to push it because of the event. Early next week, it should be there.

On Wed, Jun 5, 2024 at 18:12 Ken @.***> wrote:

@nv-jeff https://github.com/nv-jeff I think this is the same problem that your changes introduced?

good morning is there an update for this one? thank you

— Reply to this email directly, view it on GitHub https://github.com/NVlabs/Deep_Object_Pose/issues/362#issuecomment-2151215542, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABK6JIFBOYBWFFKQANIPMBTZF6ZP3AVCNFSM6AAAAABIQIKF5CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJRGIYTKNJUGI . You are receiving this because you commented.Message ID: @.***>

KennethEladistu commented 5 months ago

We are at an NVIDIA even this week. I think Jeff told me he had a solution but did not have time to push it because of the event. Early next week, it should be there. … On Wed, Jun 5, 2024 at 18:12 Ken @.> wrote: @nv-jeff https://github.com/nv-jeff I think this is the same problem that your changes introduced? good morning is there an update for this one? thank you — Reply to this email directly, view it on GitHub <#362 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABK6JIFBOYBWFFKQANIPMBTZF6ZP3AVCNFSM6AAAAABIQIKF5CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJRGIYTKNJUGI . You are receiving this because you commented.Message ID: @.>

thank you for the response!