search

robodhruv / visualnav-transformer

Official code and checkpoint release for mobile robot foundation models: GNM, ViNT, and NoMaD.
http://general-navigation-models.github.io
MIT License
610 stars 78 forks source link

Waypoint Visualization (without robot deployment) #44

Open jimpap1 opened 1 month ago

jimpap1 commented 1 month ago

Hi and sorry for making an issue. I have trained the model but I don't own a robot so this must be done only with coding. Can I feed an image from my dataset into the model and get an output on my image with Waypoint Visualization? Thanks in advance!

kjctphr commented 1 month ago

yes you can, just replace the input with opencv instead.

jimpap1 commented 1 month ago

yes you can, just replace the input with opencv instead.

How could i do that? In which file should i replace it? Any more help? Thanks!

kjctphr commented 1 month ago

deployment/navigate.py, Chatgpt is your best companion

jimpap1 commented 1 month ago

deployment/navigate.py, Chatgpt is your best companion

I managed to get waypoints from navigate.py. Now how do i visualise them on my images?

Benaidandan commented 1 month ago

deployment/navigate.py, Chatgpt is your best companion

I managed to get waypoints from navigate.py. Now how do i visualise them on my images?

Did you do that? Does that have to be deployed on the real robot？

jimpap1 commented 1 month ago

deployment/navigate.py, Chatgpt is your best companion

I managed to get waypoints from navigate.py. Now how do i visualise them on my images?

Did you do that? Does that have to be deployed on the real robot？

Yes I got some waypoints from an image dataset without robot.Now i want to visualise these trajectories on the images from the dataset.Using function plot_trajs_on_image needs some arguments that arent computed.