Monash-Connected-Autonomous-Vehicle / autoware

Autoware - the world's leading open-source software project for autonomous driving
https://www.autoware.org/
Apache License 2.0
1 stars 0 forks source link

(Twizy) Intrinsic Camera Calibration #48

Closed dtonda8 closed 3 weeks ago

dtonda8 commented 2 months ago

Relevant Autoware Docs

The docs above are pretty self explanatory. Working autoware directories are on the alienware at ~/autoware.twizy and ~/twizy/autoware.twizy

dtonda8 commented 1 month ago

Hi all! You don't need to worry about starting the Camera since is already on (as of 11th of July). Camera feed can be viewed by running the following on the Alienware (you can anydesk to it):

cd ~/autoware.twizy
source install/setup.bash
ros2 launch twizy_sensor_kit_launch camera.launch.py

If it doesn't work, someone on campus needs to start it up again (lmk if that's the case)

Edit: now not working :/. I'll get it back up running as soon as you're ready

dtonda8 commented 1 month ago

Hey Thomas, how's your progress so far?

The Camera is back up running. Use the command above to launch the cameras. You can view the camera feed using rviz2 in terminal.

tzdu commented 1 month ago

Hey David, I'm so sorry about the delays, I will be calibrating the camera today.

tzdu commented 1 month ago

Image

Hey David, when I try running the command I get the following issue

dtonda8 commented 1 month ago

@tzdu that makes sense since cameras are down now (I might turn the cameras back on on Friday). Try attending our next UA meeting and we can try running the commands together.

I'll investigate how to make it easier to turn on the cameras. Thanks for trying the commands tho

tzdu commented 1 month ago

Ok cool thanks. Also with the calibration chessboard, will printing one for use be fine?

dtonda8 commented 1 month ago

Yea that's a good idea, the docs might have the correct sizing required

dtonda8 commented 1 month ago

Starting Camera feed to be viewable from Alienware Laptop

Instructions

  1. Turn on PX 2

  2. Login to nvidia (password: nvidia)

  3. Open terminal and run the following

    cd ~/Downloads
    ./sender_alienware.sh

    You should now be able to view the camera feed via the PX 2 Display

  4. On the Alienware

    cd ~/autoware.twizy
    source install/setup.bash
    ros2 launch twizy_sensor_kit_launch camera.launch.py
  5. To verify if camera feed is actually streaming, open rviz from terminal: rviz2

  6. Add the camera topic

  7. If you cannot see camera topic, then its msot likely the case that streaming is not working

Feel free to update the instructions above so it can be more clear.

tzdu commented 1 month ago

@dtonda8 Hey David, when I run the sender_alienware file it shows one of the cameras but it's a blocked one (middle one above the windscreen). Am I using the wrong camera? And if so how do I switch it?

dtonda8 commented 1 month ago

Chen was testing cameras, and had to tape some of them 😆 . Cameras are working tho, prolly best to test cameras while campus.

tzdu commented 1 month ago

Calibrated the camera and saved the file as intrinsic_camera_calibration_info.yaml in twizy/twizy_sensor_kit_launch and twizy/twizy_individual_params.

Also pushed the files to dtonda8/twizy_sensor_kit_launch and dtonda8/twizy_individual_params (cloned to dbat folder on alienware).

Need to check which twizy_sensor_kit_launch and twizy_individual_params to push the files to.

dtonda8 commented 3 weeks ago

Individual params seems to be the correct one, we'll fix it later if its not. Feel free to close issue once you're done!