leggedrobotics / wild_visual_navigation

Wild Visual Navigation: A system for fast traversability learning via pre-trained models and online self-supervision
https://sites.google.com/leggedrobotics.com/wild-visual-navigation
MIT License
113 stars 9 forks source link

Meeting Updates #152

Closed mmattamala closed 1 year ago

mmattamala commented 1 year ago

Agenda 1

  1. Neglect the GPS most likely.
  2. Baselines
    • WayFast try to retrain it and inference exactly on our data. See the visual difference.
    • Using Geometrical Traversability
  3. Regenerating the ablations and making the plots.
  4. Calibrations Camera Lidar Perugia
    • /media/Data/Datasets/2022_Perugia/day3/mission_data/2022-05-12T11-44-56_mission_0_day_3�
    • Make sure to use correct alphasense_rsl branch
  5. Current Timings:
    Image callback: front... process
    Time image_callback - preprocess:  21.038463592529297 ms
    Time feature_extractor - sparsify_features:  51.83488082885742 ms
    Time add_mission_node - update_features:  266.98651123046875 ms
    Time add_mission_node - optical flow:  39.82950210571289 ms
    Time add_mission_node - project_supervision:  9.16096019744873 ms
    Time add_mission_node - update_supervision_signal:  1.742624044418335 ms
    Time image_callback - add_mission_node:  345.8580627441406 ms
    step: 880 | loss: 1.521120 | loss_trav: 0.169302 | loss_reco: 1.372939
    Time publish_mission_graph:  498.3157958984375 ms
    Time visualizer - plot_traversability_graph_on_seg trav:  147.77203369140625 ms
    Time visualizer - plot_traversability_graph_on_seg conf:  148.0391387939453 ms
    Time plot_mission_node_prediction:  298.7796630859375 ms
    Time publish_mission_node_prediction:  0.886784017086029 ms
    Time plot_mission_node_training:  359.99627685546875 ms
    Time publish_mission_node_training:  0.9010879993438721 ms
    Time image_callback - update visualizations:  1202.3193359375 ms
  6. Integrate the output into RMP

Agenda 0

Current status of the system

@JonasFrey96

@mmattamala

Pending tasks

Oxford visit

Other things to do

JonasFrey96 commented 1 year ago

My flight: image

JonasFrey96 commented 1 year ago
mmattamala commented 1 year ago
JonasFrey96 commented 1 year ago

@mmattamala I don't have to opportunity to bring our full GPS unit but I could set up a new unit. I think we have everything for this available but it would require some work (4-8hours). Should I do this ?

mmattamala commented 1 year ago

Let me ask if we received the components we were missing first, I'll keep you posted