uzh-rpg / rpg_ramnet

Code and datasets for the paper "Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction" (RA-L, 2021)
GNU General Public License v3.0
96 stars 28 forks source link

looks like there is no voxels folder in your dataset #10

Open algo-scope opened 3 years ago

algo-scope commented 3 years ago

I wanted to run your test.py script but found that it needed 'voxels' folder under the 'event' folder. So I wonder how to generate that?

booker-max commented 3 years ago

Hello, my problem is the same as you, do you solve it?

langmanbusi commented 2 years ago

hi, I can't find the voxel folder as well, did you solve it right now?

algo-scope commented 2 years ago

I've written a blog to solve this problem. You may try it. https://blog.csdn.net/qq_26751117/article/details/122325560

huacong commented 2 years ago

I've written a blog to solve this problem. You may try it. https://blog.csdn.net/qq_26751117/article/details/122325560

I am interested in the event-frame work. I have read your csdn article. I have a question that when I unzip the training data folder, I get three folders including Town01, Town02, Town03. Should I combine the three folders into one folder? I am not sure about the values of "base_folder" "depth_folder" "frame_folder" , "event_folder" and "PREPROCESSED_DATASETS_FOLDER". Could you share your experience? Thanks very much.

langmanbusi commented 2 years ago

I've written a blog to solve this problem. You may try it. https://blog.csdn.net/qq_26751117/article/details/122325560

I am interested in the event-frame work. I have read your csdn article. I have a question that when I unzip the training data folder, I get three folders including Town01, Town02, Town03. Should I combine the three folders into one folder? I am not sure about the values of "base_folder" "depth_folder" "frame_folder" , "event_folder" and "PREPROCESSED_DATASETS_FOLDER". Could you share your experience? Thanks very much.

As for me, I put sequences in each folder(Town01, Town02, Town03) into one folder and I add Town0x to each sequence, like this, you can write a simple code to make it.

image

You can set "PREPROCESSED_DATASETS_FOLDER" and "base folder" as you like, because they will be connected as a data folder when reading the data. As for me I set "PREPROCESSED_DATASETS_FOLDER" as /data2/wuyuhui, "base folder" as Eventscape/Town01_03_train, so the data folder is "/data2/wuyuhui/Eventscape/Town01_03_train", you should make sure the subfolders in the data folder are sequence folders, like below:

image

"depth_folder" "frame_folder" , "event_folder" they are folders in each sequence folder, in the code, the sequence folders will be add to the data folder and like this /data2/wuyuhui/Eventscape/Town01_03_train/sequence_256_town03, then in this folder, the "depth_folder" "frame_folder" , "event_folder" will be open and the data in it will be read. You can see "frame_folder is rgb/data in the .json, like this

image
langmanbusi commented 2 years ago

I've written a blog to solve this problem. You may try it. https://blog.csdn.net/qq_26751117/article/details/122325560

Thank you so much for your kind help. 😄

huacong commented 2 years ago

I've written a blog to solve this problem. You may try it. https://blog.csdn.net/qq_26751117/article/details/122325560

I am interested in the event-frame work. I have read your csdn article. I have a question that when I unzip the training data folder, I get three folders including Town01, Town02, Town03. Should I combine the three folders into one folder? I am not sure about the values of "base_folder" "depth_folder" "frame_folder" , "event_folder" and "PREPROCESSED_DATASETS_FOLDER". Could you share your experience? Thanks very much.

As for me, I put sequences in each folder(Town01, Town02, Town03) into one folder and I add Town0x to each sequence, like this, you can write a simple code to make it. image You can set "PREPROCESSED_DATASETS_FOLDER" and "base folder" as you like, because they will be connected as a data folder when reading the data. As for me I set "PREPROCESSED_DATASETS_FOLDER" as /data2/wuyuhui, "base folder" as Eventscape/Town01_03_train, so the data folder is "/data2/wuyuhui/Eventscape/Town01_03_train", you should make sure the subfolders in the data folder are sequence folders, like below: image "depth_folder" "frame_folder" , "event_folder" they are folders in each sequence folder, in the code, the sequence folders will be add to the data folder and like this /data2/wuyuhui/Eventscape/Town01_03_train/sequence_256_town03, then in this folder, the "depth_folder" "frame_folder" , "event_folder" will be open and the data in it will be read. You can see "frame_folder is rgb/data in the .json, like this image

You are so kind. Thanks very much! I also have a question. image

what's meaning of the baseline = false? AMM-Net is trained... which is AMM-Net? I didn't find it in paper. I would appreciate it if you could give me a hand. Thanks again!

langmanbusi commented 2 years ago

I've written a blog to solve this problem. You may try it. https://blog.csdn.net/qq_26751117/article/details/122325560

I am interested in the event-frame work. I have read your csdn article. I have a question that when I unzip the training data folder, I get three folders including Town01, Town02, Town03. Should I combine the three folders into one folder? I am not sure about the values of "base_folder" "depth_folder" "frame_folder" , "event_folder" and "PREPROCESSED_DATASETS_FOLDER". Could you share your experience? Thanks very much.

As for me, I put sequences in each folder(Town01, Town02, Town03) into one folder and I add Town0x to each sequence, like this, you can write a simple code to make it. image You can set "PREPROCESSED_DATASETS_FOLDER" and "base folder" as you like, because they will be connected as a data folder when reading the data. As for me I set "PREPROCESSED_DATASETS_FOLDER" as /data2/wuyuhui, "base folder" as Eventscape/Town01_03_train, so the data folder is "/data2/wuyuhui/Eventscape/Town01_03_train", you should make sure the subfolders in the data folder are sequence folders, like below: image "depth_folder" "frame_folder" , "event_folder" they are folders in each sequence folder, in the code, the sequence folders will be add to the data folder and like this /data2/wuyuhui/Eventscape/Town01_03_train/sequence_256_town03, then in this folder, the "depth_folder" "frame_folder" , "event_folder" will be open and the data in it will be read. You can see "frame_folder is rgb/data in the .json, like this image

You are so kind. Thanks very much! I also have a question. image

what's meaning of the baseline = false? AMM-Net is trained... which is AMM-Net? I didn't find it in paper. I would appreciate it if you could give me a hand. Thanks again!

Maybe it’s an early name of the proposed method, don’t care

huacong commented 2 years ago

Could you please describe the structure of the mvsec dataset file? I have download the mvsec dataset, hdf5 file, however, I don't know how to process them. I hope you could give me a hand. Thanks!

Harin99 commented 1 year ago

By any chance, do you know how to generate the mvsec dataset for running the ramnet code?

As a result of reviewing the code, it seems that the following files are necessary, but i do not understand how to generate the following files... :crying_cat_face: image