MarkFzp / act-plus-plus

Imitation learning algorithms with Co-training for Mobile ALOHA: ACT, Diffusion Policy, VINN
https://mobile-aloha.github.io/
MIT License
2.86k stars 525 forks source link

co_training data #28

Open a510721 opened 6 months ago

a510721 commented 6 months ago

I have a question about co-training looking at the constants.py, you can see the following dataset_dir aloha_compressed_dataset is the aloha_compressed_dataset the same as the aloha_static_contraining _dataset for co_trainning?

it' too slow to train whole dataset(aloha_mobile_elevator_truncated+aloha_static_contraining _dataset) how is it a good idea to organize the dataset?

"aloha_mobile_elevator_2 and aloha_mobile_elevator_button" there is no data. can you share the missing data?

'aloha_mobile_elevator_truncated_cotrain':{
    'dataset_dir': [
        DATA_DIR + '/aloha_mobile_elevator_truncated',
        DATA_DIR + '/aloha_mobile_elevator_2',
        DATA_DIR + '/aloha_mobile_elevator_button',
        DATA_DIR + '/aloha_compressed_dataset',
    ], # only the first dataset_dir is used for val
    'stats_dir': [
        DATA_DIR + '/aloha_mobile_elevator_truncated',
        DATA_DIR + '/aloha_mobile_elevator_2',
    ],
    'sample_weights': [3, 3, 2, 1],
    'train_ratio': 0.99, # ratio of train data from the first dataset_dir
    'episode_len': 2250,
    'camera_names': ['cam_high', 'cam_left_wrist', 'cam_right_wrist']
},
lunalulu commented 6 months ago

Why don't I see the code above about co training?

huiwenzhang commented 6 months ago

Why don't I see the code above about co training?

The code above is used for real-world dataset training, and the source code is hosted in https://github.com/MarkFzp/mobile-aloha/blob/main/aloha_scripts/constants.py. This repo only includes codes for training in simulation environment.