Closed hellc3c closed 1 year ago
I find out how to run the sim and finally run the train.py successfully with the use_s2s=False
option. But the first problem remains.
I assume you are willing to release the pre-trained sim2seg model, In that case, please let me know once you put the right link on the readme.md.
Also having trouble running the code here. The pre-trained segmentation model is nowhere to be found, so I just set use_s2s=False
for debugging. I can't figure out how to launch the BuggyGCEnv either -- it says missing executable files (see the following error logs). However, the released files in google drive cannot match the required file path. Any instructions on this?
Thanks for you time.
@typoverflow please change self.BASE_FOLDER
here! https://github.com/rll-research/sim2seg/blob/master/train.py#L72
I'll try and upload a s2s model to the drive link in the coming weeks, sorry for the delay! The segmentation model will be one trained on our Unity environments, so no guarantee it will work perfectly for this simple environment. For now, you should be able to run with use_s2s=False
per @hellc3c
If you would like to train a segmentation model on our provided Unity environment, you can collect paired randomized data and segmentation masks through a separate script. You would need to modify the Unity environment itself (C++ code, need to install Unity, etc.) and run a data collection-specific script. Once you have generated the dataset, you can train a segmentation model by making modifications to https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix
Feel free to let me know if there are any other concerns with this codebase or ml-agents!
Uploaded the model and a corresponding tutorial script: https://github.com/rll-research/sim2seg/blob/master/sim2seg_segmentation.ipynb
Please raise new issues if you come across anything else. Thanks!