search

openai / Video-Pre-Training

Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos
MIT License
1.28k stars 142 forks source link

Can you provide software to record keyboard and mouse movements? #31

Closed zhufq00 closed 1 year ago

zhufq00 commented 1 year ago

I want to label some data by myself for training. It seems that the recorder is very powerful, because it can record whether the GUI is open, yaw and pitch, etc. There seems to be no such software on the Internet. Thank you very much for your help.

Miffyli commented 1 year ago

Heya. Yeah you are right, there is no software out there to record in this same exact format out there sadly. One good bet would be to create a wrapper around the MineRL environment which runs the game and shows the frames, and then captures keyboard and mouse and passes those actions to the game. You can then store the frames and actions to a similar dataset for your use.

zhufq00 commented 1 year ago

Thank you very much!