TASEmulators / BizHawk

BizHawk is a multi-system emulator written in C#. BizHawk provides nice features for casual gamers such as full screen, and joypad support in addition to full rerecording and debugging tools for all system cores.
http://tasvideos.org/BizHawk.html
Other
2.18k stars 382 forks source link

Feature Request: MCTS Bot #1764

Open Meerkov opened 4 years ago

Meerkov commented 4 years ago

Proposal: Similar to BasicBot, but use a smarter algorithm.

Main bullet points for implementation:

Note, e.g. that the new scoring function is required. If you wanted to search for a maximize a RAM value, you'd likely want to score a 0xFF as a 1, a 0x80 as a 0.5, and a 0x00 as a 0. This is roughly equivalent to a max() operation, but importantly keeps scoring independent of the status of the other branches.

Reason for proposal: Basic bot is useless for all but the most narrow applications. While MCTS is not appropriate for entire TAS, the hope is that it can search small sections of say 30 frames, while discovering novel tricks.

Weaknesses: MCTS is likely not better at searching for true random events. It is most efficient at searching functions that have a smooth gradient, such as optimizing movement.

Meerkov commented 4 years ago

demo Example layout (replacing sliders with "always off" "search/random" and "always on" radio buttons)