search

AlexTheM8 / AiAi-AI

3 stars 0 forks source link

Investigate pausing while analyzing #10

Open AlexTheM8 opened 2 years ago

AlexTheM8 commented 2 years ago

There's a potential that the image used to run the model is widely outdated by the time the AI acts. To mitigate this, a potential solution could be to pause after capturing an image and unpause when the action is ready. This could cause a stutter to the live-play, but could create a more accurate model.

This is for testing purposes and should not be the final outcome. Results from this experiment could lead to a better understanding of why this isn't training properly. This could ultimately be a hardware problem, potentially being solved by issue #9

AlexTheM8 commented 2 years ago

It's "possible," but it's hard to watch. Maybe this will be valid with better hardware. One issue is the button-action for frame advance requires time.sleep(). Could later be reworked to hook into Dolphin directly and use its built-in frame advance

AlexTheM8 commented 2 years ago

Instead of having the hotkey be on the controller, might be possible to hotkey on emulated keyboard or similar. Another possibility would be to find/build a hook into the Dophin emulator directly and do some sort of emu.frameadvance()

The key idea is that we ideally want to be able to analyze every frame, if possible (or at least on consistent frames). This would be most feasible on better hardware.

AlexTheM8 commented 2 years ago

With the hook into Dolphin directly, there is the possibility with the following repo: https://github.com/AlexTheM8/dolphin

Currently, it is not up to date with Dolphin, but still good to look into. On my local, I need to re-evaluate my ability to build the project. I am currently just using a release version, but would like to be able to develop myself in the future