Save actions along with observations in ttyrec

[rokosbasilisk]

🚀 Feature

ability to save actions taken during runs along with the observations.

[heiner]

Hey @rokosbasilisk

(I have a feeling I know that handle from rationality blogs?)

Thanks for your interest in NLE!

If I don't misunderstand your somewhat succinct request, we already have the feature you are looking for: We are saving "ttyrec2" files.

Here's two scripts in NLE that make use of the NetHack inputs / actions:

• Replaying saved ttyrecs with the ttyplay2.py script tries to show the current action below the screen (may or not may work in your terminal)
• The read_tty.py script tries to show "all" information in a ttyrec, with colors. Here's an idea of how that looks: Notice the green arrows that say whether data was input to or output of NetHack. The inputs are the ASCII values of the commands sent to NLE.

I'm going to close this issue, feel free to reopen it if this isn't what you were looking for.