I was debugging alignment failures, and noticed that file handles are only closed at the end of the script running. It would be better to close things after each step is run. I also expanded the docs a bit more. For the review I would recommend hiding whitespace changes, as a lot of indentation changed.
This PR is lower priority, and doesn't fix anything in the current training run. It was just a drive-by as I was looking into the code.
I was debugging alignment failures, and noticed that file handles are only closed at the end of the script running. It would be better to close things after each step is run. I also expanded the docs a bit more. For the review I would recommend hiding whitespace changes, as a lot of indentation changed.
This PR is lower priority, and doesn't fix anything in the current training run. It was just a drive-by as I was looking into the code.