While working on the HF_tokenizers branch, I found that I could get the validation to skip triggering at the 33% mark:
As seen above, however, the validation run was triggered at the 67% mark. I suspect that this might be due to a rounding issue with floats. Note that this also coincidentally happened when the batch size was increased to an irregularly high number while running the retnet script. The contents of retnet.sh are given below:
While working on the HF_tokenizers branch, I found that I could get the validation to skip triggering at the 33% mark:
As seen above, however, the validation run was triggered at the 67% mark. I suspect that this might be due to a rounding issue with floats. Note that this also coincidentally happened when the batch size was increased to an irregularly high number while running the retnet script. The contents of retnet.sh are given below: