Originally, if nshards.txt didn't exist, I would print a warning and assume nshards = 1. This can cause results to be wrong if streaming from HF due to network issues, and is easy to go undetected. I removed this behavior, so that network issues will raise an exception instead of evaluating on one shard only.
Originally, if nshards.txt didn't exist, I would print a warning and assume nshards = 1. This can cause results to be wrong if streaming from HF due to network issues, and is easy to go undetected. I removed this behavior, so that network issues will raise an exception instead of evaluating on one shard only.