search

Kaszanas / SC2_Datasets

https://sc2-datasets.readthedocs.io/
GNU General Public License v3.0
8 stars 3 forks source link

Persistent validators holding tournament information #21

Open Kaszanas opened 2 years ago

Kaszanas commented 2 years ago

When returning read_skip_files from validators these are loading a list from the file that holds all of the files that should be skipped for a given dataset.

This means that it is not possible to count how much files are validated/skipped per replaypack.

Such implementation should be relatively simple in the following form when saving the persistent file:

{
    "Tournament_1": {"validated_files": ["file_n0", "file_n1"],
                     "skip_files": ["file_n2","file_n3"]},
    "Tournament_2": {"validated_files": ["file_m0"],
                     "skip_files": []}

}