Closed DavidNemeskey closed 1 year ago
New script batch_deduplicate_index_urls.py added that runs through the list of directories in the index_filtered directory and iteratively deduplicates them.
batch_deduplicate_index_urls.py
index_filtered
It works.
DavidNemeskey
commented
1 year ago
New script
batch_deduplicate_index_urls.pyadded that runs through the list of directories in theindex_filtereddirectory and iteratively deduplicates them.