Imagine you're running the crawler for the IPFS network for some time. Then you want to start crawling the FILECOIN network as well and experiment around. This could easily lead to FILECOIN data ending up in the same database as the IPFS data. This could be avoided if prior to each crawl we check which network was actually crawled before.
Imagine you're running the crawler for the IPFS network for some time. Then you want to start crawling the
FILECOIN
network as well and experiment around. This could easily lead toFILECOIN
data ending up in the same database as the IPFS data. This could be avoided if prior to each crawl we check which network was actually crawled before.