search

brianleect / etherscan-labels

Full label data dump of top EVM chains in JSON/CSV.
MIT License
256 stars 77 forks source link

[QOL] [RetrieveAll] Skip if exist/no change #4

Closed brianleect closed 2 years ago

brianleect commented 2 years ago

Currently every run of retrieveAll will get ALL labels again regardless if there was any change.

Possible soln is to either

  1. Skip if json/csv already exists (Easy but will miss updates)
  2. Check length of JSON/CSV vs indicated length in labelcloud (Slightly more troublesome but will capture changes)
brianleect commented 2 years ago

Implemented skip if exist for retrieval of all. In the case we want updates, makes sense to retrieveAll again.

Currently skip retrieve if exists helps save time if we crash halfway and don't wish to restart from the first label.