brianleect / etherscan-labels

Full label data dump of top EVM chains in JSON/CSV.
MIT License
249 stars 73 forks source link

[QOL] Skipping 0 number cases #17

Open brianleect opened 1 year ago

brianleect commented 1 year ago

Currently time is often wasted looping through on cases where there are 0 accounts or tokens.

E.g. augmented-finance has 0 tokens but for every scraping run it attempts to check it still

Ideally rather than hitting the page and finding out, we should have a step at labelcloud scraping stage which determines the number of labels and if tokens/account even exists for that label.

brianleect commented 1 year ago

Similar scraping procedure needed for https://github.com/brianleect/etherscan-labels/issues/15 but in this case we simply check for the existence of the segment account or token rather than require a specific number