gnolang / bounties

cosmos/gno ecosystem bounties
9 stars 8 forks source link

scrape script for raw data #8

Closed catShaark closed 2 years ago

catShaark commented 2 years ago
catShaark commented 2 years ago

https://github.com/romelukaku/gaia-scraper here is my repo, I'll post the data first and then the scripts later

jaekwon commented 2 years ago

I just actually read this, thank you very much! I also see your work here: https://github.com/gnolang/gno/issues/30 It looks like you are now actually scraping the raw chain data from hub 1,2,3? If so, amazing.

jaekwon commented 2 years ago

Did you have to use the non-pruned database, or was the pruned one sufficient?

catShaark commented 2 years ago

I use the the interchain link, I don't know if it's pruned or non-pruned

catShaark commented 2 years ago

I just actually read this, thank you very much! I also see your work here: gnolang/gno#30 It looks like you are now actually scraping the raw chain data from hub 1,2,3? If so, amazing.

Yess I use the raw data for the scraping

catShaark commented 2 years ago

do you need cosmos-hub 4 data

catShaark commented 2 years ago

osmo1jnqptkzgx4wpaa9kxqsfq2pfh2d56let3xmefu here is my osmo addr

jaekwon commented 2 years ago

thank you! https://github.com/gnolang/bounties/blob/main/bounties/001_cosmoshub_blockchain_data/README.md

catShaark commented 2 years ago

I also scraped data for cosmoshub-4, is it out of the scope