Handling for static/historic datasets - Githubissues

davidgasquez / gitcoin-grants-data-portal

🌲 Open source, serverless, and local-first data hub for Gitcoin Grants data!

https://grantsdataportal.xyz/

MIT License

25 stars 3 forks source link

Handling for static/historic datasets #71

Open DistributedDoge opened 4 months ago

DistributedDoge commented 4 months ago

Working on this one as we speak.

Some resources we want to grab:

have contents that stay the same
are hosted in strange places (e.g. Google Sheets, Notion, Github data folder)

We can pin those files on IPFS to simplify fetching logic and ensure they don't break in the future:

[x] create IPFS_Resource configured with gateway.
[x] create new module assets/static.py with assets representing archival datasets
[x] create example assets using this strategy
[ ] actually submit the PR

Examples of historic datasets:

Carl's RPGF3 data OSO-snapshot
cGrants (old Gitcoin data from Umar) (see also: OSO-funding)
Octant Epoch 0 (Only epoch to use snapshot for allocation)