volsa / etherface

Ethereum Signature Database
https://www.etherface.io
GNU General Public License v3.0
170 stars 22 forks source link

operationalize on Google BigQuery #7

Open allenday opened 1 year ago

allenday commented 1 year ago

Hi @volsa,

Thanks for making this project.

Would you be open to making the results of an etherface instance available to the public in GCP BigQuery?

Happy to discuss the details here, or email me allenday [at] google [dot] com

-Allen

volsa commented 1 year ago

Sure this shouldn't be a problem as long as you could give credits in the form of a link to this project. I was planning on publishing a database dump soon-ish anyways. Which data would you need, e.g. a full database dump or would signatures with their hashes also suffice?

allenday commented 1 year ago

That's great, my thinking is that the easiest will be to coordinate with a regular dump as the intermediary, probably using DBT in a GCP Cloud Build CI/CD.

allenday commented 1 year ago

Yes, we can add some metadata linking to the project. Given there are upstream sources that also need attribution, would you be ok with having a new page and top link linking to the citation details? I mean for etherface.io

volsa commented 1 year ago

Something like an "About" page where all relevant information is summarized? If so that shouldn't be a problem since this is long overdue anyway.

allenday commented 1 year ago

Yes exactly. Not architecture but exec summary and how to cite. We will link to this page from the dataset metadata.

On Tue, Nov 22, 2022 at 18:48 Volkan @.***> wrote:

Something like an "About" page where all relevant information is summarized? If so that shouldn't be a problem since this is long overdue anyway.

— Reply to this email directly, view it on GitHub https://github.com/volsa/etherface/issues/7#issuecomment-1323476227, or unsubscribe https://github.com/notifications/unsubscribe-auth/AADKOP3D5JWB37Q6PMTHS23WJSQINANCNFSM6AAAAAASGLZHJQ . You are receiving this because you authored the thread.Message ID: @.***>

-- Schedule a call: https://meet.allen.day/call

davideaimar commented 1 year ago

Sure this shouldn't be a problem as long as you could give credits in the form of a link to this project. I was planning on publishing a database dump soon-ish anyways. Which data would you need, e.g. a full database dump or would signatures with their hashes also suffice?

Hi @volsa, Is there any news on this? I'm trying to analyse smart contracts on scale, having a local dataset that can be loaded in memory would be very useful, avoiding millions of API calls. If there's a DB dump available or also just a text file containing the signatures I could avoid scraping the APIs. It's for my master's thesis, so of course I would cite you.

volsa commented 1 year ago

Hi, I haven't published a database dump yet. Seeing as to how it would help you out with your thesis however, I'd be happy to provide you one -- what's your email address?

davideaimar commented 1 year ago

Hi, I haven't published a database dump yet. Seeing as to how it would help you out with your thesis however, I'd be happy to provide you one -- what's your email address?

My email is davide.aimar99 [at] gmail [dot] com. Thanks a lot!