39alpha / 39alpharesearch.org

39Alpha Research's Public Website
https://39alpharesearch.org
0 stars 0 forks source link

Create data.39alpharesearch.org #24

Open dglmoore opened 2 years ago

dglmoore commented 2 years ago

Description

We need a place to host datasets, both live (e.g. live database access) and static (e.g. IPFS stored data). We do not want to give people direct access to our databases, but instead provide a user interface with which they can run create plots or download subsets of the data. It should also provide a live list of datasets together with the IPFS hashes.

Implementation

At the moment, we are thinking we'll implement the UI in Flask. This will proxy the access to the databases and build out a list of static datasets. How we will track static datasets is an outstanding problem. One possibility is to add the datasets to the IPFS UFS, and read that information from the flask app. Another is to maintain a running JSON file containing the IPFS hash of the dataset and any metadata, e.g. a title, description, authoring team, etc...