epatters
commented
4 years ago You're right that the current features of the DSO web frontend are adequately served by CouchDB. Although I'm not familiar with IPFS or Dat, you're probably right that even simpler infrastructure would suffice for the current feature set.
One reason I was considering migrating to a graph DB is to enable more sophisticated interlinking. For example, it would be nice if the page for a concept would list all the annotations that use it, so that users could quickly identify the Python or R packages implementing that concept. To do that, we would need to deep search though the function annotations' expression trees, which AFAIK is not straightforward in the document DB model. I believe it would be straightforward in a graph DB model where each node in the tree is a node in the graph DB.
Now, since the site's content is basically static, this could be done at build time by generating static indexes. I think that is the point you were making. But at a certain point I imagine it becomes easier to just use a DB for the querying and slap a cache in front of it if performance is an issue.
I am delighted that you are interested in using this project to explore collaborative ontology editing, and I would like to support this in any way that I can. It has always been my intention that the DSO be a wiki-style collaborative effort, but so far I have not had much success in getting contributions. I suspect that part of the problem (besides a general lack of visibility) is that understanding what is going on and contributing is not nearly as easy as it could be.
sander
@epatters wrote in #16:
What kind of queries are you thinking about that cannot easily be handled using CouchDB views?
For the purpose of
datascienceontology-frontend, I'm thinking the database design could even be "less intelligent" and easier to maintain. Since a built ontology just consists of static linked documents plus search/browse indices, all public, at the current scale an S3/IPFS/Dat bucket containing these static docs plus some static indices might be sufficient.Asking because I'm interested in creating patches to make the frontend and collaboration workflow easier to use and more engaging. I'd like to explore several use cases for collaborative ontology building across concepts and code using this project. The direction this upstream project is going with database management impacts how I should focus my effort.