gyorilab / indra_db

A Database-based knowledge back-end built on and for INDRA. The INDRA Database is a service that can be set up by any user with their own content and knowledge access. Our implementation of the database is the back-end to many of our projects, providing a vast and detailed knowledge base derived from many resources.
GNU General Public License v3.0
16 stars 10 forks source link

Compartmentalize Dumping #186

Closed pagreene closed 3 years ago

pagreene commented 3 years ago

This PR expands the Dump CLI sub-tree to allow each portion of the dump to be run independently. This was accomplished by adding the register method to the parent Dumper class, which when called adds an endpoint to the CLI for that dump process.

The Dumper class was also further enhanced to record inter-dump dependencies, which further supports the above aim of running dumps independently.

A new dump of database counts was also added to the growing list of dumps, in addition to a "quick" printout of statistics on the principal database (formerly the obscure stats3.py procedure, lightly modified).