Adding commands to manage the silvimetric tiledb database.
These commands include
delete - Pass a uuid associated with a shatter process to delete the data in tiledb from the database
restart - Pass a uuid associated with a shatter process to delete a shatter process and then use the config already there to rerun the process.
resume - Pass a uuid associated with an incomplete shatter process to resume where this process left off.
This PR reworks a couple of components:
Shatter processes now operate in a distinct time window associated with their process number, which is an incrementing number produced from storage
We now consolidate the fragments that are written for a shatter process down into one fragment, for ease of time traveling as well as ease of use.
Storage class now includes some more wrapper functions for tiledb including
delete which deletes fragments associated with a shatter process number (timestamp)
get_fragments_by_time which grabs tiledb fragments and filters them by timestamp
consolidate_shatter which consolidates by a timestamp
mbrs which grabs the minimum bounding rectangle for a list of fragments filtered by timestamp
This also includes the new test tile test_commands.py which will test commands that don't need a full test suite including info, delete, restart, and resume
Adding commands to manage the silvimetric tiledb database. These commands include
This PR reworks a couple of components:
delete
which deletes fragments associated with a shatter process number (timestamp)get_fragments_by_time
which grabs tiledb fragments and filters them by timestampconsolidate_shatter
which consolidates by a timestampmbrs
which grabs the minimum bounding rectangle for a list of fragments filtered by timestampThis also includes the new test tile
test_commands.py
which will test commands that don't need a full test suite includinginfo
,delete
,restart
, andresume