Closed khoroshevskyi closed 2 months ago
More details on how to do this:
https://github.com/databio/bedboss/issues/26#issuecomment-1948959955
I propose no new package/object, but do this:
use
boto3
to upload from within bedboss. Then, insert metadata about this upload (when completed successfully) withreport
using pipestat, so the database knows what files were uploaded and where they are, or whatever (or maybe it's justTrue
if the upload was successful, or something). I guess I could see this being a JSON blob with information about all files that were transferred to s3/b2.Then, write a function or class that can remove an entry from the database. It would query the info from the main database, then
* if qdrant is present, remove it (and update the database), then * if s3 files are present, remove them and update the database * remove the entry from the pephub allbeds (bedboss output pep). * finally, if those succeeded, remove the entry from the bedbase pipestat database.
fixed in 0.5.0
At present, there is no functionality to delete a bed file and all its related files on S3, both in the bed and bedset.