denshoproject / ddr-cmdln

Command-line tools for automating the Densho Digital Repository's various processes.
Other
0 stars 2 forks source link

Add tools to better manage git-annex remotes and DDR inventory #243

Open gjost opened 2 months ago

gjost commented 2 months ago

We discovered that git annex special remotes for backing up our binary files were not as up-to-date as we thought. This was due to a lack of data about the status of DR collection repositories and their remotes, which led to a breakdown of manual backup processes.

gjost commented 1 month ago

I ended up adding the following:

ddrremote copy

Wrapper around the git annex copy command that works with both rsync and b2 remotes, and which logs metadata about the copy operations.

ddrinventory report

Gathers data from local repositories, Cgit on mits2, and specified git annes special remotes to report the state of various parts of the Repository.

gjost commented 1 month ago

We have a good-enough solution for the time being. Revisit later for something better...