search

archivematica / Issues

Issues repository for the Archivematica project
GNU Affero General Public License v3.0
16 stars 1 forks source link

Move default AIP and DIP storage locations outside the shared directory #406

Open jraddaoui opened 5 years ago

jraddaoui commented 5 years ago

Please describe the problem you'd like to be solved.

In the startup process of the SS, default locations are crated for the AIP and DIP storage and for the transfer backlog. This locations are created in a path that matches the default shared directory declared in the configuration of the AM pipeline. When an AM pipeline is registered in the SS, the shared directory config path is passed to create the currently processing location in the SS for that pipeline, this match is a requirement for both systems to work properly, but there should not be the same requirement for the default AIP and DIP storage locations and having them inside the shared directory may lead to some confusions.

For example, after the changes for https://github.com/archivematica/Issues/issues/312, the total space of the disk where the shared directory is located will be shown among other sub-directories in the usage page, but the AIP and DIP storage paths will be moved to the SS locations page, showing the used and quota values from the SS. Having those location inside the shared path could make the information in the usage page not really relevant.

Moreover, the transfer backlog is located inside the AIP storage location by default, but the transfers size is not being considered in the AIP storage quota.

Describe the solution you'd like to see implemented.

We could move the default AIP and DIP storage locations to a path similar to the one used for the SS internal processing location, not related to any AM pipeline shared path.

However, it seems like the transfer backlog location has the same requirement as the currently processing location, as it's needed for the SIP arrange process in the dashboard. So we may need to keep this location inside the shared path of the related pipeline. But, instead of creating a default transfer backlog location inside the default shared directory path, we could should one for each pipeline when it's registered in the SS, like we do with the currently processing location, where the actual shared path (not the default one) is passed.

Describe alternatives you've considered.

Additional context

For Artefactual use: Please make sure these steps are taken before moving this issue from Review to Verified in Waffle:

jraddaoui commented 5 years ago

Hi @sevein, @scollazo and @ross-spencer, we'd like to hear your thoughts about this issue.

sevein commented 5 years ago

We could move the default AIP and DIP storage locations to a path similar to the one used for the SS internal processing location, not related to any AM pipeline shared path.

Good idea, @jraddaoui!

I noticed the other day that the Dashboard kind of assumes that there is only one transfer backlog location but you can associate many to a single pipeline in the Storage Service, right? In any case, transfer backlog is something that we're also revisiting for SFU and more details about the plan should appear soon, CC @peterVG.

ross-spencer commented 5 years ago

Some adjacent notes to refer back to as I work through this issue:

ross-spencer commented 5 years ago

As a solution to this begins to appear then it might also take into consideration this ticket here: https://github.com/artefactual/archivematica/issues/1093

jraddaoui commented 5 years ago

See also #407.