search

crkn-rcdr / Digital-Preservation

Documentation and related schemas for the CRKN digital preservation system
3 stars 0 forks source link

Archivematica storage service connector for Swift may not support large objects #12

Closed RussellMcOrmond closed 9 months ago

RussellMcOrmond commented 4 years ago

For objects larger than "Swift max file size" (Which we have at the default of 5G), uploads need to be divided into segments and a manifest uploaded.

Archivematica uses python-swiftclient. The client seems to support large object (Static Large Objects=SLO, Dynamic Large Objects=DLO), but the specific way Archivematica is using it seems not to.

RussellMcOrmond commented 4 years ago

Archivematica is using put_object() while the upload service seems to support large objects.

It may be simplest for us to author an update than to add other layers (Such as Duracloud)

RussellMcOrmond commented 3 years ago

Sorry -- this is longer-term work that will be in a different project. For now we only need to be aware of the issue.

RussellMcOrmond commented 2 years ago

Issue filed within Archivematica project: