Open elopatin-uc3 opened 9 months ago
@elopatin-uc3 to file separate issue for a different Nuxeo harvest file name issue where ARK is included and file extension is excluded.
We will investigate if the compose plugin can be installed on linux
Comment: The S3 key used by these files includes the query portion of the URL.
<key>ark:/13030/m5r89gbn|1|producer/nuxeo.cdlib.org/Nuxeo/nxfile/default/cede1001-e4f1-4223-9a34-243da2296bcd/file:content/highlander_19731004_027.tif?changeToken=6-0</key>
Doing an ingest change on the pathname handling to remove the URL property will generate content under the correct pathname/key but original key and content will remain with the earlier version.
@elopatin-uc3 should set up a separate meeting to discuss. Consider inviting AT for Nuxeo details.
Discussed on 1/12. Subsequent meeting to be scheduled to talk about possible solutions. Initial work should include fixing the harvester so it disregards URL parameters and excludes them from file names; also should consider no longer using Add, but Update endpoint instead.
Work is being scheduled for eliminating the change token data currently in S3. In tandem, we will need to eliminate the creation of new data with query parameters.
Will modify Nuxeo client to eliminate any query parameter in filename.
Nuxeo client change to eliminate changeToken https://github.com/CDLUC3/mrt-atom/pull/8