Open cziaarm opened 7 months ago
Update on staging for this...
This item was uploaded via browse everything "Add cloud Files" which I believe uses the same import_url method as Bulkrax
https://bl.bl-staging.notch8.cloud/concern/articles/99ea5d13-f282-4260-8659-231e0e64e7df?locale=en
Is retrievable but currently with a somewhat awkward filename...
Update for @NoraRamsey... filenames and should now be behaving on staging. please confirm
Testing on staging
Additional testing on staging
@cziaarm BE looks to be working great. Thank you! I've successfully uploaded an 88GB file.
@NoraRamsey before we approve this ticket, can you please test that all of the usual upload/import methods still work on staging (you only need to use small files for this)?
Final testing on staging
Works as expected
Testing on demo
Additional testing on demo
Story
PUT request to fcrepo (with sS3) for larger files are failing due to memory use. These request are missing filesize according to this warning:
WARN 09:58:05.429 (AmazonS3Client) No content length specified for stream data. Stream contents will be buffered in memory and could result in out of memory errors.
and it is coming true when files are > 1 or 2 GB
org.glassfish.jersey.server.ContainerException: java.lang.OutOfMemoryError
I think that this would be solved with a fedora build that used a version of modeshape that includes this change: https://github.com/ModeShape/modeshape/pull/1654/files
Acceptance Criteria
Screenshots / Video / Stacktrace
Testing Instructions and Sample Files
-
Notes