This commit will update Bulkrax to from v5.2.1 to v5.3.1 on a special branch to turn the DownloadCloudFilesJob from a perform_now to a perform_later. Logging information was added to help monitor the download progress.
When using Browse Everything to import files, the page would lock up until the download was finished because the DownloadCloudFilesJob was doing a #perform_now. This would be particularly problematic for large files that may take a long time to download and eventually time out.
Expected Behavior After Changes
When using Browse Everything to import files, the page would redirect immediately because the DownloadCloudFilesJob is now being run asynchronously as a background job. Rails logging has been added to help devs monitor the download progress.
Story
This commit will update Bulkrax to from v5.2.1 to v5.3.1 on a special branch to turn the
DownloadCloudFilesJobfrom a perform_now to a perform_later. Logging information was added to help monitor the download progress.Ref:
Expected Behavior Before Changes
When using Browse Everything to import files, the page would lock up until the download was finished because the
DownloadCloudFilesJobwas doing a#perform_now. This would be particularly problematic for large files that may take a long time to download and eventually time out.Expected Behavior After Changes
When using Browse Everything to import files, the page would redirect immediately because the
DownloadCloudFilesJobis now being run asynchronously as a background job. Rails logging has been added to help devs monitor the download progress.Screenshots / Video
https://github.com/scientist-softserv/britishlibrary/assets/19597776/3a1857bf-005c-45f1-a9cc-995c68868502