uclibs / scholar_uc_legacy

Source code for Scholar@UC up to version 3.x. Replaced by ucrate
Other
5 stars 1 forks source link

Verify box.com file imports are working properly #1950

Closed hortongn closed 5 years ago

hortongn commented 6 years ago

Descriptive summary

We are getting a lot of failed background jobs (ImportUrlJob) when users try to add files from box.com to a work.

I've tried it myself on production and it worked for me, but there must be situations when it doesn't work (large file sizes, new vs. existing work, etc).

Example error:

2018-08-22T14:46:27.958Z 23741 TID-ov9afc6x0 WARN: RuntimeError: Failed to attach cloud file to file_set with uri: https://dl.boxcloud.com/d/1/b1!4aRDO5CMayesL5wT6NyrzoqHpKmLiXRooUaPLmYgmz3zM7YVmqPAWu7e8buoduEPyROdx3GdZNLCjVrYla6SNdEHk4ina1ST-o1pVXr4lDAGOqE9pNuINorLfuoPzDs7uklwMC_S_MPzhNzIBc_KJliOl7xOZ7CvEgQs6Eg_FtorSIsbn6v76EmSdOpwt9TvObFbd0bQbDC8bZJzFyV7GIsC0g91P19c7ju_bm3GT9kAqnZKEa1EzNCZfTFOryhtTQYds7TmDjAcTHaF6F7MeBs2hlOaQSkzsBDFJIEqkUJ69A6sNqqtrDzjSYD3xKkRa_lLQ3JGrno6RVB7nNGhtOfEmO2dRzo9OxlDT0Za5cRVxy_o-PI7JGojj5W-nBITYC8MCRd9UzTAzT3V18Q3iJWCTQRfdxW45u2hjfFwtyayU-84M_Thw2lMcoD6bGpazP9VQVz5DQFg4Nq4_07iTO52nd77S_gVQ8CggYXEIiMRgbTKOLVUQiVFlH1YJ-HitYGhQB__z-twF_jORfE_FFXOIKWpLjTJyk9LNsAL8yzCoRbVUokTJlfOYQU1zAy5aKxUDVnzaY4WRKXaotW5yHjRtIQslaa_u5WPU6E_nEMS2XbQjUtMWBB-PdRUxqkAwj0ajoa9DF4EXIq4E_Ew5dY36OxpneJOf1-jBsYTJVRkRSz8Ar6ubQvKor2qGmwoyHosnDV0fQ_U2FPnGj56UI2G5cGLbJ8RZNFTu6Ci8WyitzldiMp7V0O6vawq9Sx_MdWGDTyhDNK40cv5LbIONvyOtULg6vxiR05oxxR_Qm5DgiXY_8CbHZjpmwGzhosnsWr2udNSYMsNNp4FfxMn
7a3ngfg2BYYfWcXyC2w_iG0VAcqGdt5eDY9C5jtgoHlfOlrmncRJjzcU67wl4Aheb976NoCpiS-ZlSrKeW28fy6o1hHWPJJBSS_xbj8sFPUHhNnbiJ6uLJMr-AaPUsnhrfQgYuSkwo2VN5AGN4L3jnlg9VZFxF7ZdA_ai7RM_ArIoIjMdOgA9_pQXjQwLuzzavpObwMbnlmOjzby1el-XqdGzeL0fRVF45_xNYPpzDDlw-3LI0yM8fasmfXgZqX2-nSVEOw1cIrjaeYa8YGltAowQvUDikNhx7CGDOiT6TRgmjVd7nYcxCDnDHZ6BPQtMdNTTzUfmeIuLMNuaWfy6zpLUbw_JUD_hTBMlsCRpiN2ooPrZnwNa9xNSOsHpSKqLGpPTwS0QjR7fowUphC7LN46SAynSbRg163o8ZVz4en0IA../download.
2018-08-22T14:46:27.958Z 23741 TID-ov9afc6x0 WARN: /srv/apps/curate_uc/app/jobs/import_url_job.rb:17:in `get_follow_redirects'
hortongn commented 5 years ago

Determined this was a problem with very large files being uploaded for the Winkler Center timing out.