search

OSC / ood-fileexplorer

[MOVED] The Open OnDemand File Explorer
https://osc.github.io/Open-OnDemand/
MIT License
4 stars 1 forks source link

Large passenger downloads are filling up /tmp #126

Closed brianmcmichael closed 8 years ago

brianmcmichael commented 8 years ago

Report from systems that /tmp was filling up on webdev02 INC0307858

Analysis revealed a user attempting to download a 10GB file in the file explorer app was causing the /tmp dir to fill. Currently /tmp only has about 8.5GB space free on a 10GB mount.

This appears to be an issue with Passenger 4.0 buffering data to memory, and then to disk if the file is too large. It can be corrected by an upgrade to Passenger 5.0, which is not viable currently because it is not in the Software Collections library.

As a workaround, the plan is the create a new infrastructure route which will allow for direct downloads through the NGINX server. See https://github.com/OSC/nginx_stage/issues/10

Once the new route is in place, ood-fileexplorer will need to be updated to utilize the infrastructure path for file download requests. (Currently planned at pun/files/<path>/<to>/<file>)

brianmcmichael commented 8 years ago

Update

New route is in place. Path spec is:

pun/download/<path>

ericfranz commented 8 years ago

In the .env file we probably should put a download path env var with the default value (when the env is not provided) being the internal api of the app.

brianmcmichael commented 8 years ago

done, along with modifications to nginx stage, in v1.2.0