cianfrocco-lab / COSMIC-CryoEM-Gateway

Web platform for analyzing cryo-EM data on Comet cluster at San Diego Supercomputer Center
http://cosmic-cryoem.org
GNU General Public License v3.0
9 stars 1 forks source link

Storage value on Portal doesn't agree with data size on gateway #289

Open mcianfrocco opened 3 years ago

mcianfrocco commented 3 years ago

Right now if you upload the tutorial dataset (3.2GB), the portal only says 472 KB uploaded:

Screen Shot 2021-01-07 at 5 01 02 PM

mcianfrocco commented 3 years ago

Leave size of each file as data items, but show full size from 'du' as the portal value.

Q: when to update this value? Once a day? How long would this take each time it checks?

mcianfrocco commented 3 years ago

@kenneth59715 - get total data upload in a globus_transfers directory and update hourly in a chron job