search

jbrzusto / TO_DO

sensorgnome / motus TODO list for jbrzusto
0 stars 0 forks source link

Missing upload, project 14 #152

Closed zcrysler closed 6 years ago

zcrysler commented 6 years ago

An upload titled "lhpr_08142017" for project 14 doesn't seem to be in the system, it may have been uploaded prior to the new process which would explain why it's not appearing on the status page, but there's no data for it past April in the hourly plots or the .motus files: https://sgdata.motus.org/download/14/SG-1914BBBK0875-2017_Loring_LHPR_hourly_tags.pdf.

Is there any record of this data being uploaded? Trying to sort out if this was an interrupted upload or an issue with processing

jbrzusto commented 6 years ago

This upload is present on old server as: /raid5tb/uploads/files/pam.loring/pam.loring:2017-08-15T14-48-02.055:lhpr_08142017.zip Only uploads after 2017-08-21 or so are explicitly recorded on the new server; data uploaded before that date were synced directly from the file_repo in one go, rather than broken up by uploaded file. However, that uploaded file's contents have been processed:

zcrysler commented 6 years ago

I'm still confused - from what you sent it looksl like there was data for 2017-08-14, but it's not in the hourly plots or the current .motus files. Since they're all listed as 0% above, does this mean that those files are included in the jobs you're de-bugging? I think there should be data from 2017-03-18 to 2017-08-14

jbrzusto commented 6 years ago

The listing above is a bit confusing, as the dates on the left represent when the file was created on Pam's machine, but the data are from the dates embedded in the filenames you see when scrolling all the way right, e.g. 2017-04-02T23-50-20. for the last file. The 0% is about compression ratio. Sorry - it's a raw zip listing which I should have editted down. It says nothing about the state of the server, or data, other than to tell us which files were received.