search

jbrzusto / TO_DO

sensorgnome / motus TODO list for jbrzusto
0 stars 0 forks source link

Upload errors project 120 #180

Closed zcrysler closed 6 years ago

zcrysler commented 6 years ago

A large number of uploads for project 120 got processing errors last night, they all seem to get errors with SGfindtags for receiver SG-0816BBBK0C16:

160744 SGfindtags 2018-03-08 21:52:28.978Z Error serno = SG-0816BBBK0C16; monoBN = 244; canResume = true
160745 SGfindtags 2018-03-08 21:52:29.015Z Error serno = SG-0816BBBK0C16; monoBN = 245; canResume = false

Can these be re-run?

jbrzusto commented 6 years ago

These failed due to a bug I introduced yesterday and fixed today. But as a separate item, users should be upload all files for a given receiver in a single archive. (At least not in separate archives at the same time.) So that way, a single main job is run to process the files, not a whole bunch. And there may still be a bug if multiple uploads for the same receiver happen at the same time: jbrzusto/motusServer#341 Can you suggest improvements to the wording of the instructions on the upload page to make it more clear to users that they shouldn't do this?

jbrzusto commented 6 years ago

That receiver is being rerun: https://sgdata.motus.org/status?jobID=160919

jbrzusto commented 6 years ago

As a separate issue, that receiver went into a weird mode starting June 6 where it reboots every 24 hours. This is probably an issue with the solar charge controller, or the power supply on site? It doesn't seem to be affecting data acquisition except for losing a couple of minutes of listening time each day.

~minutes. This looks like one of the watchdog timers going off and causing a reboot, but I don't get why, since the antennas appear to be working. (The 20-minute watchdog checks every 20 minutes to make sure there's at least one USB device attached; if not, it assumes the hub got unplugged and replugged, which doesn't work on the current beaglebone SG. But the antennas are working, so the watchdog should not bark!)~ (No, I got tricked by diff.POSIXct returning values in different units depending on the magnitude of differences it finds. Not helpful!)

zcrysler commented 6 years ago

What about replacing "Please do not upload sensorgnome .txt/.gz files individually and please do keep all files from a receiver together in the same archive" with "Please do not upload sensorgnome .txt/.gz files individually, and please do keep all files from a receiver together in the same archive, ie. zip together all daily files within the SGdata folder"

jbrzusto commented 6 years ago

Here's what I went with:

ie. make one big zip file that includes all days of data from your SG