search

SINTEF / olmo

SINTEF OceanLab Observatory data handling and storage
3 stars 4 forks source link

The 'main' db (azure) and the 'backup' (sintef_pc) aren't equal #81

Open WillRNaylor opened 2 years ago

WillRNaylor commented 2 years ago

The munkholmen pi data is no longer ingested into the backup.

Also I (william) can't log into that influx instance, and probably Lara can't either. If NTNU come along, then I think they will have a DB instance which will mean we can stop the backup sintef one.

emlynjdavies commented 2 years ago

what is the reason for the pi data not being included in this backup?

WillRNaylor commented 2 years ago

When the pi data was first added to the DB it was added as integers. This causes some errors which you noticed some hours after we switched to the methane-ingest branch. I dont' quite understand the errors, and it might be unrelated to that branch even. So to fix this error I copied the measurment (on azure) to another db, but when I copied over I made sure it had floats as the datatype. Then I deleted the data from the oceanlab db. Then I copied that copy back.

I don't have access to the sintef influx server, so to do this I would have to do a lot more things "in the dark" and many things I do would have to be done in a different way, so it's just a lot more work, which I don't think is worth doing. And of course if you just try to keep using the old measurement/table, then you will get errors, since the dtypes aren't consistent (remember also that everything in influx is immutable).