search

emo-bon / observatory-roskogo-crate

EMO BON observatory - logsheets
0 stars 0 forks source link

Duplicate rows #7

Open cpavloud opened 1 month ago

cpavloud commented 1 month ago

In water logsheets, EMOBON_ROSKOGO_Wa_210618_3um_1 is appearing twice

cpavloud commented 1 month ago

In sampling and measured

cpavloud commented 1 month ago

@melinalou

melinalou commented 1 month ago

I can only find one appearance.

cpavloud commented 1 month ago

It's twice.

Check here and here

melinalou commented 1 month ago

yes indeed..but you are looking in the transformed logsheets while I am working here https://docs.google.com/spreadsheets/d/1BCu2pbuIS4f-yrw5Kw4uzfO9v6ryZJBtSF5WBLWG_-E/edit?gid=15718907#gid=15718907 , where are not duplicates. From our conversation with Katrina I concluded that this is where I supposed to make any changes. Am I wrong?

cpavloud commented 1 month ago

So how there are duplicates appearing in the transformed logsheets if they are not in the raw ones? This is strange.

melinalou commented 1 month ago

I have no idea..

cpavloud commented 1 month ago

@kmexter @melanthia can you keep an eye on this?

kmexter commented 1 month ago

It is because the transformed ones were made months ago (check out the date in GH) and we have not been able to reharvest and QC since Bram left - @marc-portier and co need to get that action working again. So that duplicate has been corrected since the transformed CSVs were made but I did correct duplicate blank samples in the logsheet which I found when looking at them :-D

cpavloud commented 1 month ago

Ok! Could you let me know when you do the next harvest?

kmexter commented 1 month ago

@marc-portier take note - as this may happen while I am on vacation FYI Marc we have to talk next week as there are now half a dozen changes to the QC and TTL that have to change in the etl action. I will be raising issues next week on the action's repo to record that all