search

marinebon / p2p

Pole to Pole website
https://marinebon.github.io/p2p
3 stars 1 forks source link

Add in situ temperature data from MARINe and p2p Gdrive #25

Closed bbest closed 3 years ago

bbest commented 3 years ago

This is being handled by:

bbest commented 3 years ago

Hey @eqmh,

The EcoQuants intern Cristina @cdobbelaere and I added in situ temperature files here:

There in the README.md, you can follow links to the updated site pages. Cristina will be revisiting the code to produce non-MARINe sites in situ temperature data from the p2p Gdrive that produced some initial odd results (see screenshots below).

data/temperature_in-situ/README.md

In situ Temperature Files

These files (.csv, .yml) were generated from MARINe and Pole to Pole data using code found in the Github repository intertidal-temps, and more specifically ingest.Rmd by Cristina Dobbelaere CristinaDobbelaere@gmail.com and Ben Best ben@ecoquants.com.

NOTE: The sites that are not MARINe and in the P2P Google Drive folder still need to get checked and probably reproduced since the temperature values are oddly flat.

Screenshot examples

MARINe 👍 ✅

non-MARINe 👎 ❎

bbest commented 3 years ago

Hi @cdobbelaere,

FYI I'm noticing some odd parsing errors suggesting inconsistent columns:

https://github.com/marinebon/p2p/blob/e68110a1fa7bc9d226c8d4150939e127d78c119e/_temperature_in-situ.Rmd#L9

Warning: Warning: 5826 parsing failures.
 row       col           expected actual                                                              file
1480 Low       1/0/T/F/TRUE/FALSE  10.95 '/Users/runner/work/p2p/p2p/data/temperature_in-situ/usa-hop.csv'
1480 Lower-Mid 1/0/T/F/TRUE/FALSE  10.91 '/Users/runner/work/p2p/p2p/data/temperature_in-situ/usa-hop.csv'
...
Warning: Warning: 1672 parsing failures.
 row       col           expected actual                                                              file
1007 Upper-Mid 1/0/T/F/TRUE/FALSE  12.99 '/Users/runner/work/p2p/p2p/data/temperature_in-situ/usa-pbl.csv'
1008 Upper-Mid 1/0/T/F/TRUE/FALSE  12.99 '/Users/runner/work/p2p/p2p/data/temperature_in-situ/usa-pbl.csv'
...
Warning: Warning: 224 parsing failures.
 row       col           expected actual                                                              file
1269 Lower-Mid 1/0/T/F/TRUE/FALSE  26.64 '/Users/runner/work/p2p/p2p/data/temperature_in-situ/usa-rmr.csv'
1270 Lower-Mid 1/0/T/F/TRUE/FALSE  18.55 '/Users/runner/work/p2p/p2p/data/temperature_in-situ/usa-rmr.csv'

But those above are for the MARINe sites, not the problematic other ones.

cdobbelaere commented 3 years ago

Hi @bbest, Sorry for the late response! Looking into it now. I did fix the smoothing issue with the problematic p2p gdata sites.

bbest commented 3 years ago

Looking good now! Nicely done @cdobbelaere 🥳

For example:

OLD non-MARINe 👎 ❎

image

NEW non-MARINe 👍 ✅

image

bbest commented 3 years ago

With commit: + "ºC" ylab to plot_dygraph() · marinebon/p2p@502a9af

Improvement: added ºC to y-label

image

bbest commented 3 years ago

Hey Ben, Cristina,

Edgardo was able to pull the data from the loggers he installed in Gorgona Island (Colombia). The 024537 is the sun-exposed logger and the 024444 is the shaded one.  The loggers registered temperatures above 52 C.   The files are also stored in the GDrive.   Let me know when we can meet with your intern at Caltech to look at these records. Edgardo, let me know if you would like to participate in the discussion about advancing this tool.

Cheers, Enrique

bbest commented 3 years ago

Hey @eqmh,

So @cdobbelaere and I got this going for Gorgona Island (Colombia) with the new shading to min/max she also implemented for all other non-MARINe sites (see [data/temperature_in-situ/](https://github.com/marinebon/p2p/tree/master/data/temperature_in-situ) except MARINe_sites.csv):

image

eqmh commented 3 years ago

Hi @bbest and @cdobbelaere, Very cool! Glad to see this already up and running on the website. Great work, thanks! Let's chat about automating the workflow to update these time series plots as new data becomes available.