search

USEPA / Phytoplankton-Data-Analysis

Phytoplankton Data Analysis
3 stars 0 forks source link

Storet vs. spreadsheets #37

Closed mjpdenver closed 9 years ago

mjpdenver commented 10 years ago

Using the large query of storet results provided by Jake

The storet query provides some data for 20 of the 31 lakes represented in the algae database.

The existing water quality file created from the spreadsheets contains data from 8 of the 31 lakes. All lake represented in the spreadsheet based files are represented in the storet files.

wrt. years of coverage, the storet data is decidedly more complete from 2000 - 2011. No data is reported before then. Would this be in the historical storet dataset?

From the spreadsheets we have 1992, 1993, 1995 and 1998 data. The rest of the years from 1988 to 2000 are largely empty.

jbeaulie commented 10 years ago

I'm glad we took the time to look into this. Did you write out the formatted storet data to a file?

Older data may be in the historical storet database. I'll see if I can find anything in there.

jbeaulie commented 10 years ago

No additional data in the Legacy Storet database.

mjpdenver commented 10 years ago

I added the storet dat to a file processed_data/storet.0605.csv.

jbeaulie commented 10 years ago
mjpdenver commented 10 years ago

The spreadsheet data will be re-formatted to create a data.frame with similar names as the storet data. There will be some incomplete fields in the older data as it is not nearly as complete or consistent as the new data.

The WQ data should merge with the algae data by sample ID or the equivalent fields ( 2, lake, station, date, depth).

Date: Tue, 10 Jun 2014 07:16:25 -0700 From: notifications@github.com To: Phytoplankton-Data-Analysis@noreply.github.com CC: Matt_Pocernich@hotmail.com Subject: Re: [Phytoplankton-Data-Analysis] Storet vs. spreadsheets (#37)

This file looks pretty good. What is the next step to prepare it for merging with the other chemistry data file? Presumably the field names should be formatted to be consistent with the names used in the algae data.

— Reply to this email directly or view it on GitHub.

jbeaulie commented 10 years ago

The chemistry data files we received from Jade contain quite a few observations for 2011 and 2012. Lets combine 1992, 1993, 1995, 1998, 2011, and 2012 from the spreadsheets with the Storet data. Sound good?

jbeaulie commented 9 years ago

This has been completed. The STORET and water quality data from Jade have been formatted and merged via rbind().