Last full team meeting was Oct. 6; Next one is Nov. 2?
Data Flagging project
[x] Met with Molly to discuss data confidentiality and set up meeting for further file organization next month (10/11)
[x] Continued work with sub-milestones of "Identify trends in reporting consistency across variables" and "Explore data with figures"
[x] Helped with Caribbean Index and Discharge meeting with gear grouping visualization (10/10)
Groupings of Seine Nets, Pots and Traps, and Hand Lines are most frequently used across all islands for Yellowtail Snapper
[x] Explore SEDAR flagging automation with current SEDAR species
[x] Document notes with Quarto
Historical Data project
[x] Created new function with help from Sarina to pull from database by year and island
[x] Finalized date glitch between Oracle and Historical datasets:
Dates misalign from Jan 1 to April 1 and November 3 to Dec. 31. The historical records are labeled as one day later than the Oracle records for these sets of dates.
Theory: the oracle records have a time value when the historical do not. The time values for the misaligned dates are 23:00:00 while the time value for the aligned dates are 00:00:00. Possibly human error or system glitch caused the time input to be incorrect, thus pushing the dates back by one hour in Oracle to the previous day.
[x] Worked to align Muni codes and Place ID codes between datasets
There seems to be a typo in the ORACLE muni code table -> GUAYAMILLA should be spelled GUAYANILLA (it is spelled correctly in the correlating PLACE_NAME
[x] Worked to align gear_codes between tables
Notable difference: ORACLE uses "by hand, diving gear (snare)" when historical data uses "scuba diving" or "skin diving"
Next Steps
Continued work on data consistency visualization across area and time focusing on utilizing past SEDAR strategies
Comparison of historical and ORACLE data by combining the comparisons made by variable
Explore Area_codes from other projects and compare to historical areazip_codes
Restructure GitHub repo meeting on 11/1
Sub Milestones: Data Flagging Project
Milestone 1 - Send funding to Contracting Agency and Cooperative Institution (DONE)
Milestone 2 - Develop data flagging system to be programed - 9/1/2023
July
Start exploring data with figures (in process)
Flagging needs to include data visualization work (oddities are often only noted when the data are plotted)
Reach out to projects for documents/updates (Completed)
Better understand complementary projects
Start annotated list of resources (in process)
Revisit specific flags from existing work; identify additional relevant work
Schedule status quo meetings for island specific (?) metadata review
Identify trends in reporting consistency across variables (table showing what has been reported and with what consistency?) (in process)
Revisit specific flags from existing work (S57, S46) (completed)
Revisit sub-milestones
August
Document new flags (in process)
Finalize reference library of past efforts (in process)
Revisit sub-milestones
Milestone 3 - Develop data visualization to be programed - 10/6/2023
September
Leverage documentation compiled for milestone 2
Meet with Molly to explore past SEDAR flagging automation (completed)
Explore SEDAR flagging automation with current SEDAR species ( in progress)
Incorporated documented flags into data visualization system (in progress)
Inform Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023
Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023
October
Move code to GitHub (in progress)
Incorporate flags and filters from visualization into filtering and binning process
Sub Milestones: Data Flagging Project
Look at how many unique interviews there for a given date(complete)
Interview date vs historical vs oracle # of interviews(complete)
Correct dates to historical dates (complete)
Areazip correction
Look for sample_county_code table codes that have muni/county names that correspond to codes (complete)
Look in oracle tables and tip manuals: Once fixed, update reporting_area_zip/PLACE_ID
Match gear codes (complete)
Convert old species codes to itis
How many length records for each species
Possibly find # of matching and mismatching lengths
Agenda for October 20:
Progress report:
Progress
Last full team meeting was Oct. 6; Next one is Nov. 2?
Data Flagging project
Historical Data project
Next Steps
Sub Milestones: Data Flagging Project
Milestone 1 - Send funding to Contracting Agency and Cooperative Institution (DONE)
Milestone 2 - Develop data flagging system to be programed - 9/1/2023
July
August
Milestone 3 - Develop data visualization to be programed - 10/6/2023
September
Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023
October
Sub Milestones: Data Flagging Project