issues
search
SEFSC
/
SEFSC-SFD-CFB-TIP-Compositions
Other
1
stars
0
forks
source link
Full TIP Tag Up 11/17/2023
#14
Closed
KatGodwin-NOAA
closed
6 months ago
KatGodwin-NOAA
commented
10 months ago
Agenda for November 17:
Progress report:
Data Flagging project
Historical Data project
Progress
Last full team meeting was Nov. 2; Next one is Nov. 30?
Data Flagging project
[x] Met with Adyan to explore Kruskal Wallace code
[x] Moved files to GitHub repository
[x] Met with Kyle Dettloff for help with glm analysis
[x] Continued markdown of general flagging code
[x] Continued work with sub-milestones of "Explore data with figures"
[x] Continued work with SEDAR 84 gear groupings
[x] if we only use years with more than 30 unique trip IDs, we are reduced to 12 years of data
Historical Data project
[x] Follow up on date glitch between Oracle and Historical datasets:
[x] put together code to hardcode daylight savings glitch correction
daylight savings seems to be fixed, did Sarah update this? (I ran tests on various years and dates are aligning now
[x] Continued work on consolidating muni code tables across projects (TIP, historical, MER, and MRIP)
[x] ArcGIS map of overlapping dates between MER and MRIP
Next Steps
Continue work on quarto markdown of data consistency visualization across area and time focusing on utilizing past SEDAR strategies
Streamline markdown of SEDAR 84 size comp
Comparison of historical and ORACLE data by combining the comparisons made by variable
Consolidation of muni code tables
Talk to OMI about who will be new Sandra
working meeting with Adyan and Molly
Revisit timeline with new project collaboration through March
working meeting to discuss
Begin species comparison in historical data
Sub Milestones: Data Flagging Project
Milestone 1 - Send funding to Contracting Agency and Cooperative Institution (DONE)
Milestone 2 - Develop data flagging system to be programed - 9/1/2023
July
Start exploring data with figures (in process)
Flagging needs to include data visualization work (oddities are often only noted when the data are plotted)
Reach out to projects for documents/updates (Completed)
Better understand complementary projects
Start annotated list of resources (in process)
Revisit specific flags from existing work; identify additional relevant work
Schedule status quo meetings for island specific (?) metadata review
Identify trends in reporting consistency across variables (table showing what has been reported and with what consistency?) (complete)
Revisit specific flags from existing work (S57, S46) (completed)
Revisit sub-milestones
August
Document new flags (in process)
Finalize reference library of past efforts (in process)
Revisit sub-milestones
Milestone 3 - Develop data visualization to be programed - 10/6/2023
September
Leverage documentation compiled for milestone 2
Meet with Molly to explore past SEDAR flagging automation (completed)
Explore SEDAR flagging automation with current SEDAR species ( in progress)
Incorporated documented flags into data visualization system (in progress)
Inform Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023
Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023
October
Move code to GitHub (in progress)
Incorporate flags and filters from visualization into filtering and binning process (in process)
Practice flags with SEDAR 84 (in progress)
Sub Milestones: Data Flagging Project
Look at how many unique interviews there for a given date(complete)
Interview date vs historical vs oracle # of interviews(complete)
Correct dates to historical dates (complete)
Areazip correction (in progress)
Look for sample_county_code table codes that have muni/county names that correspond to codes (complete)
Look in oracle tables and tip manuals: Once fixed, update reporting_area_zip/PLACE_ID
Match gear codes (complete)
Convert old species codes to itis
How many length records for each species
Possibly find # of matching and mismatching lengths
Agenda for November 17:
Progress report:
Progress
Last full team meeting was Nov. 2; Next one is Nov. 30?
Data Flagging project
Historical Data project
Next Steps
Sub Milestones: Data Flagging Project
Milestone 1 - Send funding to Contracting Agency and Cooperative Institution (DONE)
Milestone 2 - Develop data flagging system to be programed - 9/1/2023
July
August
Milestone 3 - Develop data visualization to be programed - 10/6/2023
September
Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023
October
Sub Milestones: Data Flagging Project