Full TIP Tag Up 1/4/2024

[KatGodwin-NOAA]

Agenda for January 4:

Progress report:

• Data Flagging project
• Historical Data project

Progress

Last full team meeting was Dec. 7; Next one is Jan. 17?

Data Flagging project

• [x] Continued markdown of general flagging code
• [x] Completed glm analysis of pr_yts, sttj_yts, and stx_slp size comp tip data
• [x] Continued work with sub-milestones of "Explore data with figures"
  • [x] Continued work with SEDAR 84 gear grouping figures
    • pr yts, sttj yts, and stx slp are complete
• [x] Began work on working papers (stx stp) for SEDAR 84 size comp analysis using SEDAR 57 guidance
• [x] Met with Molly and Adyan about project's next steps
  • [x] Began correspondence with Michael Holley about replacement for Sandra

Historical Data project

• [x] Discussed collaboration with PR on compiled sampling site list
  • Will reach out to Steph about her work on it when she returns from leave
• [x] Began work with species comparison

Next Steps

• Working papers for sttj yts and pr yts
• Comparison of historical and ORACLE data by combining the comparisons made by variable

Sub Milestones: Data Flagging Project

Milestone 1 - Send funding to Contracting Agency and Cooperative Institution (DONE)

Milestone 2 - Develop data flagging system to be programed - 9/1/2023

July

• Start exploring data with figures (in process)
  • Flagging needs to include data visualization work (oddities are often only noted when the data are plotted)
• Reach out to projects for documents/updates (Completed)
  • Better understand complementary projects
• Start annotated list of resources (in process)
  • Revisit specific flags from existing work; identify additional relevant work
• Schedule status quo meetings for island specific (?) metadata review
• Identify trends in reporting consistency across variables (table showing what has been reported and with what consistency?) (complete)
• Revisit specific flags from existing work (S57, S46) (completed)
• Revisit sub-milestones

August

• Document new flags (in process)
• Finalize reference library of past efforts (in process)
• Revisit sub-milestones

Milestone 3 - Develop data visualization to be programed - 10/6/2023

September

• Leverage documentation compiled for milestone 2
• Meet with Molly to explore past SEDAR flagging automation (completed)
• Explore SEDAR flagging automation with current SEDAR species ( in progress)
• Incorporated documented flags into data visualization system (in progress)
• Inform Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023

Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023

October

• Move code to GitHub (complete)
• Incorporate flags and filters from visualization into filtering and binning process (in process)
• Practice flags with SEDAR 84 (in progress)

Sub Milestones: Data Flagging Project

1. Look at how many unique interviews there for a given date(complete)
   1. Interview date vs historical vs oracle # of interviews(complete)
   2. Correct dates to historical dates (complete)
2. Areazip correction (in progress)
   1. Look for sample_county_code table codes that have muni/county names that correspond to codes (complete)
   2. Look in oracle tables and tip manuals: Once fixed, update reporting_area_zip/PLACE_ID
3. Match gear codes (complete)
4. Convert old species codes to itis (in progress)
5. How many length records for each species
6. Possibly find # of matching and mismatching lengths