Full TIP Tag Up 11/2/2023

Agenda for November 2:

Last full team meeting was Oct. 20; Next one is Nov. 17?

[x] Met with Molly and Adyan to set up meeting for file organization in GitHub (11/1)
- [x] File structure in place worked well
- [x] Added branches to work within and will pull from main when needed
[x] Continued work with sub-milestones of "Identify trends in reporting consistency across variables"
- [x] Began markdown of code to be moved to GitHub
[x] Continued work with sub-milestones of "Explore data with figures"
- [x] Supplied Caribbean Index and Discharge meeting with gear grouping visualization using updated S80 aggregated density plots
- Groupings of Nets, Pots and Traps, and Hand Lines are most frequently used across all islands for Yellowtail Snapper
[x] Explore SEDAR flagging automation with current SEDAR species
- [x] Working meeting with Sarah showed distance to shore may need to be investigated

[x] Finalized date glitch between Oracle and Historical datasets:
- Dates misalign from Jan 1 to April 1 and November 3 to Dec. 31. The historical records are labeled as one day later than the Oracle records for these sets of dates.
- New Theory: daylight savings
[x] Began work on consolidating muni code tables across projects (TIP, historical, MER, and MRIP)

Continue work on quarto markdown of data consistency visualization across area and time focusing on utilizing past SEDAR strategies
Comparison of historical and ORACLE data by combining the comparisons made by variable
Consolidation of muni code tables
Talk to OMI about who will be new Sandra
- working meeting with Adyan and Molly
Revisit timeline with new project collaboration through March
- working meeting to discuss

Start exploring data with figures (in process)
- Flagging needs to include data visualization work (oddities are often only noted when the data are plotted)
Reach out to projects for documents/updates (Completed)
- Better understand complementary projects
Start annotated list of resources (in process)
- Revisit specific flags from existing work; identify additional relevant work
Schedule status quo meetings for island specific (?) metadata review
Identify trends in reporting consistency across variables (table showing what has been reported and with what consistency?) (complete)
Revisit specific flags from existing work (S57, S46) (completed)
Revisit sub-milestones

Leverage documentation compiled for milestone 2
Meet with Molly to explore past SEDAR flagging automation (completed)
Explore SEDAR flagging automation with current SEDAR species ( in progress)
Incorporated documented flags into data visualization system (in progress)
Inform Milestone 4 - Develop data filtering and binning processes to be programed - 11/3/2023

Move code to GitHub (in progress)
Incorporate flags and filters from visualization into filtering and binning process (in process)
Practice flags with SEDAR 84 (in progress)

Look at how many unique interviews there for a given date(complete)
1. Interview date vs historical vs oracle # of interviews(complete)
2. Correct dates to historical dates (complete)
Areazip correction (in progress)
1. Look for sample_county_code table codes that have muni/county names that correspond to codes (complete)
2. Look in oracle tables and tip manuals: Once fixed, update reporting_area_zip/PLACE_ID
Match gear codes (complete)
Convert old species codes to itis
How many length records for each species
Possibly find # of matching and mismatching lengths