QA/QC flags for bear den data

[popovs]

Develop scripts in R to flag data quality issues in the bear den data. Longterm, this QA/QC script should ideally eventually create an issue ticket for issues that it flags.

Bear dens current table flags

• [ ] Den ID must be unique
• [ ] Disaggregate Den ID and confirm prefix + location name are valid and match others in DB
• [ ] Required columns not NULL

Field visits table flags This table ideally gets scanned each day in the field, or potentially even after each new record is added.

• [ ] Field visits not matched to any bear den ID
• [x] Den Sample ID is unique
• [x] Date is valid
• [x] Required columns not NULL
• [x] Distance to nearest tree 25cm DBH is NULL
• [x] Distance to nearest tree 25cm DBH is NULL AND previous years are not NULL
• [x] Forestry verification column values not greatly different from in field values (verif value +/->10m difference OR 30% difference)
• [x] Forestry field + verification columns for a new field visit are both not NULL (in this case, copy over values from previous visit?)
• [x] All forestry GIS values are not NULL (same as above, just an extra flag to indicate if everything is null rather than 1 or 2 cols)
• [x] Forestry values are present in previous year but not current year
• [x] Bear den metrics (cup present, bed size, entrance width, etc.) are NULL
• [x] Bear den metrics are present in previous year but not current year
• [x] "Nearest Road Status Or Details" IS NULL
• [x] "X Patch Size Contiguous With Den" is NULL
• [x] "Proportion of Trees Windthrown Within 60m Den" is NULL
• [x] "Proportion of Trees Windthrown Within 60m Den" is NULL AND previous years have values
• [x] "Horizontal Visibility" is NULL
• [x] "Horizontal Visibility" is NULL AND previous years have values

[popovs]

Need to get a list of required not-null cols for both bear den tables

[popovs]

Required columns for field visits ('Unknown' or NA is ok, but there should be no blanks):

Den ID

• [x] Den ID
• [x] Sample ID
• [x] Surveyor(s)
• [x] Organization
• [x] Date Inspected
• [x] Bedding Cup Present
• [x] Indicator Change From Previous Visit
• [x] Claw or Bite Marks
• [x] Claw or Bite Marks Location
• [x] Hair on Entrance
• [x] Hair in Bed
• [x] Incidental Bear Sightings/Signs (scat, plug)
• [x] Den Status
• [x] Den Status Rationale
• [x] Den Flagging Or Signage
• [x] Indicator Left Description
• [x] Monitored by Camera
• [x] Hair Samples Taken
• [x] Hair Removed from Den Entrance
• [x] Forestry Treatment Description
• [x] Distance to Nearest Tree >25cm DBH
• [x] Proportion Forested within 60m of Den
• [x] Verification - Proportion Forested within 60m of Den
• [x] Distance to less than 40 yr forest
• [x] Verification - Distance to less than 40 yr forest
• [x] Distance to greater than 40 yr forest
• [x] Verification - Distance to greater than 40 yr forest
• [x] Distance to Nearest Built Road
• [x] Verification - Distance to nearest built road
• [x] Nearest Road Status or Details
• [x] Proportion of Trees Windthrown within 60m Den
• [x] Horizontal Visibility
• [x] Horizontal Visibility Reason
• [x] Photos to Document Forestry Impact

[popovs]

Possibly also flag 'forestry treatment description' in one year not matching other years?

[popovs]

Ideal future vision: store these QAQC flags as a SQL View rather than R script so it's a living document. Then develop Shiny interface to allow interactive viewing and editing of flagged data.