Some Surveys have values or 0s for num and num_cpue when they should have NA

AquaAuma / FishGlob_data

Database and methods related to the manuscript "An integrated database of fish biodiversity sampled with scientific bottom trawl surveys"

Creative Commons Attribution 4.0 International

21 stars 7 forks source link

Some Surveys have values or 0s for num and num_cpue when they should have NA #47

Open zoekitchel opened 3 months ago

zoekitchel commented 3 months ago

Some surveys have values or 0s for num when they should have NA (aka no data exist, not that 0 were found).

Specifically:

GMEX
GOA
NEUS
AI
DFO (HS, QCS, SOG, WCHG, WCVI)
SEUS
WCANN
WCTRI

zoekitchel commented 3 months ago

This issue was created in step where duplicate observations were removed (line 189 in ai_clean.R). I didn't realize that the output of sum(c(NA,NA,NA,NA,NA,NA,NA), na.rm = T) is 0, and not NA.

zoekitchel commented 3 months ago

I have updated the code, files in FishGlob_data/outputs/Cleaned_data (SURVEY_data.Rdata) and cleaned google drive files (SURVEY_data.csv).

zoekitchel commented 3 months ago

Unfortunately, the standardization code for the NEUS would never run fully for me after multiple attempts, so the neus_std_clean.Rdata file in the repository has NOT yet been updated. This still needs to be done.

AquaAuma commented 3 months ago

is NEUS the only code that needs an update? I can try next week