dali-lab / pine-beetle-automation

Server for automating the pipeline between ArcGIS and MongoDB.

https://spbpredict.com

1 stars 0 forks source link

data cleanup #160

Closed jeffzyliu closed 1 year ago

jeffzyliu commented 1 year ago

Description

lots of old <2010 rows with no trapping or spots data, some of those even have no spotst1t2. also most old rows have the calculated log/logit fields blank.

need permission to run some data cleaning on old <2021 data, and then change sparse fetch on backend to use the log spots maybe

Type of Issue

[ ] New feature
[ ] Bug fix
[ ] Documentation update

jeffzyliu commented 1 year ago

good to go

jeffzyliu commented 1 year ago

make sure to requireAuth on the new route

jeffzyliu commented 1 year ago

todo finish 2010 to now for the data cleaning

jeffzyliu commented 1 year ago

add a ~10 year limit to prevent crashes on heroku