Pre-process the Datasets - Githubissues

ferdouszislam / Rainfall-Prediction-ML

Predict rainfall and waterlevel from other relevant weather data using data-mining techniques and machine learning. Weather dataset source: http://www.brri.gov.bd/site/page/2ded3c9f-593b-4434-9dda-20e6f77d47ab/-, Water-level dataset source: http://www.hydrology.bwdb.gov.bd/index.php?pagetitle=water_level&sub3=185&_subid=131&id=125&id2=126.

MIT License

0 stars 1 forks source link

Pre-process the Datasets #7

Closed ferdouszislam closed 2 years ago

ferdouszislam commented 3 years ago

Pre-process the waterlevel and weather datasets by

dropping or, filling missing values (give precedence to filling instead of dropping)
removing clearly invalid values
deal with outliers (what to do?)

New tasks:

[x] form a new weekly with data from all previous days (instead of their mean)
[x] pre-process the new weekly dataset and create final train-test datasets
[x] Create the dataset for classification using rainfall level margins from: http://live4.bmd.gov.bd/file/2016/08/17/pdf/21827.pdf