search

CivicDataLab / IDS-DRR-Assam

Intelligent Data Solution - Disaster Risk Reduction is a system to assist flood management in the state of Assam through data-driven ways. The repository contains codes to extract relevant datasets and the modelling approach used to calculate Risk Scores for each revenue circle in Assam.
GNU Affero General Public License v3.0
0 stars 0 forks source link

IDS-DRR | Curate a list of variables and data sources used in the current model #1

Closed apoorv74 closed 1 year ago

apoorv74 commented 1 year ago

For each variable, we need:

  1. variable_title
  2. variable_type (user-defined)
  3. data_source_title
  4. data_source_url
  5. update_frequency
  6. data_sourcing_methodology (manual/scraping/API/procuring-it)
  7. data_sourcing_script
  8. data_transformation_script
  9. type_of_values (numeric/categorical/other)
  10. variable_documentation (sourcing and transformation)
  11. last_update_date
  12. from_date
  13. to_date
apoorv74 commented 1 year ago
d-saikrishna commented 1 year ago

Here is the pipeline audit I created for all the variables that are used in the final SEM Model as of now:

https://docs.google.com/spreadsheets/d/1RRW5KZ1Csb3TPBgz_SZrtNSX3pT_W7upUE2wkHAoZOA/edit#gid=0

We should update this as and when more variables are used in the SEM Model.

Requesting @shreyaagrawal0809 to add scraper details on Assam tenders.

apoorv74 commented 1 year ago

@d-saikrishna - Please move the sheet to the shared project drive.

d-saikrishna commented 1 year ago

Moved it to this folder: https://drive.google.com/drive/u/1/folders/1JEEqsnYAVOBzT0b6Q13_5faLa94DpxcD