CivicActions / edscrapers

US Department of Education Data Scraping Kit; see https://us-ed-scraping.ckan.io/dataset
GNU Affero General Public License v3.0
15 stars 9 forks source link

Improve stats through better RAG computation #112

Closed osahon-okungbowa closed 4 years ago

osahon-okungbowa commented 4 years ago

SITUATION

The current RAG computation for the project is performed on the raw/parsed datasets rather than the the datajson which has been processed for ingestion by the harvester. The side-effect of this is : stats/RAG displayed by the dashboard are misleading/inaccurate because a healthy amount of metadata is created during datajson processing/creation which are not captured by the RAG.

TASKS:

ACCEPTANCE CRITERIA

Task is related to this JIRA card + more

osahon-okungbowa commented 4 years ago

Est 1.5 days