CivicActions / edscrapers

US Department of Education Data Scraping Kit; see https://us-ed-scraping.ckan.io/dataset
GNU Affero General Public License v3.0
15 stars 9 forks source link

[osers-parser-fix][fix]: handle cases where non-text content are passed to parser #119

Closed osahon-okungbowa closed 4 years ago

osahon-okungbowa commented 4 years ago

TASK TACKLED The osers parser is crashing on airflow. Upon further investigation, these bugs were fixed to prevent crashes/errors:

CONCLUSION

@nightsh please redeploy on airflow to confirm solution. other issues MAY arise from transformers package