P3 Parsing: Office of Postsecondary Education

[nightsh]

ref. #5

Create a HTML parser that integrates into the OPE scraper and replaces the existing dummy parser script.

Tasks:

• [x] identify the possible page structures in the target site
• [x] write one or multiple parsers that cover as many cases as possible
• [x] test if it runs well within the pipeline

Acceptance criteria:

• [x] we have a parser specific to this site that replaces the initial dummy parser
• [x] parser creates Dataset instances, each having at least one Resource
• [x] uses scrapy pipelines to dump dataset

TBD: List of potentially different structures and one or two false positives to test the scraper against.

[osahon-okungbowa]

Will start work on this early tomorrow

[osahon-okungbowa]

All tasks completed. Pending pull request