P5 Parsing: Office of Special Education and Rehabilitative Services

[nightsh]

ref. #7

Create a HTML parser that integrates into the OSERS scraper and replaces the existing dummy parser script.

Tasks:

• [x] identify the possible page structures in the target site
• [x] write one or multiple parsers that cover as many cases as possible
• [x] test if it runs well within the pipeline

Acceptance criteria:

• [x] we have a parser specific to this site that replaces the initial dummy parser
• [x] parser creates Dataset instances, each having at least one Resource
• [x] calls dataset.dump() method and dumps serialized output in a directory specific to this scraper

TBD: List of potentially different structures and one or two false positives to test the scraper against.