search

opencivicdata / scrapers-us-municipal

Scrapers for US municipal governments.
MIT License
97 stars 66 forks source link

Add full text of versions #158

Open fgregg opened 6 years ago

fgregg commented 6 years ago

pupa now supports attaching the full text to versions of bills. RIght now we are only tracking the latest version full text in the extras field.

https://github.com/opencivicdata/pupa/blob/42fca48ec728c9c5e2f1f04488a4faa308fdc460/pupa/scrape/bill.py#L108-L112

Let's start capturing every version's full text, where we have access to the plain text of bills (not OCR).

This will necessitate a downstream change in django-councilmatic. So let's do this in two stages.

  1. add full text to versions
  2. update django-councilmatic to get the full text from that location
  3. remove full text from extras
fgregg commented 6 years ago

relates to https://github.com/datamade/la-metro-councilmatic/issues/128