JustZack / audit-congress

A website collecting & displaying information about the activities of congress.
0 stars 0 forks source link

Complete Bulk-Bill-Pull script #86

Closed JustZack closed 5 months ago

JustZack commented 6 months ago

this script pulls most of the available info from bills right now, but not all of it makes it into the database.

Revise table schema as needed to ensure the entire bill object makes it into the database.

Specifically need:

  1. Policy Area (in json this is subjects_top_term)
  2. Text versions (Between 0 and many per bill)
  3. Actions (Between 0 and very many per bill)

Ensure this works for the JSON and XML file types. Note that the JSON is not 1:1 mapping of XML, and some things may need to be inferred.

JustZack commented 5 months ago

NOTE: Amendment fetching is being pushed up because they pose a larger change to the code in order to fix the right way.

91 and #90 document this.