Scrape independent expenditure data

[hancush]

Scrape independent expenditure data from https://login.cfis.sos.state.nm.us/#/transaction/IE

To do this, page through the underlying API endpoint (https://login.cfis.sos.state.nm.us/api///Search/TransactionSearchInformation – use the Network tab in your console to see what those requests should look like). For each expenditure, get details and donors: https://login.cfis.sos.state.nm.us/api/Public/GetExpenditureDetails?transactionID=1284056&transactionVersID=1 https://login.cfis.sos.state.nm.us/api///Public/GetIEDonors?transactionId=1284056&transactionVersId=1

Combine these data sources into a single record that looks something like:

Transaction Date Reporting Entity Name Reporting Entity Type Payee Payee Type Payee Address Expenditure Amount Expenditure Description Election Type Election Year Reason Stance Donor Name Donor Address Donor Amount

Upload the final dataset to S3.

[hancush]

From https://www.fec.gov/help-candidates-and-committees/candidate-taking-receipts/understanding-independent-expenditures:

An independent expenditure is an expenditure for a communication that expressly advocates the election or defeat of a clearly identified candidate and which is not made in coordination with any candidate or their campaign or political party.

[antidipyramid]

@hancush

Each of these fields:

Transaction Date Reporting Entity Name Reporting Entity Type Payee Payee Type Payee Address Expenditure Amount Expenditure Description Election Type Election Year Reason Stance Donor Name Donor Address Donor Amount

other than the donor info look like they're recorded in the TransactionSearchInformation endpoint. Does that sound right to you? Is there anything in the transaction detail endpoint (i.e. GetExpenditureDetails) I'm overlooking?

[hancush]

I was working quickly, so it's very possible all of that info is in the main endpoint and we can save the request. Great spot, @antidipyramid.