search

datamade / nmid-scrapers

Scrapers for NMID
MIT License
0 stars 0 forks source link

Add filer type to financial disclosure scrape #3

Closed hancush closed 10 months ago

hancush commented 10 months ago

Each disclosure contains "Current Filing Status", which indicates the position the filer holds that requires them to file.

Screenshot 2024-01-03 at 9 27 45 AM

Include this information in the scrape.

fgregg commented 10 months ago

some of that information is already in the filing.csv file as "FilingRequirement".

ReportType,FilingRequirement,FilingYear,FiledDate,TotalCount,ReportFileName,ReportTypeCode,ScanFlag,isCheckinFlag,ReportStatus,DocumentFileName,ImageExists,ReportVersionID,ReportID,Type,Description,Date,Amount,Balance,Status,MemberID,Filed,IsLateFiled,FilerID
Financial Disclosure Statement,"    MILITARY BASE PLANNING COMMISSION ,    MILITARY BASE PLANNING COMMISSION ",2022,...
Financial Disclosure Statement, County Sheriff Catron   ,...
fgregg commented 10 months ago

The data on how they came to be in the office or the date of assuming office are not captured. do you need those now?

hancush commented 10 months ago

@fgregg Yes, that would be ideal, if it's simple enough!

fgregg commented 10 months ago

@antidipyramid, why don't you pick up this scraping task. let's talk about it on friday.