Open galbwe opened 3 years ago
@galbwe Can I get this assigned?
Hey @kaleeaswari if you can focus on the Colorado Non-profits (CNP) data, that would be the most helpful. We currently aren't using the socrata dataset because it was missing most of the relevant information for the app.
The files you will want to look at are scrape_CNP.py
and tasks.py
. A good start would be to filter out the records that are missing all of the fields needed for the the table on the homepage. There are other things to do like making sure strings are formatted consistently, and removing records for nonprofits with obvious religious affiliations.
Mandatory fields to consider a lead : Name, Contact, Website, SocialMedia. Is that correct?
@galbwe
I think they all have the Name field. If a lead is missing Contact, Website, Facebook, Twitter, Instagram, and LinkedIn, then it should be dropped.
find_socrata_api_leads
task (intasks.py
), or can be done in a separate task intasks.py
that runs afterfind_socrata_api_leads