Seed Data

[dragosrotaru]

Seed Data

OSCMS has a roster on google sheets I have gone through and grabbed every Facebook group (and page) id from (187 total). Roster:

https://docs.google.com/spreadsheets/d/1JH5uL3WW6PwvwFRe4wqXkheK0-jcGYqaPmb9J3Dr6Ac/edit?fbclid=IwAR3FX_xPe-bYbXQmjsXF5FUr7aISp27wGwHXuNIWzh92ScdQQSgVVrbixBo#gid=179139280

The data is available in data/facebook-group-ids-unclean.txt

Not all ID's are for FB groups though, so we need to pre-process them. Salty_Steve wrote a script to do that in Python but it doesn't work for all. Maybe it just needs rate-limiting implemented. See scripts/facebook-group-id-validator.

fix scripts/facebook-group-id-validator and product a clean file of group IDs called data/facebook-group-ids.txt. This is critical, please manually check your work. We need clean data.

[dragosrotaru]

Requirements

• Don't commit data (except for facebook-group-ids.txt), private info, credentials, etc.
• use conservative rate-limiting and a dynamic DOM renderer like selenium or Puppeteer.
• the script should get FB_USERNAME, FB_PASSWORD + MongoDB credentials via .env file
• Your script should not only output a CSV, but also save to a local MongoDB collection called group-ids.