pyladies / global-organizing

Repository to track global organizing

46 stars 14 forks source link

Add MeetUp scraper script #40

Closed lorenanicole closed 4 years ago

lorenanicole commented 4 years ago

Overview

Inspired by https://github.com/pyladies/pyladies/pull/434 ... this PR adds a MeetUp scraper script for us to pull down up-to-date info on Pyladies MeetUp chapters! This uses the list found on the PyLadies website.

Scope of Work

README.md explaining how to run the script
pyladies-meetup-scraper.py to run the actual script to:
- Download the pyladies/pyladies repo config.yml with meetup info
- Get MeetUp API token
- Download the group info (only single endpoint, no batch endpoint) and ensure within ratelimit
- Output a new *.yml of meetup chapter info
simple_server.py for use in helping create a callback url in getting MeetUp token access

lorenanicole commented 4 years ago

Thanks @Mariatta I'm going to merge for the sake of getting it merged but when I come back and do another sweep on these scripts (the twitter script uses .env too) I'll update to env vars!