add sitesAirtable scrapy spider for updating Site table
use pugsql to execute db queries. Put all sql queries in queries folder. see issue #18
fix issue #15
simplify _crawler.py, _spider.py and _pipeline.py files. Right now, for both Page and Post, fb_handler.py directly calls _crawler.py, and _crawler.py no longer needs _pipeline.py. (i.e. we can get rid of _spider.py and _pipeline.py) This makes the code base easier to navigate.
sitesAirtablescrapy spider for updating Site tablepugsqlto execute db queries. Put all sql queries inqueriesfolder. see issue #18_crawler.py,_spider.pyand_pipeline.pyfiles. Right now, for both Page and Post,fb_handler.pydirectly calls_crawler.py, and_crawler.pyno longer needs_pipeline.py. (i.e. we can get rid of_spider.pyand_pipeline.py) This makes the code base easier to navigate.