search

anidata / ht-etl

Anidata 1.0: ETL and algorithm code.
0 stars 10 forks source link

pages extract #10

Closed egrossman closed 7 years ago

egrossman commented 7 years ago

puts raw page data into a csv

egrossman commented 7 years ago

@dlrobertson tagging you as it seems I can't add reviewers

egrossman commented 7 years ago

@bmenn Right, I started out with code from get_data and -removed- uncommented what I didn't need. I just needed to make sure the luigi stuff worked. I'm going to add in the phone lookup now. I see you used a package called rfc3987 instead of re. Are there any advantages to that?