ChrisCates / CommonCrawler

🕸 A simple way to extract data from Common Crawl
MIT License
33 stars 12 forks source link

Convert to CLI tool #5 #9

Closed zyfrank closed 5 years ago

ChrisCates commented 5 years ago

Hmm, interesting.

This only references the Wet path.

I'm also going to provide an example of what I think is more ideal in terms of structure and we can discuss from there. The repository needs to be reorganized anyway.