search

fdac18 / Twitter

The final project for analyzing disater-related twitter
1 stars 4 forks source link

Codes For Crawling and Cleaning #7

Open mmahbub opened 6 years ago

mmahbub commented 6 years ago

I found some codes to crawl and clean data: For Crawling with a specific keyword: https://gist.github.com/vickyqian/f70e9ab3910c7c290d9d715491cde44c For pre-processing the data: https://github.com/CrisisNLP/deep-learning-for-big-crisis-data/blob/master/data_helpers/preprocess.py

audrism commented 6 years ago

https://github.com/DisasterMasters/TwitterScrape/tree/master/Scraper

this one is in python if you don't like ruby It gets data from speciific users, not by keyword however.

Also, the scripts you noted require you to get developer account, I believe