search

uwescience / twittervaccine

Geo-tagged clusters of twitter sentiment data
0 stars 0 forks source link

Can we start collecting #Ebola tweets? #23

Open aflaxman opened 10 years ago

aflaxman commented 10 years ago

Is the infrastructure still in place to start collecting tweets about ebola? If this is not hard, I would like to do it. Keywords: ebola, EVD, EHF, hemorrhagic, marburg, lassa.

bpcb commented 10 years ago

Definitely doable, I'm on the road right now though with no laptop...I think it would be a five minute project for Andrew to get it going again. Andrew could you do that?

On Sep 12, 2014, at 10:20 AM, Abraham Flaxman notifications@github.com wrote:

Is the infrastructure still in place to start collecting tweets about ebola? If this is not hard, I would like to do it. Keywords: ebola, EVD, EHF, hemorrhagic, marburg, lassa.

— Reply to this email directly or view it on GitHub.

7andrew7 commented 10 years ago

Roger that. I'll start up the machinery later today.

On Fri, Sep 12, 2014 at 11:12 AM, bpcb notifications@github.com wrote:

Definitely doable, I'm on the road right now though with no laptop...I think it would be a five minute project for Andrew to get it going again. Andrew could you do that?

On Sep 12, 2014, at 10:20 AM, Abraham Flaxman notifications@github.com wrote:

Is the infrastructure still in place to start collecting tweets about ebola? If this is not hard, I would like to do it. Keywords: ebola, EVD, EHF, hemorrhagic, marburg, lassa.

— Reply to this email directly or view it on GitHub.

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-55440370 .

aflaxman commented 10 years ago

Awesome! Thanks Andrew and Ben!

aflaxman commented 10 years ago

additional kwds: EBOV, filovirus, haemorrhagic,VHF

7andrew7 commented 10 years ago

Done.

On Sat, Sep 13, 2014 at 8:34 AM, Abraham Flaxman notifications@github.com wrote:

additional kwds: EBOV, filovirus, haemorrhagic,VHF

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-55497419 .

aflaxman commented 10 years ago

Today seems like a good day to take a look at what we've gathered... can you give me a hint where to find it?

7andrew7 commented 10 years ago

It's stuck on an amazon virtual machine. Do you have a public key file I can use?

On Wed, Oct 1, 2014 at 11:40 AM, Abraham Flaxman notifications@github.com wrote:

Today seems like a good day to take a look at what we've gathered... can you give me a hint where to find it?

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-57514321 .

aflaxman commented 10 years ago 
[abie@dismod ~]$ more .ssh/id_rsa.pub
ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAsCvtRvT9sqraY0iwmfdJImEy4IKtgXY4rHxK7iF8JuVtjlc/eQBoJLySsICdBZ2/JmVimDBuPkmSNNBVomHTuh5qucM
w+qWaPdxkUi+kav+Ar30QhPWnGne9G6Vwy13NDLLZ56rNVKT15qMuShohCJ60x3uL3SDrTnhh6zJ/I5aJqt0NM/a9IISZLuyUuUCGU3DjEnOirF5KEQAkks+2VL8oK5
GSOy1oSPwPqkKITMhM8APpu07GcyvPttn828errVEiORan/6/wjT7QEs4UB91z6Jk5Db+yaP1nsjXNueET28jmKQG96UeelL07sngSAfCn/DdCfEex4hbWfFcAMw==
abie@winthrop.gs.washington.edu
aflaxman commented 10 years ago 
[abie@dismod ~]$ more .ssh/id_rsa.pub
ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAsCvtRvT9sqraY0iwmfdJImEy4IKtgXY4rHxK7iF8JuVtjlc/eQBoJLySsICdBZ2/JmVimDBuPkmSNNBVomHTuh5qucM
w+qWaPdxkUi+kav+Ar30QhPWnGne9G6Vwy13NDLLZ56rNVKT15qMuShohCJ60x3uL3SDrTnhh6zJ/I5aJqt0NM/a9IISZLuyUuUCGU3DjEnOirF5KEQAkks+2VL8oK5
GSOy1oSPwPqkKITMhM8APpu07GcyvPttn828errVEiORan/6/wjT7QEs4UB91z6Jk5Db+yaP1nsjXNueET28jmKQG96UeelL07sngSAfCn/DdCfEex4hbWfFcAMw==
abie@winthrop.gs.washington.edu<mailto:abie@winthrop.gs.washington.edu>
7andrew7 commented 10 years ago

Abie,

Attempt to login to the following machine:

ssh abie@54.185.145.68 cd /mnt

You should see a bunch of ebola_tweets files, which contain a bunch of concatenated json blobs. For example:

less ebola_tweets_20140930-031218.json

On Wed, Oct 1, 2014 at 1:32 PM, Abraham Flaxman notifications@github.com wrote:

[abie@dismod ~]$ more .ssh/id_rsa.pub
ssh-rsa
AAAAB3NzaC1yc2EAAAABIwAAAQEAsCvtRvT9sqraY0iwmfdJImEy4IKtgXY4rHxK7iF8JuVtjlc/eQBoJLySsICdBZ2/JmVimDBuPkmSNNBVomHTuh5qucM

w+qWaPdxkUi+kav+Ar30QhPWnGne9G6Vwy13NDLLZ56rNVKT15qMuShohCJ60x3uL3SDrTnhh6zJ/I5aJqt0NM/a9IISZLuyUuUCGU3DjEnOirF5KEQAkks+2VL8oK5

GSOy1oSPwPqkKITMhM8APpu07GcyvPttn828errVEiORan/6/wjT7QEs4UB91z6Jk5Db+yaP1nsjXNueET28jmKQG96UeelL07sngSAfCn/DdCfEex4hbWfFcAMw==

abie@winthrop.gs.washington.edu<mailto:abie@winthrop.gs.washington.edu>

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-57533581 .

aflaxman commented 10 years ago

Success! Thanks so much Andrew.

7andrew7 commented 10 years ago

No problem. We've got some parsing code lying around -- Ben knows more than me, but I'm happy to take a look if you get stuck.

On Wed, Oct 1, 2014 at 1:59 PM, Abraham Flaxman notifications@github.com wrote:

Success! Thanks so much Andrew.

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-57537457 .

aflaxman commented 10 years ago

Not sure if Ben is getting all of this issue traffic in his email, but if so perhaps this location info will make it partially worthwhile:

"location":"Kitchen, Yams Everywhere"

7andrew7 commented 10 years ago

"data quality issues"

On Wed, Oct 1, 2014 at 2:43 PM, Abraham Flaxman notifications@github.com wrote:

Not sure if Ben is getting all of this issue traffic in his email, but if so perhaps this location info will make it partially worthwhile:

"location":"Kitchen, Yams Everywhere"

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-57543949 .

aflaxman commented 10 years ago

A lot of twitter traffic since first US case:

image

Not a large upswing of scary misinformation:

image

aflaxman commented 10 years ago

Recap of the magic words: ebola, marburg, lassa, filovirus, hemorrhagic, EBOV, VHF, EVD, EHF

bpcb commented 10 years ago

Cool stuff! I'm finally back online indefinitely...that location definitely makes all the messages worthwhile.

aflaxman commented 10 years ago

looks like the tweets stopped coming. did we run out of room or something?

7andrew7 commented 10 years ago

I'll take a look...

On Fri, Oct 3, 2014 at 2:31 PM, Abraham Flaxman notifications@github.com wrote:

looks like the tweets stopped coming. did we run out of room or something?

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-57865881 .

7andrew7 commented 10 years ago

I restarted it. If this happens again, I'll look into "hardening" the script.

On Fri, Oct 3, 2014 at 2:31 PM, Abraham Flaxman notifications@github.com wrote:

looks like the tweets stopped coming. did we run out of room or something?

— Reply to this email directly or view it on GitHub https://github.com/uwescience/twittervaccine/issues/23#issuecomment-57865881 .