casmlab / stack

The BITS Lab STACK tool for social media collection and analysis.
http://bits.ischool.syr.edu/
MIT License
1 stars 0 forks source link

"track" Twitter collector setup through web doesn't assign term ids #9

Open libbyh opened 7 years ago

libbyh commented 7 years ago

I set up a new collector to use the "track" parameter. Here's what's in the config database:

{ "_id" : ObjectId("58e8408421e38520c599575e"), "project_name" : "potus45", "listener_running" : true, "network" : "twitter", "rate_limits" : [ ], "terms_list" : [ { "collect" : 1, "term" : "potus", "type" : "term", "id" : null, "history" : [ { "start_date" : "2017-04-07", "end_date" : "current" } ] }, { "collect" : 1, "term" : "realdonaldtrump", "type" : "term", "id" : null, "history" : [ { "start_date" : "2017-04-07", "end_date" : "current" } ] }, { "collect" : 1, "term" : "@potus", "type" : "term", "id" : null, "history" : [ { "start_date" : "2017-04-07", "end_date" : "current" } ] }, { "collect" : 1, "term" : "@realdonaldtrump", "type" : "term", "id" : null, "history" : [ { "start_date" : "2017-04-07", "end_date" : "current" } ] } ], "collector_name" : "potus-mentions", "languages" : null, "api" : "track", "collection_type" : "realtime", "api_auth" : { "consumer_secret" : "[removed]", "access_token" : "[removed]", "consumer_key" : "[removed]", "access_token_secret" : "[removed]" }, "active" : 1, "params" : { }, "error_codes" : [ ], "project_id" : "5886bdea21e38564ac1ccfd8", "collector" : { "collect" : 1, "run" : 1, "update" : 0 }, "location" : null, "stream_limit_loss" : { "counts" : [ ], "total" : 0 }, "rate_limit_count" : 0, "error_code" : 0 }

Don't the terms need IDs? Or do only handles get IDs?

libbyh commented 7 years ago

Just setup another one using the "follow" parameter, and all terms have ids.

pratik27shah commented 7 years ago

The prroblem is that the tweets db is always empty and let's not remove the ids as it works as the primary key ,Yes the terms need ,Id,because the termid is only used for the lookup

libbyh commented 7 years ago

So track collectors don't assign term ids to the terms? We have at least two "track" collectors running to check this on:

If track collectors don't need term ids, then we need to change the way the web GUI shows users data since right now those functions are all keyed off term ids.

pratik27shah commented 7 years ago

Needs discussion.