search

casmlab / stack

The BITS Lab STACK tool for social media collection and analysis.
http://bits.ischool.syr.edu/
MIT License
1 stars 0 forks source link

web GUI should start processor and inserter after creating a collector #7

Open libbyh opened 7 years ago

libbyh commented 7 years ago

I don't think any of the changes could have broken this, so I think maybe I just set it up wrong?

Here's the admin page: http://stack.casmlab.org/queer-fans/twitter/58d5c38421e385726a0fd8cf/

Admin Login is on Asana.

pratik27shah commented 7 years ago

http://stack.casmlab.org/58d5c38421e385726a0fd8cf/update_collector it works fine.. issue

libbyh commented 7 years ago

There's no data in there, but tweets have shown up on Twitter since the collector started.

libbyh commented 7 years ago

e.g., https://twitter.com/grimblygrunkTWD/status/846174362503929856

pratik27shah commented 7 years ago

could you please check the setup because I checked the backend and the database has nothing stored in it..

pratik27shah commented 7 years ago

There was a json file which was created in the backend but the file had to be imported in mongodb..I tried doing it manually,but the structure of the config file and the json file had several blank values..and hence even after making an import the thing will not work,,i request you to re-verfiy the setup for this collector.once again

libbyh commented 7 years ago

Sure, I will check it. I made the Issue as a note. You don't really need to worry about these unless they are assigned to you or you don't have other stuff to do.

For this one, because I used the web front-end, that the collector isn't collecting suggests that there's (a) something missing from the "create collector" form process or (b) something missing from the instructions that I failed to follow. I'll dig into when I have more time.

On Mon, Mar 27, 2017 at 4:04 PM, Pratik Shah notifications@github.com wrote:

There was a json file which was created in the backend but the file had to be imported in mongodb..I tried doing it manually,but the structure of the config file and the json file had several blank values..and hence even after making an import the thing will not work,,i request you to re-verfiy the setup for this collector.once again

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/casmlab/stack/issues/7#issuecomment-289585795, or mute the thread https://github.com/notifications/unsubscribe-auth/AALIzp8p2xyW6TT-f5Wecx9cHthRRCg0ks5rqCR7gaJpZM4MpvRy .

libbyh commented 7 years ago

Low priority because we can make collectors through the command line.

libbyh commented 7 years ago

I think the problem is that the web interface starts a collector but not a processor or inserter. For both the queer-fans and mil2 collectors, which I started through the web, I just started processors and inserters through the command line, and now there's data in tweets for both. I will check back in a bit to see if those tweets are visible through the web GUI as well.

libbyh commented 7 years ago

It's ok if we have three sets of buttons:

  1. start collector
  2. start processor
  3. start inserter

Those buttons should show only available commands though - i.e., if a collector is running, don't show a "start" button or at least don't make it clickable.