songzhm / cqa-analysis

Voting behavior study
1 stars 0 forks source link

multi-layer voting procedure simulation #9

Open songzhm opened 8 years ago

songzhm commented 8 years ago

using trained voter models to do simulation in order to study:

yan-li-ds commented 7 years ago

How is this one going? We hope to close the project soon?

songzhm commented 7 years ago

Hi prof,

We had some problem with the data. According to Jerry, the data we gave him before the break has length limit at 255 for the answer field, so the content of the length is not full. When we tried to go back to MongoDB to re-retrive data. I accidentally ran a script that deleted the content in mongodb... However, I've restarted the downloading process and I just check the process. It's already re-downloaded over 8000+ questions with 16000+ users by far. We should be able to get the data into sql and regenerate a dataset to Jerry by Tuesday.

songzhm commented 7 years ago

In terms the multilayer simulation procedure, I don't know yet, will talk with team.

yan-li-ds commented 7 years ago

Ming, Lesson learned! Always back up. Have you kept a copy of MongoDB?

Yan

Sent from my iPhone

On Jan 29, 2017, at 6:45 PM, Ming notifications@github.com wrote:

Hi prof,

We had some problem with the data. According to Jerry, the data we gave him before the break has length limit at 255 for the answer field, so the content of the length is not full. When we tried to go back to MongoDB to re-retrive data. I accidentally ran a script that deleted the content in mongodb... However, I've restarted the downloading process and I just check the process. It's already re-downloaded over 8000+ questions with 16000+ users by far. We should be able to get the data into sql and regenerate a dataset to Jerry by Tuesday.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

songzhm commented 7 years ago

Yeah... very big lesson... I will do this time. Fortunately, the downloading speed is not slow, as i disable the inserting data to sql functionality from the downloading procedure. I'm gonna write a separate model to transfer data from mongodb to sql separately.