gladisor / AdviceBot

Chatbot which gives general advice using a language model
GNU General Public License v3.0
0 stars 0 forks source link

Need to select criteria for helpful comments on training data #1

Closed gladisor closed 3 years ago

gladisor commented 3 years ago

We need to create a way of telling if a post contains helpful comments.

Function which takes as input a post from pushshift api and reconstructs comment chain. Then returns all useful comments. Write function in utils.py

Ideas:

All ideas must be searchable in the pushshift post.

gladisor commented 3 years ago

We do not have enough information from the comments to determine if they are useful or not. I think we should assume all top level comments above a certain word length are useful.