search

Spaceface16518 / strat-collector

Combs through a specific subreddit for posts with over a certain threshold in comments. It then adds them to a database.
MIT License
2 stars 0 forks source link

Data processing necessary? #20

Open Spaceface16518 opened 6 years ago

Spaceface16518 commented 6 years ago

Do we really need to include the data processor module? We could always just send the data straight from reddit to mongodb.

vorana commented 6 years ago

Yes we need it. We want to format it BEFORE it goes into the database. We need to run the formatting script before we send it to the Database to achieve this. Inquire for more info, ill be starting work on this in free time.