search

tophboogie / trumptweets

A Twitter scraper that logs Trump's emotional state via IBM Watson API
2 stars 1 forks source link

Move string to array conversion to backend #24

Closed tophboogie closed 7 years ago

tophboogie commented 7 years ago

loading new wordclouds is slow, especially for longer time periods. it would be more efficient to have the backend convert tweet string into array of words and store in database. side benefit: being able to query db word arrays, sort alphabetically, and manually remove any weird characters that slip through the regular expression. also - we could prolly do a better regular expression for removing punctuation...

heinburger commented 7 years ago

@tophboogie - this is a great idea! I had to make some changes to the array stuff because something was failing if something happened (sorry I can't remember) - maybe we can work on this later? I will be up when you get up, maybe - we can do a quick chat about how we want to push this forward?

heinburger commented 7 years ago

also this is quite slow on the frontend -like if you select a large date range.. if it was on the backend, our loader would also work and it might get rid of the bug where the wordcloud is redrawn

tophboogie commented 7 years ago

fixed by #31