mrbrianevans / social-media-export-analyser

Analyse GDPR exports of your data from big social media companies
https://social-media-export-analyser-mrybc.ondigitalocean.app/
MIT License
1 stars 0 forks source link

Improve fake data generation #59

Open mrbrianevans opened 2 years ago

mrbrianevans commented 2 years ago

The fake data generated is currently sufficient to demonstrate the main visualisation of each of the supported files (with a few exceptions like YouTube Search History). However, the data lacks the quality needed to demonstrate the analysis features such as: time series analysis, frequency analysis and topic extraction. To properly demonstrate these features, at least some of the data needs to be based on real world data. For example, some of the text in tweets could be randomly selected from a corpus of real world statements. This would better show the topic extraction feature and word frequency. The time series analysis is not well demonstrated when using a uniform random distribution of dates. It would be better to either use some real world event dates or to generate them according to a different distribution, taking into account day of week etc.

Ideas for data sources: