data glitches - Githubissues

tilburgsciencehub / music-to-scrape

A fictitious music streaming service with a real website and API so you can learn how to scrape!

https://music-to-scrape.org

3 stars 6 forks source link

data glitches #47

Closed hannesdatta closed 9 months ago

hannesdatta commented 10 months ago

In this issue, I report a few "glitches" that make the data/site become unrealistic.

[x] plays this year includes data from the future. condition on unixtime.

[x] make use of unixtimestamps, not weeks
[x] in almost all cases, users have just played a particular SONG once. doesn't seem so realistic...

Bug or correct?

[x] is the recently played section COMPLETE (all records shown)?

[x] the recently played section shows items in the future (here, august 25, although today is aug 24)
[x] drop artist name from artist overview page...

[x] fix UTF encoding directly in the R data

[x] verify these are PLAYS up to today (vs. plays all time)

[x] simulate data for entire year 2023 (so we have jan - today data, maybe even 2022)