tilburgsciencehub / music-to-scrape

A fictitious music streaming service with a real website and API so you can learn how to scrape!
https://music-to-scrape.org
3 stars 6 forks source link

Address feedback points #24

Closed hannesdatta closed 1 year ago

hannesdatta commented 1 year ago

Data

This is important to tackle because in the future, we are going to update the simulation to gradually make the data more realistic.

Front-end

image

(in this screenshot, we first should see may 20, then may 21, etc.

image

image

image

image

image

Feedback

Next steps

thierrylahaije commented 1 year ago

Data feedback:

in terms of directory structure, it's unclear to me why we have sql_app, flask_app (both are good), and then a few separate folders such as src, gen, data. Can you somehow integrate these concepts? Probably we need another main folder, called data, and everything related to the simulation etc. happens there.

hannesdatta commented 1 year ago

agree with your recommendations.

data folder only contains a single .csv file. Do you need this file? Otherwise this folder can be removed.

don't need it.

gen folder is not necessary anymore, so this folder will be removed in my next push.

good

we might rename the 'src' folder to 'data'. This would simplify everything (if the data folder mentioned above can be removed of course.

agree.


The database is located in 2 folders since they both have different functions (one folder is flask, one is fastapi). When deploying them, the databases must be inside the folder of the specific app (fastapi/flask). To prevent errors for users, I already placed them inside the folders, instead of specifying and outer folder. Furthermore, the new simulate.R file that I will push this weekend automatically creates a new database, so we do not need to make copies by hand when editing the data. We then also do not need to render the .csv files anymore, the r script will handle everything for about the data up to and including the creation of the database.

Ok. Fine. Please update descriptions about how to update the data then and make a clear statement that we 'run' two data bases. Probably also what happens in reality...

Thanks!

thierrylahaije commented 1 year ago

I have done another push to address the following issues:

FastAPI:

Issue 20:

hannesdatta commented 1 year ago

Thanks a bunch! I love it!