Desired Functionalities for Requesting Data from our DB

[ZaneReda]

As of right now I will just make simple requests from the DB to gather data and maybe a smaller pipeline for getting that data into a readable format in a pandas dataframe or whatever yall prefer to work with. Let me know what yall want in terms of other functionalities and I will add them in the coming days. As of right now if everyone can start using the genre_scrape.py, book_scrape.py and review_scrape_selenium.py to keep gathering our data that would be ideal. If you find any errors that prevent the program from continuing let me know.

[ismadoukkali]

For me .csv or pandas data frame would be ideal. In terms of the mapping (How the dataframe is organized), these are the combination I would like to have. I believe these are called collections right?:

• Book ids mapped to their characteristics (genre, publisher, length..) and to rating distribution.
• User ids mapped to their reviews (with an individual review_id) and book id.

With those two initial data frames we can start with the roadmap we proposed through the WhatsApp group @vtwoptwo and I. Is this correct? I attach image of the brainstorming. Put special attention to the right side of the board - there you will find what was discussed for Versions.

[ismadoukkali]

Seems unorganized... I know, but the vision can be seen more or less. Either way, all was specified in read.me.

[ismadoukkali]

Review Scraper works optimally now! Try it ou!