search

madan96 / La-Z-Boy

Get IMDb ratings for movies showing up on TV |
https://la-z-b0y.herokuapp.com/
MIT License
15 stars 26 forks source link

Integrate database for storing scraping data #31

Closed hackrush01 closed 7 years ago

hackrush01 commented 7 years ago

Made small changes to main.py. Created .gitignore

Fixes #19

hackrush01 commented 7 years ago

I think that a .travis.yml file is needed for it, configured for python 2.7. Currently it is configured for ruby.

madan96 commented 7 years ago

Hey @hackrush01 ! Thanks for the PR and sorry to keep you waiting. I was preoccupied with some other work.

Regarding the PR, what you have done isn't something that we require for our package. By database, I am referring to something like a postgresql database using flask, which will be updated hourly using cronjob.

hackrush01 commented 7 years ago

What exactly would be the function of the database? Please elaborate. Then I'll try.

madan96 commented 7 years ago

We are planning to add multiple features to this package like leaderboard for the channels base on IMDb ratings and a recommendation system based on the genre. All this would require multiple instances of scraping from one site and then receiving data from IMDb site, which would take a lot of time. Having a database would help speeding up all these tasks. Postgresql db would have the same table as the one created by you only difference being it would contain data from all the channels that we plan to scrape.