IntegerAlex / netflix-recommendation-system

This Netflix Recommendation System is a web application developed using Node.js and Express. It utilizes a recommendation engine written in Python
https://netflix-recommendation-system-v2ndqtpkjq-uc.a.run.app
GNU General Public License v3.0
7 stars 4 forks source link

Requests taking too long #29

Closed fancyvanilla closed 4 months ago

fancyvanilla commented 7 months ago

Great work on the app! After forking it and experimenting with it, I noticed that the cosine matrix is regenerated every time a user requests a recommendation. While I attempted to store it using JSON, the file size turned out to be too large. In light of this, I believe utilizing a cache or a database would be a more efficient solution. Additionally, implementing caching for repeated requests could further optimize performance. Best of luck with the continued development of the app!

IntegerAlex commented 7 months ago

Great work on the app! After forking it and experimenting with it, I noticed that the cosine matrix is regenerated every time a user requests a recommendation. While I attempted to store it using JSON, the file size turned out to be too large. In light of this, I believe utilizing a cache or a database would be a more efficient solution. Additionally, implementing caching for repeated requests could further optimize performance. Best of luck with the continued development of the app!

There are few issues needed to be addressed .

  1. The response from the OMDB server is slow and cannot be done in bulk
  2. The SSR needs full data before rendering the template
  3. Python is slow , I'm not that in python some fixes are needed .

Solutions Needs paid IMDB api, will reduce 15sec to probably 8sec . Fixes in script will occur another 1-2sec . Well it is deployed on cloud run which is bad as it shuts down after sometime and cold starts generally sucks