search

haystack / eyebrowse-server

Eyebrowser Server
http://eyebrowse.csail.mit.edu/
MIT License
27 stars 7 forks source link

Populate top feed for new users #89

Closed amirw closed 8 years ago

amirw commented 9 years ago

Upon registration and following of Mr. @joshblum, All feeds except "most recent" were empty. I would expect a non empty field to be the default.

amyxzhang commented 9 years ago

sorry, you need to run the script populate_popular_history.py in scripts/cron_tasks:

from scripts.cron_tasks.populate_popular_history import * populate_popular_history()

This is a cron task that runs once every 6 hours and updates the popular feeds. I will add to the startup docs.

amyxzhang commented 9 years ago

added to docs: 4890d2feda1f2a499e4deba5f874e32cf693a989

karger commented 9 years ago

why run only once every 6 hours?

On 3/26/2015 2:27 PM, Amy Zhang wrote:

sorry, you need to run the script populate_popular_history.py in scripts/cron_tasks:

from scripts.cron_tasks.populate_popular_history import * populate_popular_history()

This is a cron task that runs once every 6 hours and updates the popular feeds. I will add to the startup docs.

— Reply to this email directly or view it on GitHub https://github.com/haystack/eyebrowse-server/issues/89#issuecomment-86657347.

joshblum commented 9 years ago

I think this is referring to the user experience upon signup, not just for devs. also I think we should change 4890d2f to include python manage.py installtasks in the makefile rather than another ad hoc command

So to address the issue we should probably kick off the job initially when a user signs up or change the default feed to be something that contains data rather than an empty feed (especially after following someone)

amyxzhang commented 9 years ago

I think it's actually set right now at once an hour but I've noticed that the site gets noticeably slower when it's running (so I've asked to perhaps move it to less often). We need a larger machine or a dedicated machine but haystack's openstack account is close to full. Can we request more memory and cores @karger?

karger commented 9 years ago

it's surprising that with only 10 users eyebrowse is loading any machine at all. We should find out what the performance issues are since they will hound us as the userbase grows---even if we can upgrade machine now, that won't help us when we have more users. It's often just a matter of creating an index on a relevant column of a table.

On 3/26/2015 3:06 PM, Amy Zhang wrote:

I think it's actually set right now at once an hour but I've noticed that the site gets noticeably slower when it's running (so I've asked to perhaps move it to less often). We need a larger machine or a dedicated machine but haystack's openstack account is close to full. Can we request more memory and cores @karger https://github.com/karger?

— Reply to this email directly or view it on GitHub https://github.com/haystack/eyebrowse-server/issues/89#issuecomment-86673737.

joshblum commented 8 years ago

we're going to kick off an update when users follow/unfollow others. Need this to run asynchronously, looking into celery and @amyxzhang is going to modify the algorithm to work on a per user basis https://realpython.com/blog/python/asynchronous-tasks-with-django-and-celery/

amyxzhang commented 8 years ago

Ok added to code to synchronously update popular history feed when following/unfollowing others. It's a little slow (~10-15 seconds) to run, so I added a loading gif to the button. I think it could be made faster too, not sure. Closing this for now.