Top hype not refreshing

karpathy / arxiv-sanity-preserver

Web interface for browsing, search and filtering recent arxiv submissions

http://www.arxiv-sanity.com/

MIT License

5.14k stars 1.33k forks source link

Top hype not refreshing #125

Open rodgzilla opened 5 years ago

rodgzilla commented 5 years ago

Hi!

First, I want to thank you for this amazing website.

The top hype does not seem to change anymore, maybe the authentification tokens have expired or something? The last commit to the twitter_daemon.py is from march 2017 so that would make sense if the token had an expiration date of 2 years.

rqjdupont commented 5 years ago

I think the recommandations tab is no longer updated as well.

rodgzilla commented 5 years ago

The last commit is from october :(

Andrej is probably busy with a lot of other things.

That's too bad, Arxiv Sanity is my main way to stay updated with Twitter.

karpathy commented 5 years ago

Sorry :( I just had a chance to ssh in and have a look around but can't see anything obviously wrong for both twitter_daemon and the buildsvm. typically i see some weird issue e.g. mongo went down mysteriously and i just restart it, but this time it looks a bit more involved. Bleh! Ok let me see..

karpathy commented 5 years ago

okay i did a reboot and and recomputing everything (eta 16 hours or so). there's some weird memory leak in something i'm using (mongo, or sklearn svms, or something else).

rodgzilla commented 5 years ago

Thanks a lot for taking the time to fix this issue!

I will close this issue once both tabs are up and running.

jsusskin commented 5 years ago

Thanks Andrej for all the awesome work on this service. Note that it seems top recent content has also not been updating for a few days. I’m guessing you know this already but thought I’d post just in case.

michaelklachko commented 5 years ago

Seems like it can't pull anything new since March 28

rodgzilla commented 5 years ago

I've been monitoring the top hype tab for the past few days and the results seem pretty strange. It is updating but the content seems wrong.

For example today (2019-04-08) the top hype papers for the last day are:

Data science is science's second chance to get causal inference right: A classification of data science tasks (10/9/2018)
Polynomial Regression As an Alternative to Neural Nets (6/29/2018)
CT-GAN: Malicious Tampering of 3D Medical Imagery using Deep Learning (1/11/2019)

This might be correct but it seems really strange to me that the top-3 most tweeted about papers from yesterday are all at least 3 months old.

michaelklachko commented 5 years ago

Oh, so the hype tab is updating, strange! I guess that's the only thing that's working, everything else has stopped at 8/28.

BTW, it's normal that random people tweet random old papers, that's always been the case. As you zoom out you will see that most "hyped" papers are all very recent though.

qianyizhang commented 5 years ago

it seems the server stops updating new paper since 4/15/2019 perhaps the new donation add on https://arxiv.org/ broke things?