search

kickscondor / fraidycat

Follow blogs, wikis, YouTube channels, as well as accounts on Twitter, Instagram, etc. from a single page.
Other
1.76k stars 56 forks source link

Twitter updates get frozen #152

Closed mpancorbo closed 4 years ago

mpancorbo commented 4 years ago

Before you start.

Desktop (please complete the following information):

Describe the bug

I mainly use Fraidycat for twitter fellows and since yesterday (2020-06-02) all twitter accounts does not update and their avatar is replaced by twitter's bird one. I follow other people through proxies like nitter.net and these ones update normally.

mitchellgordon95 commented 4 years ago

My Twitter feeds have also not been updating since two days ago. Interesting because I'm on Chrome, not Firefox.

OS: macOS High Sierra 10.13.6 Browser: Chrome Version 81.0.4044.129 (Official Build) (64-bit) FraidyCat: 1.1.5

Let me know if you need me to do any debugging, logs, etc, have some webdev experience.

P.S. Love the app, really great alternative to feeds. Let me know if you have a Patreon or anything.

kzys commented 4 years ago

It seems https://twitter.com/[username] no longer have tweets. Switching to https://mobile.twitter.com/[username] may work, since it has tweets still.

mpancorbo commented 4 years ago

My Twitter feeds have also not been updating since two days ago. Interesting because I'm on Chrome, not Firefox.

No surprise. My report includes two desktop apps not working (debian package and Appimage).

It seems https://twitter.com/[username] no longer have tweets. Switching to https://mobile.twitter.com/[username] may work, since it has tweets still.

Also switching to https://niitter.net/[username] works, but that's not the point; the app does not allow to change the source, so you must re-input all twitter sources what is annoying.

I guess the problem sides on some change around how twitter manage manage RSS.

kzys commented 4 years ago

Sorry. I meant switching to mobile.twitter.com internally. Twitter doesn't have RSS and Fraidycat uses https://github.com/kickscondor/fraidycat/blob/c077f3193dc1960c6d224a6082d01f0a96fe4ad3/defs/social.json#L496 to fetch its HTML. Updating the JSON file (including XPath selectors) would work, I suppose.

kickscondor commented 4 years ago

I am working frantically on this. As @kzys mentions, I have tried switching to mobile.twitter.com, but there are no precise timestamps. Still, it could be good enough. I'm attempting to use the rendering approach (currently used with TikTok) to use the old rule set.

This is going to happen from time to time, because I try not to rely on APIs (which are rate-limited) - however, I am able to update the scraper (or even to support APIs) without requiring any of you to update the software or to re-enter your follows.

Thank you for caring enough to come here and offer useful info!

kickscondor commented 4 years ago

Ok, so Nitter dealt with this a few days ago too: https://github.com/zedeus/nitter/issues/157

I'm mimicking their same strategy. Almost there. I'm sorry for the delay. Twitter is a bit more complicated than other platforms because I also collapse Twitter threads.

httpsterio commented 4 years ago

Rate-limited APIs wouldn't be an issue though, if each user gets their own API keys. I doubt even a heavy user would ping their API hard enough to get rate limited

kickscondor commented 4 years ago

Ok, this appears to be fixed. Your feeds should update in the next hour. Let me know how it goes!

I was able to make some improvements with the new calls:

Thank you for being patient so that I could do this properly.

mpancorbo commented 4 years ago

Yes, it seems it works o_O

But... how? My app/plugin is not updated.