Impact of recent Twitter updates

BANKA2017 commented 1 year ago

The bad one is now twitter rejects almost all anonymous requests.
The good one is that we support login and provide cookies.

BANKA2017 commented 1 year ago

 ❯ tests/backend.online.test.js (21) 35476ms
   ✓ Guest token 5529ms
   ✓ UserInfo (3) 1496ms
   ❯ Tweets (5) 5914ms
     ✓ Tweet 3831ms
     ✓ With replies 3775ms
     ✓ Status 4184ms
     ✓ List 5913ms
     × Community 2616ms
   ✓ Search (2) 3317ms
   ✓ Album search (2) 3424ms
   ✓ Broadcast (1) 6030ms
   ✓ Audiospace (1) 4034ms
   ✓ Trends (might not supported in some region) (1) 1553ms
   ✓ Typeahead (1) 1300ms
   ✓ List (2) 1417ms
   ❯ Community (2) 1456ms
     × Info 1379ms
     ✓ Search 1455ms

Community information and timeline changed to require login (removed), other endpoints areavailable.

n0099 commented 1 year ago

https://twitter.com/elonmusk/status/1675187969420828672

BANKA2017 commented 1 year ago

The Rate limit of the timeline endpoint is very low. It is recommended that crawler users reduce the frequency of crawling, or add more proxies.

'x-rate-limit-limit': '50'

BANKA2017 commented 1 year ago

https://github.com/BANKA2017/twitter-monitor-assets/commit/6e7ab33e4b76e0d80b4e3f383f109dfd67ead7a1

bestRunner commented 1 year ago

匿名请求已无法使用关键词搜索

BANKA2017 commented 1 year ago

I need a little more time to fix it, before that, you can refer to https://github.com/zedeus/nitter/issues/983#issuecomment-1681199357 to obtain guest accounts and then create a new object:

{
    "authorization": "Bearer AAAAAAAAAAAAAAAAAAAAAFXzAwAAAAAAMHCxpeSDG1gLNLghVe8d74hl6k4%3DRUMF4xAQLsbeBhTSRrCiQpJtxoGWeyHrDb5te2jpGskWDFW82F",
    "oauth_token": "1680000071584518144-SVdJOzLojjUy00000T2Snv00000tnR",
    "oauth_token_secret": "OFYvbr00000IIzkHgytbNBfPbwp00000ynF5600000zUa"
}

and finally modify the code:

- ANY_VARIABLE = new GuestToken() // ANY_VARIABLE refers to a type of variables, they have many names
+ ANY_VARIABLE = new GuestToken('android')

- await ANY_VARIABLE.updateGuestToken(4) // May be any number from 0 to 4
+ await ANY_VARIABLE.openAccountInit({
+     "authorization": "Bearer AAAAAAAAAAAAAAAAAAAAAFXzAwAAAAAAMHCxpeSDG1gLNLghVe8d74hl6k4%3DRUMF4xAQLsbeBhTSRrCiQpJtxoGWeyHrDb5te2jpGskWDFW82F",
+     "oauth_token": "1680000071584518144-SVdJOzLojjUy00000T2Snv00000tnR",
+     "oauth_token_secret": "OFYvbr00000IIzkHgytbNBfPbwp00000ynF5600000zUa"
+ })

BANKA2017 commented 1 year ago

~Now I can no longer get any new guest accounts.~

BANKA2017 commented 9 months ago

It seems that Twitter restored the timeline order of Enterprise Certified (Gold Marked) accounts under anonymous access.

bestRunner commented 9 months ago

It seems that Twitter restored the timeline order of Enterprise Certified (Gold Marked) accounts under anonymous access.

应该并不是所有的主页都可以完全显示，例如：https://twitter.com/iPaulCanada，在登陆和无痕模式访问状态下，无痕模式依旧无法显示最新的内容

BANKA2017 commented 9 months ago

https://twitter.com/iPaulCanada，在登陆和无痕模式访问状态下，无痕模式依旧无法显示最新的内容

only for gold marked accounts @bestRunner

BANKA2017 commented 7 months ago

The core of Open-Twitter-Monitor will stop updating until a common solution other than guest account authentication is found.

Other parts, such as webpush, media downloader（except audio space）, rate limit checker, etc. are not affected.

BANKA2017 / twitter-monitor

Impact of recent Twitter updates #4