BANKA2017 / twitter-monitor

Twitter Crawler Core and some based apps
https://tmapi.nest.moe
MIT License
143 stars 15 forks source link

Impact of recent Twitter updates #4

Open BANKA2017 opened 1 year ago

BANKA2017 commented 1 year ago
BANKA2017 commented 1 year ago
 ❯ tests/backend.online.test.js (21) 35476ms
   ✓ Guest token 5529ms
   ✓ UserInfo (3) 1496ms
   ❯ Tweets (5) 5914ms
     ✓ Tweet 3831ms
     ✓ With replies 3775ms
     ✓ Status 4184ms
     ✓ List 5913ms
     × Community 2616ms
   ✓ Search (2) 3317ms
   ✓ Album search (2) 3424ms
   ✓ Broadcast (1) 6030ms
   ✓ Audiospace (1) 4034ms
   ✓ Trends (might not supported in some region) (1) 1553ms
   ✓ Typeahead (1) 1300ms
   ✓ List (2) 1417ms
   ❯ Community (2) 1456ms
     × Info 1379ms
     ✓ Search 1455ms

Community information and timeline changed to require login (removed), other endpoints areavailable.

n0099 commented 1 year ago

https://twitter.com/elonmusk/status/1675187969420828672

BANKA2017 commented 1 year ago

The Rate limit of the timeline endpoint is very low. It is recommended that crawler users reduce the frequency of crawling, or add more proxies.

'x-rate-limit-limit': '50'
BANKA2017 commented 1 year ago

https://github.com/BANKA2017/twitter-monitor-assets/commit/6e7ab33e4b76e0d80b4e3f383f109dfd67ead7a1

bestRunner commented 1 year ago

匿名请求已无法使用关键词搜索

BANKA2017 commented 1 year ago

I need a little more time to fix it, before that, you can refer to https://github.com/zedeus/nitter/issues/983#issuecomment-1681199357 to obtain guest accounts and then create a new object:

{
    "authorization": "Bearer AAAAAAAAAAAAAAAAAAAAAFXzAwAAAAAAMHCxpeSDG1gLNLghVe8d74hl6k4%3DRUMF4xAQLsbeBhTSRrCiQpJtxoGWeyHrDb5te2jpGskWDFW82F",
    "oauth_token": "1680000071584518144-SVdJOzLojjUy00000T2Snv00000tnR",
    "oauth_token_secret": "OFYvbr00000IIzkHgytbNBfPbwp00000ynF5600000zUa"
}

and finally modify the code:

- ANY_VARIABLE = new GuestToken() // ANY_VARIABLE refers to a type of variables, they have many names
+ ANY_VARIABLE = new GuestToken('android')

- await ANY_VARIABLE.updateGuestToken(4) // May be any number from 0 to 4
+ await ANY_VARIABLE.openAccountInit({
+     "authorization": "Bearer AAAAAAAAAAAAAAAAAAAAAFXzAwAAAAAAMHCxpeSDG1gLNLghVe8d74hl6k4%3DRUMF4xAQLsbeBhTSRrCiQpJtxoGWeyHrDb5te2jpGskWDFW82F",
+     "oauth_token": "1680000071584518144-SVdJOzLojjUy00000T2Snv00000tnR",
+     "oauth_token_secret": "OFYvbr00000IIzkHgytbNBfPbwp00000ynF5600000zUa"
+ })
BANKA2017 commented 1 year ago

~Now I can no longer get any new guest accounts.~

BANKA2017 commented 11 months ago

It seems that Twitter restored the timeline order of Enterprise Certified (Gold Marked) accounts under anonymous access. image

bestRunner commented 11 months ago

It seems that Twitter restored the timeline order of Enterprise Certified (Gold Marked) accounts under anonymous access. image

应该并不是所有的主页都可以完全显示,例如:https://twitter.com/iPaulCanada,在登陆和无痕模式访问状态下,无痕模式依旧无法显示最新的内容

BANKA2017 commented 11 months ago

https://twitter.com/iPaulCanada,在登陆和无痕模式访问状态下,无痕模式依旧无法显示最新的内容

only for gold marked accounts @bestRunner

BANKA2017 commented 9 months ago

The core of Open-Twitter-Monitor will stop updating until a common solution other than guest account authentication is found.

Other parts, such as webpush, media downloader(except audio space), rate limit checker, etc. are not affected.