search

strohne / Facepager

Facepager was made for fetching public available data from YouTube, Twitter and other websites on the basis of APIs and webscraping.
https://github.com/strohne/Facepager/releases
510 stars 197 forks source link

Pagination for Twitter Timeline (API v2) not working #191

Closed qd1990 closed 9 months ago

qd1990 commented 2 years ago

Hi, I am using the User Tweets Timeline (Twitter API v2) to collect tweets of a public brand. The objective is to collect the most recent 3200 tweets of a brand. My setting is shown in the attached screenshots. However, I cannot figure out how to make the pagination work so that I can collect all the 3200 tweets without manually updating the pagination_token again and again.

I tried to enter "meta.next_token" in the pagination_token, however, I got an errod which says: "The pagination_token query parameter value [meta.next_token] is not a valid token." If I manually enter the meta.next_token value, I can keep collecting the next page of tweets, but this takes a lot of time as I have to re-enter the next_token value again and again.

I tried to search to see if there is any instruction on this, but cannot find. So I am wondering if anyone could give me some guidances on how to do this. Thanks for your time and consideration!

Screenshot 2022-08-23 093012 Screenshot 2022-08-23 093040 Screenshot 2022-08-23 094211
strohne commented 2 years ago

Thanks for the detailed description. We will fix this, please allow some time,

strohne commented 2 years ago

Should work by now, without reinstalling Facepager, just restart it. I added the pagination info to the API doc https://github.com/strohne/Facepager/blob/master/apis/Twitter.v2.oa3.json

Please, could you try it out?