yihong0618 / twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
MIT License
324 stars 82 forks source link

blocked #4

Open yihong0618 opened 1 year ago

yihong0618 commented 1 year ago

blocked by twitter they banned the search api.

for now we can only get 3200 tweets

AhmedShujaAbbasi commented 1 year ago

CRITICAL:root:twint.run:Twint:Feed:noData'globalObjects

yihong0618 commented 1 year ago

@AhmedShujaAbbasi fixed but caused by the limit we only have 3200 tweets.

AhmedShujaAbbasi commented 1 year ago

Thanks.. but i have another problem.

On Wed, Apr 26, 2023, 1:21 PM yihong @.***> wrote:

@AhmedShujaAbbasi https://github.com/AhmedShujaAbbasi fixed but caused by the limit we only have 3200 tweets.

— Reply to this email directly, view it on GitHub https://github.com/yihong0618/twint/issues/4#issuecomment-1522987428, or unsubscribe https://github.com/notifications/unsubscribe-auth/A35TGS7NGSWLOI7NHTE2G7LXDDLIZANCNFSM6AAAAAAXGKBSJA . You are receiving this because you were mentioned.Message ID: @.***>

AhmedShujaAbbasi commented 1 year ago

Can you plz checkout once again

On Wed, Apr 26, 2023, 3:08 PM Shuja Abbasi @.***> wrote:

Thanks.. but i have another problem.

On Wed, Apr 26, 2023, 1:21 PM yihong @.***> wrote:

@AhmedShujaAbbasi https://github.com/AhmedShujaAbbasi fixed but caused by the limit we only have 3200 tweets.

— Reply to this email directly, view it on GitHub https://github.com/yihong0618/twint/issues/4#issuecomment-1522987428, or unsubscribe https://github.com/notifications/unsubscribe-auth/A35TGS7NGSWLOI7NHTE2G7LXDDLIZANCNFSM6AAAAAAXGKBSJA . You are receiving this because you were mentioned.Message ID: @.***>

AhmedShujaAbbasi commented 1 year ago

raise RefreshTokenException('Could not find the Guest token in HTML') twint.token.RefreshTokenException: Could not find the Guest token in HTML

yihong0618 commented 1 year ago

@hongqn Since twitter block search for none login user I recover it by using timeline, but for now it limit 3200 tweets and can not search. But anyway it works again


I also recover followers and following you can test.


Maybe we can do more things ~

LinqLover commented 1 year ago

Facing the same issues, CRITICAL:root:twint.run:Twint:Feed:noData'globalObjects and sporadically Could not find the Guest token in HTML. Issues still exist for me with the latest commit from this fork. My query is a single word.

Is it possible to use twint to log in with my Twitter account?

yihong0618 commented 1 year ago

@LinqLover @AhmedShujaAbbasi do not support for now. twitter ban all search api if it is not login

try pip install -U twint_fork then

twint -u LinqLover

LinqLover commented 1 year ago

Thank you. Unfortunately, for my project, I do need to do a full-text search on Twitter ...

yihong0618 commented 1 year ago

for now it needs api or a login user...

LinqLover commented 1 year ago

Apparently, someone has commissioned to implement such a login feature on freelancer. Unfortunately, there is no information on whether someone is working on this project and whether they will publish their solution.

If you look at the code on github, you can see they use a Bearer token, but now it says "Forbidden" as now they require login to do search do Twitter.

AhmedShujaAbbasi commented 1 year ago

@yihong0618 pip install -U twint_fork thanks it is working now. It will continue?

AhmedShujaAbbasi commented 1 year ago

Now there won't be any problem?

AhsanMollani commented 1 year ago

CRITICAL:root:twint.run:Twint:Feed:noData-1

its giving me this error after running pip install -U twint_fork

yihong0618 commented 1 year ago

yes it is dead again.

AhsanMollani commented 1 year ago

Can it be fixed again?

yihong0618 commented 1 year ago

maybe just say that I will try. And twitter ban another api....

yihong0618 commented 1 year ago

@AhmedShujaAbbasi fixed