I've been trying several scripts to scrape advanced search on Twitter but everyone of them (included this one) sometimes doesn't return anything. I can run the exact same script 10 times in a row and it will fail like 2 or 3 times.
It's not a rate limit because I get an error with it. It's just that it doesn't manage to get the tweets, it's inconsistent.
In fact when I try to search on X it's the same, sometimes the page does return the results and sometimes not. I'm wondering if it's made on purpose from X against scrappers...
Hi!
I've been trying several scripts to scrape advanced search on Twitter but everyone of them (included this one) sometimes doesn't return anything. I can run the exact same script 10 times in a row and it will fail like 2 or 3 times.
It's not a rate limit because I get an error with it. It's just that it doesn't manage to get the tweets, it's inconsistent.
In fact when I try to search on X it's the same, sometimes the page does return the results and sometimes not. I'm wondering if it's made on purpose from X against scrappers...
Do you know this issue? Thanks