Need to be able to limit the scraping speed or use proxies

[Blare1337]

As many people have stated here, you cannot scrape ig accounts with large following & no limits being set. It's scraping to fast. We need delays or the use of proxies to scrape large accounts.

Searching for target followers... Traceback (most recent call last):
File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/client.py", line 523, in _call_api response = self.opener.open(req, timeout=self.timeout) File "/usr/lib/python3.9/urllib/request.py", line 523, in open response = meth(req, response) File "/usr/lib/python3.9/urllib/request.py", line 632, in http_response response = self.parent.error( File "/usr/lib/python3.9/urllib/request.py", line 561, in error return self._call_chain(args) File "/usr/lib/python3.9/urllib/request.py", line 494, in _call_chain result = func(args) File "/usr/lib/python3.9/urllib/request.py", line 641, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 429: Too Many Requests

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/kali/Osintgram/main.py", line 186, in _cmd() File "/home/kali/Osintgram/src/Osintgram.py", line 324, in get_followers data = self.api.user_followers(str(self.target_id), rank_token=rank_token) File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/endpoints/friendships.py", line 65, in user_followers res = self._call_api(endpoint, query=query_params) File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/client.py", line 527, in _call_api ErrorHandler.process(e, error_response) File "/home/kali/.local/lib/python3.9/site-packages/instagram_private_api/errors.py", line 116, in process raise ClientThrottledError( instagram_private_api.errors.ClientThrottledError: Please wait a few minutes before you try again.

[TheoLeao]

Hello,

Have you found a solution to solve this limitation? I am also facing this error.

Thanks

[endeavourhgp]

Hello,

I have the same problem with big accounts....

[mk99633d]

في الخميس، ٩ ديسمبر ٢٠٢١ ٣:٥٨ ص endeavourhgp @.***> كتب:

Hello,

I have the same problem with big accounts....

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/Datalux/Osintgram/issues/365#issuecomment-989352625, or unsubscribe https://github.com/notifications/unsubscribe-auth/AWXNB5V2X2OWHUAON7HSQZ3UP75J3ANCNFSM5HGO43NA .

[emperoribk]

can you use proxies for the osintgram

[markshi9008]

same here, do u guys find any solutions to solve it?

[cryptoparrott]

Completely agree on the need for a rate limit, afaik the current api limit per hour is now 200... you'd need hundreds of proxies baked in somewhere to make that work.

I'm looking at asyncio, aiohttp and semaphores, to see if these could be placed into the command code or at a higher level for all commands etc.