fabienvauchelles / scrapoxy

Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers 🕸️. It also smartly handles traffic routing 🔀 to minimize bans and increase success rates 🚀.
http://scrapoxy.io
MIT License
2.01k stars 235 forks source link

Freeze an IP for a manual replacement #253

Open elizandromoreira opened 1 month ago

elizandromoreira commented 1 month ago

Current Behavior

I use Rayobyte proxies and when a proxy is blocked by the site with 403 I cannot disable this proxy within Scrapoxy, and so I keep making requests that I know returned with 403.

Expected Behavior

Have a button to pause or disable the proxy until you make the replacement in Rayobyte.

Steps to Reproduce

1.

Failure Logs

No response

Scrapoxy Version

4.15

Custom Version

Deployment

Operating System

Storage

Additional Information

No response

fabienvauchelles commented 1 month ago

Hi @elizandromoreira,

Thank you for using Scrapoxy!

First, you can remove proxies using Scrapoxy’s API. Here’s a link that might help: Scrapoxy API - Remove Multiple Sources.

Additionally, the Rayobyte connector also supports proxy removal. You can find more information here: Rayobyte Connector Guide.

Please keep in mind that Rayobyte allows a limited number of replacement requests within a monthly window, though I’m not sure of the exact amount.

elizandromoreira commented 1 month ago

Hi @fabienvauchelles! First of all, thank you for your answer and congratulations on your work! I knew about the details of Rayobyte because I read the documentation, the problem is that it doesn't work. My question is, not only for Rayobyte, but for other third parties like Proxy Resseler that I also use, the ideal would be to have a button to PAUSE the proxy with blocking... I know that this is a customization, and I would like to know if this is possible and if so, who can do it?

fabienvauchelles commented 1 month ago

Let me clarify:

The idea is to introduce a third button or status that allows you to 'freeze' the proxy. 
In this state, the proxy remains active but Scrapoxy won’t route any traffic through it until it’s unfrozen.

You can freeze the proxy either via a button or an API call.

Does this meet your requirements?

Additionally, I have a question for you: Suppose you have 10 static IP proxies, and they get progressively banned over the next hour. As a result, you’ll eventually have no proxies left. How would you go about replacing them, and what impact would this have on your proxy sessions?

Could you also explain the specific use case where you would need this functionality? It might help me identify alternative solutions or provide a broader perspective.

elizandromoreira commented 1 month ago

Yes, it is, freeeze for the moment. To answer your question, if I get banned, I'll contact my current suppliers Rayobyte and Proxy-Seller and ask for a replacement. Today I started testing AWS to see how it works, and so far it's okay.

Since my scrapers update prices, they run 24 hours a day, and at the moment I'm monitoring, depending on the store, if I stop for 10 minutes, the proxy often comes back without being blocked.

I hope I was clear...thanks for your help. Screenshot at Sep 27 16-19-25