fabienvauchelles / scrapoxy

Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers πŸ•ΈοΈ. It also smartly handles traffic routing πŸ”€ to minimize bans and increase success rates πŸš€.
http://scrapoxy.io
MIT License
1.97k stars 233 forks source link

Template instance not found on GCP (eratically) #225

Closed h4gen closed 7 months ago

h4gen commented 7 months ago

Current Behavior

When installing a new connector I get the following error: The resource 'projects/xxx/zones/europe-west1-c/instances/scrapoxy-template-instance' was not found

I can see in gcp that the instance is trying to create. I can see no errors in the gcp console. After a few seconds the instance is gone and the error is thrown.

Expected Behavior

Connector is installed correctly

Steps to Reproduce

For me it occured after uninstalling a connector and then trying to install it again

  1. Install connector with fresh scrapoxy deployment (typically works)
  2. Uninstall the connector (works)
  3. Install another connector (does not work with error0

Failure Logs

I cannot see that there are any usable logs besides the error in my deployment. I use the helm chart on Kubernetes (which is awesome in general btw)

Scrapoxy Version

latest (4)

Custom Version

Deployment

Operating System

Storage

Additional Information

I changed the commander to LoadBalancer to have an accessible external IP. But that should have no impact afaik.

It also does not work with docker Anymore :(

h4gen commented 7 months ago

Okay nevermind. There is just a massive resource shortage on GCP.

fabienvauchelles commented 7 months ago

Good to know that can happen.

Enjoy Scrapoxy !

javierlopeza commented 1 month ago

Is there a known solution for this issue? I'm coming across the same problem as OP.