fabienvauchelles / scrapoxy

Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers πŸ•ΈοΈ. It also smartly handles traffic routing πŸ”€ to minimize bans and increase success rates πŸš€.
http://scrapoxy.io
MIT License
1.97k stars 234 forks source link

[BUG][Azure connector] Sometime, the deployment of proxies failed #240

Open jmaitrehenry opened 3 months ago

jmaitrehenry commented 3 months ago

Current Behavior

When Scrapoxy create many proxy in the same time, we have an error in the log:

[Nest] 1  - 06/21/2024, 12:49:54 PM   ERROR [RefreshConnectorsService] Error: Nic(s) in request is reserved for another Virtual Machine for 180 seconds. Please provide another nic(s) or retry after 180 seconds. Reserved VM: /subscriptions/xxx/resourceGroups/xxxx/providers/Microsoft.Compute/virtualMachines/spxw1-dolphin527328155-vm

It's a transient error and when scrapoxy create a new deployment, it works.

Expected Behavior

Scrapoxy create the proxy in the first try and without errors.

Steps to Reproduce

  1. Create more than one proxy
  2. Hope to have the error

Failure Logs

[Nest] 1  - 06/21/2024, 12:49:54 PM   ERROR [RefreshConnectorsService] Error: Nic(s) in request is reserved for another Virtual Machine for 180 seconds. Please provide another nic(s) or retry after 180 seconds. Reserved VM: /subscriptions/xxx/resourceGroups/xxxx/providers/Microsoft.Compute/virtualMachines/spxw1-dolphin527328155-vm


### Scrapoxy Version

4.9

### Custom Version

- [X] No
- [ ] Yes

### Deployment

- [X] Docker
- [ ] Docker Compose
- [ ] Kubernetes
- [ ] NPM
- [ ] Other (Specify in Additional Information)

### Operating System

- [X] Linux
- [ ] Windows
- [ ] macOS
- [ ] Other (Specify in Additional Information)

### Storage

- [X] File (default)
- [ ] MongoDB & RabbitMQ
- [ ] Other (Specify in Additional Information)

### Additional Information

_No response_
jmaitrehenry commented 3 months ago

@fabienvauchelles you can assign the issue to my and add a low priority flag as it's not really a problem, it just add some delay to the proxy creation.

fabienvauchelles commented 3 months ago

Thanks. I need to test

fabienvauchelles commented 2 months ago

I think this issue is correct @jmaitrehenry . Can I close it ?