Azure-Samples / qdrant-azure

Qdrant Vector Database on Azure Cloud
MIT License
92 stars 22 forks source link

"Too Many Request" errors during the parallel upload #24

Closed mesgar closed 1 year ago

mesgar commented 1 year ago
- [x] bug report -> please search issues before submitting
- [ ] feature request
- [x] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

I followed the walkthrough blog post:
https://devblogs.microsoft.com/semantic-kernel/the-power-of-persistent-memory-with-semantic-kernel-and-qdrant-vector-database/

but uploading documents in parallel causes too many "Too Many Request" Errors.

image

I think it's not an issue with the VM's Spec, since the node's CPU usage is 12%.

image

Is there a workaround for this?

mesgar commented 1 year ago

Fixed my problem by reducing to 10 parallel requests from 100 parallel requests. Its slow but working...