qdrant / go-client

Go client for Qdrant vector search engine
Apache License 2.0
161 stars 15 forks source link

Implement helper for initial upload #4

Closed monatis closed 1 year ago

monatis commented 2 years ago

An easy-to-use parallelized initial uploader needed --just like the one in the Python client.

Rendez commented 1 year ago

This go client for now is a minimal, generated gRPC client. Since it's using HTTP/2 and the go library is supposed to manage its own connection pool, I would say iterate over a slice extracting chunks of 50 or 100, and issue an upsert() call each time. I am not yet a proficient Go dev, but here seems like it's done with Goroutines: https://zetcode.com/web/async-http-requests/