Data loading is quiet slow

EulerSearch / embedding_studio

Embedding Studio is a framework which allows you transform your Vector Database into a feature-rich Search Engine.

https://embeddingstud.io/

Apache License 2.0

377 stars 5 forks source link

Data loading is quiet slow #2

Open zhannachan opened 8 months ago

zhannachan commented 8 months ago

Hey, trying to run the fine tuning , found out that image downloading is quite slow. Checked it out, seems that it’s even not multithreaded or async. Are you going to speed it up somehow?

oYASo commented 8 months ago

Hello! Yes, we're working on improving performance and implementing asynchronous requests. This will be done in the upcoming releases. Soon!