search

rom1504 / embedding-reader

Efficiently read embedding in streaming from any filesystem
MIT License
94 stars 19 forks source link

Is the content of embedding_folder always npy, but why is the shape of npy files two-dimensional while the image is three-dimensional #68

Closed chuanyueaiqing closed 3 months ago

chuanyueaiqing commented 3 months ago

Is the content of embedding_folder always npy, but why is the shape of npy files two-dimensional while the image is three-dimensional

rom1504 commented 3 months ago

Embedding reader does not manipulate images.

chuanyueaiqing commented 3 months ago

So what should we read?

chuanyueaiqing commented 3 months ago

Or how should I transform the image data to be read and loaded

rom1504 commented 3 months ago

What are you trying to do ?

Embedding reader is a package to read embeddings

Do you want to read embeddings ?

chuanyueaiqing commented 3 months ago

I'm very sorry, as I am reading a code article for Dalle2 that uses your code for data source iteration. I would like to try the code for Dalle2, but because its data source uses your function, I don't know how to create the data source.