rom1504 embedding-reader issues

rom1504 / embedding-reader

Efficiently read embedding in streaming from any filesystem

MIT License

89 stars 18 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Is the content of embedding_folder always npy, but why is the shape of npy files two-dimensional while the image is three-dimensional

#68 chuanyueaiqing closed 1 week ago
5
Bump black from 24.1.0 to 24.4.2

#67 dependabot[bot] opened 2 months ago
0
Bump pytest from 7.4.4 to 8.1.2

#66 dependabot[bot] opened 2 months ago
0
Bump black from 24.1.0 to 24.4.1

#65 dependabot[bot] closed 2 months ago
1
Bump mypy from 1.8.0 to 1.10.0

#64 dependabot[bot] opened 2 months ago
0
Bump black from 24.1.0 to 24.4.0

#63 dependabot[bot] closed 2 months ago
1
aiohttp.client_exceptions.ClientPayloadError: Response payload is not completed

#62 DJLee68 opened 3 months ago
0
Bump pytest-cov from 4.1.0 to 5.0.0

#61 dependabot[bot] opened 3 months ago
0
No embeddings found in folder

#60 loretoparisi closed 3 months ago
2
Bump black from 24.1.0 to 24.3.0

#59 dependabot[bot] closed 3 months ago
1
Bump pytest from 7.4.4 to 8.1.1

#58 dependabot[bot] closed 2 months ago
1
Bump mypy from 1.8.0 to 1.9.0

#57 dependabot[bot] closed 2 months ago
1
Bump pytest from 7.4.4 to 8.0.2

#56 dependabot[bot] closed 4 months ago
1
Bump pylint from 3.0.3 to 3.1.0

#55 dependabot[bot] opened 4 months ago
0
Bump pylint from 3.0.3 to 3.0.4

#54 dependabot[bot] closed 4 months ago
1
Bump pytest from 7.4.4 to 8.0.1

#53 dependabot[bot] closed 4 months ago
1
Bump black from 24.1.0 to 24.2.0

#52 dependabot[bot] closed 4 months ago
1
Bump pytest from 7.4.4 to 8.0.0

#51 dependabot[bot] closed 4 months ago
1
Bump black from 24.1.0 to 24.1.1

#50 dependabot[bot] closed 5 months ago
1
Bump black from 23.12.1 to 24.1.0

#49 dependabot[bot] closed 5 months ago
0
Add requirements.txt to sdist, remove README.md from data_files

#48 charles-dyfis-net opened 5 months ago
0
1.7.0 published tarball does not include requirements.txt

#47 charles-dyfis-net opened 5 months ago
6
Update pyarrow requirement from <15,>=6.0.1 to >=6.0.1,<16

#46 dependabot[bot] closed 5 months ago
0
update deps

#45 rom1504 closed 6 months ago
0
Fix glob path in get_file_list

#44 bencwallace closed 6 months ago
6
EmbeddingReader.__init__() got an unexpected keyword argument 'metadata_folder'

#43 segalinc closed 6 months ago
8
fix homepage

#42 dotlambda closed 11 months ago
0
Release 1.5.1

#41 rom1504 closed 1 year ago
0
Make library installable in python3.11

#40 victor-paltz closed 1 year ago
0
Would there be a way to allow for more recent pyarrow versions?

#39 gietema closed 6 months ago
3
[question] Multiple vs single parquet/np files for embeddings

#38 apsdehal closed 6 months ago
1
str() causes .npy file header to fail regex

#37 796F closed 1 year ago
5
Fix to ValueError raised on Windows when this function is run (https://github.com/criteo/autofaiss/issues/113)

#36 Frikallo closed 1 year ago
4
How do you prepare the local dataset?

#35 zhenzi0322 closed 1 year ago
3
AttributeError: 'NoneType' object has no attribute 'group'

#34 zhenzi0322 closed 6 months ago
7
try out new fsspec feature to speed up parquet read

#33 rom1504 opened 1 year ago
0
Missing format string specifier

#32 UnknownError55 closed 6 months ago
1
Add the possibility for the user to specify a regex string to target specific embeddings/metadata files with glob

#31 victor-paltz closed 1 year ago
1
[Fix/new feature] Add max_ram_usage_in_bytes parameter for better control of ram usage

#30 victor-paltz closed 1 year ago
10
[Not yet tested] Ability to load 3 dimensions worth of embeddings

#29 TheoCoombes closed 6 months ago
3
consider moving most examples to dedicated packages

#28 rom1504 opened 2 years ago
1
build dedicated package, depending on this to create clip subset

#27 rom1504 opened 2 years ago
0
improve parquet reader in the same way as parquet numpy reader

#26 rom1504 opened 2 years ago
0
faster numpy parquet

#25 rom1504 closed 2 years ago
1
Added a readme example for parquet_npy file format

#24 Veldrovive closed 2 years ago
0
Add a sequential reader

#23 rom1504 opened 2 years ago
2
added hosted laion5b to demo

#22 dmarx closed 2 years ago
0
Numpy parquet faster

#21 rom1504 closed 2 years ago
4
reimplement parquet reader using ParquetFile

#20 rom1504 closed 2 years ago
20
solve memleak in parquet numpy reader

#19 rom1504 closed 2 years ago
7