issues
search
rom1504
/
img2dataset
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
MIT License
3.62k
stars
336
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Bump pytest-xdist from 2.5.0 to 3.5.0
#385
dependabot[bot]
closed
8 months ago
1
Bump pylint from 2.13.4 to 3.0.3
#384
dependabot[bot]
closed
8 months ago
1
Update pandas requirement from <2,>=1.1.5 to >=1.1.5,<3
#383
dependabot[bot]
closed
8 months ago
1
Bump pytest from 7.0.1 to 7.4.4
#382
dependabot[bot]
closed
8 months ago
1
custom dataset
#381
mayilin0714
closed
8 months ago
1
Add hf:// file system in README
#380
lhoestq
closed
8 months ago
1
LAION-Aesthetic Huggingface Error: Access to this resource is disabled.
#379
haodong2000
closed
8 months ago
1
cannot download laion-high-resolution
#378
Harper714
closed
8 months ago
2
parallelize tests with gh action containers
#377
rom1504
opened
8 months ago
0
Remove version restriction for fsspec
#376
rom1504
closed
8 months ago
0
Run img2dataset on goolge cloud
#375
zwzhu-d
closed
8 months ago
1
Query Regarding Performance Optimisation for Large-Scale Downloads
#374
yihong1120
opened
8 months ago
1
Added incremental mode 'extend'
#373
edwardguil
closed
8 months ago
2
laion-coco not available
#372
vanpersie32
closed
9 months ago
1
Clarification of correct TSV file for CC3M?
#371
RylanSchaeffer
opened
9 months ago
3
Download all of CC3M
#369
MohammedSB
closed
9 months ago
3
Retry only on certain HTTP codes
#368
pabl0
opened
9 months ago
1
Firewall Rules Tripped
#367
jamboNum5
closed
8 months ago
6
100% "hash mismatch" when doing md5 sanity check on laion2B
#366
fabiozappo
closed
9 months ago
3
Add support for the X-Robots-Tag noml header
#365
robrwo
opened
10 months ago
1
Functionality to split a WDS
#364
floschne
closed
8 months ago
1
Fix typos
#363
kianmeng
closed
8 months ago
1
DNS resolver without sudo and systemd
#361
benbergner
closed
10 months ago
3
70% of files are not downloaded due to name resolution error
#360
TheSeriousProgrammer
closed
10 months ago
2
S3 laion5b upload faild
#359
kelisiya
closed
9 months ago
1
How can I continue to download with incremental mode
#358
Moonteresa
closed
9 months ago
2
Is it possible to read LAION-400M from LAION-5B tarfiles?
#357
xwen99
closed
11 months ago
6
Error reported downloading coyo-700m
#356
Daming-TF
opened
11 months ago
0
Error when importing cv2
#355
awsankur
closed
8 months ago
3
Add docs on downloading LAION-COCO
#354
bryant1410
closed
11 months ago
3
Streaming refacto
#353
rom1504
opened
11 months ago
37
Add an example to download fondant25m
#352
rom1504
opened
11 months ago
0
Fix download script in laion-high-resolution docs
#351
BitPhinix
closed
11 months ago
1
fix(example): move python code into __main__
#350
Adenialzz
closed
8 months ago
7
ValueError: Invalid output format webdataset\--output_folder
#349
YMKiii
closed
1 year ago
0
How can I download directly to the original size without resizing?
#348
TiaoziLiao
closed
9 months ago
2
UnicodeEncodeError: 'charmap' codec can't encode characters in position 74-78: character maps to <undefined>
#347
geroldmeisinger
opened
1 year ago
2
Implement sanity check for hash value
#346
geroldmeisinger
closed
8 months ago
3
Ctrl+C doesn't work on Windows 10 using Miniconda
#345
geroldmeisinger
opened
1 year ago
1
json not written and text file empty for files omitted from re-encoding
#344
geroldmeisinger
closed
8 months ago
2
The download process goes on forever
#343
novruzgurbanov
opened
1 year ago
6
[BUGFIX] .txt file with commas in URLs
#342
bkj
opened
1 year ago
2
fix int conversion failure caused by macos hidden file in logger.py
#341
FlyHighest
closed
8 months ago
1
fix int conversion failure caused by macos hidden file in logger.py
#340
FlyHighest
closed
1 year ago
0
Refactor as a (self hosted) service
#339
rom1504
opened
1 year ago
2
High Initial RAM Usage Leads to Crashes
#338
Sypherd
opened
1 year ago
2
Support all compression types via fsspec
#337
Skylion007
opened
1 year ago
1
Package knot resolver as a python package and use it
#336
rom1504
opened
1 year ago
1
minor fix laion-high-resolution.md
#335
ShoufaChen
closed
1 year ago
0
Cloudflare R2 Compatibility
#334
zanussbaum
closed
8 months ago
6
Previous
Next