search

FacePerceiver / LAION-Face

The human face subset of LAION-400M for large-scale face pretraining.
274 stars 17 forks source link

OSError : corrupt snappy compressed data #4

Closed NamisMe closed 1 year ago

NamisMe commented 1 year ago 
    Hi, thanks for sharing data.

an Error "OSError : Corrupt snappy compressed data" occured. Other sites says it is conflict of version (1 and 2) (https://issues.apache.org/jira/browse/ARROW-6057), but there is no solution. image

How can we solve this ?

Originally posted by @NamisMe in https://github.com/FacePerceiver/LAION-Face/issues/2#issuecomment-1370428956

yinglinzheng commented 1 year ago

I think you might download a corrupted metadata, maybe you should try download again and evaluate the completeness of these parquet file.