Closed tcnichol closed 4 months ago
Using the huggingface ray dataset extractor, I noticed I was getting an error when iterating through the fileList.
The fileList contained a field metadata (related to the pagination) and then 'data'.
This line
if f['id'] == fileid:
causes an error because f is a metadata object, and not a file object.
Using the huggingface ray dataset extractor, I noticed I was getting an error when iterating through the fileList.
The fileList contained a field metadata (related to the pagination) and then 'data'.
This line
if f['id'] == fileid:causes an error because f is a metadata object, and not a file object.