frictionlessdata / datapackage-py

A Python library for working with Data Packages.
https://frictionlessdata.io
MIT License
191 stars 43 forks source link

too many opened file exception caused by large multipart/chunks number #276

Closed paulgirard closed 4 years ago

paulgirard commented 4 years ago

Overview

I have a table-data resource with thousands of chunks. resource.iter throw a "too many opened file" as the multipart.iter open all the streams at the same time. Easy to solve by using a stream iterator instead. I open a PR about this.


Please preserve this line to notify @roll (lead of this repository)

roll commented 4 years ago

Fixed in #277