stactools-packages / fws-nwi

stactools package for the National Wetlands Inventory (NWI) product provided by the U.S. Fish and Wildlife Service (FWS)
Other
1 stars 0 forks source link

"Chunk" size #10

Closed m-mohr closed 1 year ago

m-mohr commented 1 year ago

Right now I'm writing 2500 rows per chunk, which in my env leads to about a max of around 8GB of memory consumption. Is this okay? Shall we make this configurable or so?

m-mohr commented 1 year ago

Make it a config option