search

SuperchupuDev / tinyglobby

A fast and minimal alternative to globby and fast-glob
https://npmjs.com/package/tinyglobby
MIT License
149 stars 9 forks source link

Support for globStream #59

Closed etnoy closed 1 month ago

etnoy commented 1 month ago

I'm looking to migrate from fast-glob, but I don't see a way to stream results like fast-glob does with globStream.

For very large directories with millions of files, node tends to crash due to running out of memory. We use globStream to paginate the result and manage the files in batches, but this appears not to be possible in tinyglobby yet.

benmccann commented 1 month ago

I requested this in https://github.com/SuperchupuDev/tinyglobby/issues/24 earlier on, but hard to find as I didn't name it well. I just renamed it

SuperchupuDev commented 1 month ago

this first needs streams support on thecodrr/fdir, duplicate of #24 though