Improve folders & files tree discovery

[devcatalin]

We should probably use the following two NPM libraries to improve our current way of reading files, without having to refactor too much code:

• [ ] https://www.npmjs.com/package/glob - to discover the entire file tree for **/*.yaml files
• [ ] https://www.npmjs.com/package/ignore - to ignore all files from .gitignore
• [ ] https://www.npmjs.com/package/graceful-fs - Queues up open and readdir calls, and retries them once something closes if there is an EMFILE error from too many file descriptors.
• [ ] https://www.npmjs.com/package/@parcel/watcher - faster watcher for files

[chargio]

Adding the performance label to this