search

chipsenkbeil / vimwiki-rs

Rust library and tooling to parse, render, and modify vimwiki text and files.
56 stars 2 forks source link

Investigate optional rayon dependency for parallel file parsing #96

Closed chipsenkbeil closed 3 years ago

chipsenkbeil commented 3 years ago

Rather than sequentially parsing files with the vimwiki-server, it could be a performance improvement to leverage https://github.com/rayon-rs/rayon to do the work. It isn't the same as futures in that it uses a thread pool to split up work rather than a future that would consume the active thread until paused.

chipsenkbeil commented 3 years ago

Tried it out in a local branch for vimwiki-cli and did not seem to help, which is surprising as I assumed a thread pool would be able to tackle multiple files.

Either it doesn't work well with file I/O or there is something else going on. Going to close out