search

drcapybara / capyCRYPT

An experimental high-performance cryptosystem.
MIT License
11 stars 1 forks source link

feature: support parallel file processing #10

Open drcapybara opened 10 months ago

drcapybara commented 10 months ago

Use rayon to open and hash a file in batches. part of larger batch issue.

drcapybara commented 10 months ago

This will consist of multiple parts.

  1. Need to read in files of any size and convert to byte arrays before passing into library.
  2. Should carefully take into account size of file. Sliding window will likely be needed.
  3. Open question about how to handle in place operations. Can be destructive if we do not account for interruptions in execution.
  4. Should use rayon crate to perform file based hashing in parallel if possible