WaveBeans / wavebeans

Audio Processing. On scale.
https://wavebeans.io
Apache License 2.0
23 stars 0 forks source link

File System to handle multiple reads #94

Open asubb opened 3 years ago

asubb commented 3 years ago

During processing some the file attempted to be read more than once. For example WavInput reads the file every time the sequence is created.

Two main consideration points:

  1. Some file systems may not support multiple reads (i.e. reading from HTTP/network source).
  2. It is might be inefficient.

No proposed solutions at the moment. The ideas:

  1. Either generically cache in local file systems, though may not work for some cases, when the user of the file system can be distributed physically across different machines with no access to shared FS.
  2. OR FS user itself should tackle the problem on its own depending on the use case, though FS should state the fact that multiple reads are not supported.