powturbo / Turbo-Base64

Turbo Base64 - Fastest Base64 SIMD:SSE/AVX2/AVX512/Neon/Altivec - Faster than memcpy!
GNU General Public License v3.0
264 stars 40 forks source link

restartable algo #16

Closed jgm-ktg closed 1 year ago

jgm-ktg commented 2 years ago

Hello,

It is often not feasible to prepare the entire input buffer or the entire output buffer prior to a single call of a transformation algo.

For example, look at zlib API. User provides input chunks in succession and output chunks in succession. The entire data to be transformed does not have to be in memory at once.

https://zlib.net/zlib_how.html

Please provide this kind of multi-call API!

jgm-ktg commented 2 years ago

Hmm, is it true that processing input in multiples of 3 fulfills this requirement already?

powturbo commented 1 year ago

Yes