Open cbenhagen opened 1 year ago
Yes, agreed - that'd be ideal.
Does XXH3 work with streams? If so, do you know of any working implementations of this?
EDIT: found my answer to both; yes and yes. https://github.com/Cyan4973/xxHash/blob/dev/xxhash.h#L133 I'll start looking into this, but I have limited time available so I can't promise anything soon.
The current implementation requires the whole data to be in memory. Allowing a
Stream<List<int>>
as an input would make it possible to hash big files.