iscc / iscc-specs

ISCC: International Standard Content Code
http://iscc.codes
Other
47 stars 9 forks source link

Implement optional performance optimized reference implementation #18

Open titusz opened 6 years ago

titusz commented 6 years ago

The reference code is currently implemented with minimal dependencies and no performance optimizations. For real world and large scale testing of the ISCC we need faster ISCC generation.

Create an optional parallel iscc_opt.py module with the same interface that is optimized by using packages like numpy, numba, gmpy, cython (to be researched).

Without making these hard dependencies we could automatically use the optimized version if the required packages are available in the users environment. Performance gains of 100x or more are to be expected of such optimizations.