Support `savez`/`savez_compressed` and loading NpzFiles

helmholtz-analytics / heat

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

https://heat.readthedocs.io/

MIT License

210 stars 53 forks source link

Support `savez`/`savez_compressed` and loading NpzFiles #950

Closed ClaudiaComito closed 1 year ago

ClaudiaComito commented 2 years ago

Any chance for supporting savez/savez_compressed and loading NpzFiles?

Originally posted by @fschlimb in https://github.com/helmholtz-analytics/heat/issues/101#issuecomment-843967591

References:

Dhruv454000 commented 2 years ago

@ClaudiaComito I would like to work on this one.

mrfh92 commented 1 year ago

Since .npz-format is not an HPC-typical format, it does not make sense from my point of view, to save DNDarray's that really need distribution in this format. On the other hand, for DNDarrays's that are sufficiently small to admit conversion to a non-distributed numpy-array, its easy to use this conversion and to save as .npz afterwards.

Therefore, closed within #1109