search

graykode / matorage

Matorage is tensor(multidimensional matrix) object storage manager for deep learning framework(Pytorch, Tensorflow V2, Keras)
https://matorage.readthedocs.io
Other
73 stars 8 forks source link

(add) refresh argument on data saver #4

Closed graykode closed 4 years ago

graykode commented 4 years ago

Usage : 

import numpy as np
from matorage import *

if __name__ == '__main__':
    data_config = DataConfig(
        endpoint="127.0.0.1:9000",
        access_key="minio",
        secret_key="miniosecretkey",
        dataset_name="test_datasaver_refresh",
        attributes=[DataAttribute("x", "float64", (2), itemsize=32)],
    )
    for refresh in [False, True]:
        data_saver = DataSaver(config=data_config, refresh=refresh)
        x = np.asarray([[1.0, 2.0], [3.0, 4.0], [5.0, 6.0]])
        data_saver({"x": x})
        data_saver.disconnect()