cannot parallelize extraction from function output tuples

aiporre / multidataloader

Dataloader for Tensor Flow using the multithreading features

Apache License 2.0

8 stars 0 forks source link

cannot parallelize extraction from function output tuples #3

Open aiporre opened 4 years ago

aiporre commented 4 years ago

    .....lib\site-packages\dpipe\factories.py:104 None  *
        lambda x: tf.data.Dataset.from_generator(self.gen_object.read_fcn, self.dataset.element_spec.dtype, self.dataset.element_spec.shape, args=(x,)),

    AttributeError: 'tuple' object has no attribute 'dtype'

aiporre commented 3 years ago

Another error related TF2.3 does create datasets from mixed type dataset as ('path_to_file', label int) e.g. ('/home/image1.txt', 10.0) fails in parallelization.