Data pipeline: data.as_numpy_iterator error

[Noorallah1311]

Hi, did anybody find the solution for this error? I'm running the code on Google Colab, Tensorflow 2.12.0 Any help is much appreciated.

[abhishek-sameriya]

if u find the solution please tell me i m facing this problem too

[Ameya22Joshi]

For the people who are using colab,

• I used tensorflow version 2.10.1
• In load_data(), use file_name = path.split('/')[-1].split('.')[0]
• For mappable_function, use this code: from typing import Tuple def mappable_function(path:str) ->Tuple[tf.Tensor, tf.Tensor]: result = tf.py_function(load_data, [path], (tf.float32, tf.int64)) return result (The tf.py_function call returns a tuple of two tensors (tf.float32 and tf.int64), not a list of strings.)

[kido321]

@Ameya22Joshi Can you make it more clear on how to fix this issue?

[SushovanHaldar]

@Ameya22Joshi were you able to fix this issue? If yes can you please help us?

[Ameya22Joshi]

@Ameya22Joshi Can you make it more clear on how to fix this issue?

--> The return type of tensors is by default in form of tuple, but previously it was in the form of a list. Hence, we have to make it in tuple form. (def mappable_function(path:str) ->Tuple[tf.Tensor, tf.Tensor]:)

[Ameya22Joshi]

Hi, did anybody find the solution for this error? I'm running the code on Google Colab, Tensorflow 2.12.0 Any help is much appreciated.

The problem arises because there is a hidden file .ipynb_checkpoints in the data. To delete this file:

• Use the following command after extracting the data from zip file --> rm -rf find -type d -name .ipynb_checkpoints

[Ameya22Joshi]

@Ameya22Joshi were you able to fix this issue? If yes can you please help us?

Yes I was able to fix the issue. The solutions related to [data.as_numpy_iterator error] and [data/alignments/s1/.align] file not found error] are mentioned in the comments/replies.

[Sheeevani]

install specific version of tensorflow pip install tensorflow==2.10.1

Make changes in load_data function, update this line as file_name = path.split('/')[-1].split('.')[0]

Change '\' to '/' in below variables test_path = './data/s1/bbal6n.mpg' tf.convert_to_tensor(test_path).numpy().decode('utf-8').split('/')[-1].split('.')[0]

It will work fine then without any error in nextiterator :)

[sphynxlee]

install specific version of tensorflow pip install tensorflow==2.10.1

Make changes in load_data function, update this line as file_name = path.split('/')[-1].split('.')[0]

Change '\' to '/' in below variables test_path = './data/s1/bbal6n.mpg' tf.convert_to_tensor(test_path).numpy().decode('utf-8').split('/')[-1].split('.')[0]

It will work fine then without any error in nextiterator :)

Thank you, works for me!