search

rizkiarm / LipNet

Keras implementation of 'LipNet: End-to-End Sentence-level Lipreading'
MIT License
628 stars 224 forks source link

Getting Loading dataset list from cache... Found 0 videos for training. Found 0 videos for validation. #51

Closed kpkool1995 closed 6 years ago

kpkool1995 commented 6 years ago

Hi,

Can anyone help me as I am getting the following error while training the model from train.py

Loading dataset list from cache... Found 0 videos for training. Found 0 videos for validation.

Layer (type) Output Shape Param #

the_input (InputLayer) (None, 75, 100, 50, 3) 0

zero1 (ZeroPadding3D) (None, 77, 104, 54, 3) 0

conv1 (Conv3D) (None, 75, 50, 25, 32) 7232

batc1 (BatchNormalization) (None, 75, 50, 25, 32) 128

actv1 (Activation) (None, 75, 50, 25, 32) 0

spatial_dropout3d_1 (Spatial (None, 75, 50, 25, 32) 0

max1 (MaxPooling3D) (None, 75, 25, 12, 32) 0

zero2 (ZeroPadding3D) (None, 77, 29, 16, 32) 0

conv2 (Conv3D) (None, 75, 25, 12, 64) 153664

batc2 (BatchNormalization) (None, 75, 25, 12, 64) 256

actv2 (Activation) (None, 75, 25, 12, 64) 0

spatial_dropout3d_2 (Spatial (None, 75, 25, 12, 64) 0

max2 (MaxPooling3D) (None, 75, 12, 6, 64) 0

zero3 (ZeroPadding3D) (None, 77, 14, 8, 64) 0

conv3 (Conv3D) (None, 75, 12, 6, 96) 165984

batc3 (BatchNormalization) (None, 75, 12, 6, 96) 384

actv3 (Activation) (None, 75, 12, 6, 96) 0

spatial_dropout3d_3 (Spatial (None, 75, 12, 6, 96) 0

max3 (MaxPooling3D) (None, 75, 6, 3, 96) 0

time_distributed_1 (TimeDist (None, 75, 1728) 0

bidirectional_1 (Bidirection (None, 75, 512) 3048960

bidirectional_2 (Bidirection (None, 75, 512) 1181184

dense1 (Dense) (None, 75, 28) 14364

softmax (Activation) (None, 75, 28) 0

Total params: 4,572,156 Trainable params: 4,571,772 Non-trainable params: 384

train.py:69: UserWarning: Update your fit_generator call to the Keras 2 API: fit_generator(generator=<lipnet.he..., steps_per_epoch=0.0, epochs=20, validation_data=<lipnet.he..., validation_steps=0.0, callbacks=[<keras.ca..., initial_epoch=0, verbose=1, workers=2, use_multiprocessing=False, max_queue_size=5) pickle_safe=False) Traceback (most recent call last): File "train.py", line 73, in train(run_name, 0, 20, 3, 100, 50, 75, 32, 50) File "train.py", line 69, in train pickle_safe=False) File "C:\Users\karan.kumar.panda\AppData\Local\Programs\Python\Python36\lib\site-packages\keras\legacy\interfaces.py", line 91, in wrapper return func(*args, **kwargs) File "C:\Users\karan.kumar.panda\AppData\Local\Programs\Python\Python36\lib\site-packages\keras\engine\training.py", line 2107, in fit_generator raise ValueError('validation_steps=None is only valid for a' ValueError: validation_steps=None is only valid for a generator based on the keras.utils.Sequence class. Please specify validation_steps or use the keras.utils.Sequence class.

liviust commented 6 years ago

Check the symlinks.

gzz666 commented 5 years ago

Hey,can you let me see your folders? I do not understand how to create symlink

DerekChia commented 5 years ago

Did you follow the instruction?

Overlapped Speakers

Run the preparation script:

python prepare.py [Path to video dataset] [Path to align dataset] [Number of samples]

Notes:

  • [Path to video dataset] should be a folder with structure: /s{i}/[video]
  • [Path to align dataset] should be a folder with structure: /[align].align
  • [Number of samples] should be less than or equal to min(len(ls '/s{i}/*'))

Then run training for each speaker:

python training/overlapped_speakers/train.py s{i}
gzz666 commented 5 years ago

yes,thanks!however ,I have other issue. ValueError: output of generator should be a tuple (x, y, sample_weight) or (x, y). Found: None I do not know how to solve it Do you know?

DerekChia commented 5 years ago

yes,thanks!however ,I have other issue. ValueError: output of generator should be a tuple (x, y, sample_weight) or (x, y). Found: None I do not know how to solve it Do you know?

I also getting this error and trying to fix it now. If you'd like to solve it together, can you please contact me via my email (see profile), thanks!

kawseribn commented 4 years ago

@DerekChia can you show me how should i put folders? i am also facing probelm regarding symlink. Though i saw their attached description but its not clear to me.