cywang97 / StreamingTransformer

Apache License 2.0
271 stars 42 forks source link

Start train stage, data read error. #17

Open lilong04 opened 3 years ago

lilong04 commented 3 years ago

70 File "/root/anaconda3/lib/python3.7/site-packages/torch/multiprocessing/spawn.py", line 19, in _wrap 71 fn(i, *args) 72 File "/data/app/lilong/StreamingTransformer/espnet/asr/pytorch_backend/asr_ddp.py", line 319, in dist_train 73 train_epoch(train_loader, model, optimizer, epoch, args) 74 File "/data/app/lilong/StreamingTransformer/espnet/asr/pytorch_backend/asr_ddp.py", line 348, in train_epoch 75 for i, batch in enumerate(train_loader): 76 File "/root/anaconda3/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 615, in next 77 batch = self.collate_fn([self.dataset[i] for i in indices]) 78 File "/root/anaconda3/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 615, in 79 batch = self.collate_fn([self.dataset[i] for i in indices]) 80 File "/root/anaconda3/lib/python3.7/site-packages/chainer/dataset/dataset_mixin.py", line 67, in getitem 81 return self.get_example(index) 82 File "/root/anaconda3/lib/python3.7/site-packages/chainer/datasets/transform_dataset.py", line 52, in get_example 83 return self._transform(in_data) 84 File "/data/app/lilong/StreamingTransformer/espnet/asr/pytorch_backend/asr_ddp.py", line 291, in 85 train_dataset = TransformDataset(train, lambda data: converter(load_tr(data))) 86 File "/data/app/lilong/StreamingTransformer/espnet/asr/pytorch_backend/asr_ddp.py", line 118, in call 87 ys_pad = pad_list([torch.from_numpy(y) for y in ys], 88 File "/data/app/lilong/StreamingTransformer/espnet/asr/pytorch_backend/asr_ddp.py", line 118, in 89 ys_pad = pad_list([torch.from_numpy(y) for y in ys], 90 TypeError: expected np.ndarray (got numpy.int64)

I print the ys, like this: (1021,)

Under the egs/librispeech/asr1/ folder and run train.sh Is this a pytorch or numpy version problem?

Help me please.