Franck-Dernoncourt
commented
4 years ago I've just tried running the Docker example in https://github.com/KhalilMrini/LAL-Parser#inference on my side. Everything works fine. Did you run the same commands or did you change anything? Also, why do you say "I am using benepar[cpu] and tensorflow==2.0.0b1 since tensorflow==2.0.0 could not be found."? Did you get some error messages other than RuntimeError: The size of tensor a (39) must match the size of tensor b (35) at non-singleton dimension 0?
FYI:
root@4a133a3a9d40:/LAL-Parser# pip freeze
absl-py==0.9.0
asn1crypto==0.24.0
astor==0.8.1
benepar==0.1.2
boto3==1.14.2
botocore==1.17.2
certifi==2020.4.5.2
chardet==3.0.4
click==7.1.2
cryptography==2.1.4
Cython==0.29.20
dataclasses==0.7
docutils==0.15.2
filelock==3.0.12
gast==0.3.3
gdown==3.11.1
google-pasta==0.2.0
grpcio==1.29.0
h5py==2.10.0
idna==2.6
importlib-metadata==1.6.1
jmespath==0.10.0
joblib==0.15.1
Keras-Applications==1.0.8
Keras-Preprocessing==1.1.2
keyring==10.6.0
keyrings.alt==3.0
Markdown==3.2.2
nltk==3.5
numpy==1.18.5
protobuf==3.12.2
pycrypto==2.6.1
pygobject==3.26.1
PySocks==1.7.1
python-dateutil==2.8.1
pytorch-pretrained-bert==0.6.2
pyxdg==0.25
regex==2020.6.8
requests==2.23.0
s3transfer==0.3.3
sacremoses==0.0.43
SecretStorage==2.3.1
sentencepiece==0.1.83
six==1.15.0
tensorboard==2.0.0
tensorboardX==2.0+022f060
tensorflow-estimator==1.14.0
tensorflow-gpu==1.14.0
termcolor==1.1.0
tokenizers==0.5.2
torch==1.1.0
tqdm==4.45.0
transformers==2.8.0
urllib3==1.25.9
Werkzeug==1.0.1
wrapt==1.12.1
zipp==3.1.0
krasi0
@KhalilMrini thanks for your great work! Could the following error be due to a recently changed dependency: Note: I am using benepar[cpu] and tensorflow==2.0.0b1 since tensorflow==2.0.0 could not be found.
$ source parse_quick.sh /home/user/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:516: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint8 = np.dtype([("qint8", np.int8, 1)]) /home/user/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:517: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_quint8 = np.dtype([("quint8", np.uint8, 1)]) /home/user/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:518: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint16 = np.dtype([("qint16", np.int16, 1)]) /home/user/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:519: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_quint16 = np.dtype([("quint16", np.uint16, 1)]) /home/user/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:520: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. _np_qint32 = np.dtype([("qint32", np.int32, 1)]) /home/user/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'. np_resource = np.dtype([("resource", np.ubyte, 1)]) Not using CUDA! Loading model from best_parser.pt... /home/user/.local/lib/python3.6/site-packages/torch/nn/_reduction.py:43: UserWarning: size_average and reduce args will be deprecated, please use reduction='sum' instead. warnings.warn(warning.format(ret)) Parsing sentences... Parsing sentences: 0%| | 0/1 [00:00<?, ?it/s]/pytorch/aten/src/ATen/native/LegacyDefinitions.cpp:29: UserWarning: masked_select received a mask with dtype torch.uint8, this behavior is now deprecated,please use a mask with dtype torch.bool instead. /pytorch/aten/src/ATen/native/TensorAdvancedIndexing.cpp:543: UserWarning: maskedfill received a mask with dtype torch.uint8, this behavior is now deprecated,please use a mask with dtype torch.bool instead. /pytorch/aten/src/ATen/native/IndexingUtils.h:20: UserWarning: indexing with dtype torch.uint8 is now deprecated, please use a dtype torch.bool instead. Parsing sentences: 0%| | 0/1 [00:00<?, ?it/s] Traceback (most recent call last): File "src_joint/main.py", line 788, in
main()
File "src_joint/main.py", line 784, in main
args.callback(args)
File "src_joint/main.py", line 711, in runparse
syntree, = parser.parse_batch(tagged_sentences)
File "/home/user/LAL-Parser/src_joint/KM_parser.py", line 1771, in parse_batch
annotations, self.current_attns = self.encoder(emb_idxs, pre_words_idxs, batch_idxs, extra_content_annotations=extra_content_annotations)
File "/home/user/.local/lib/python3.6/site-packages/torch/nn/modules/module.py", line 550, in call
result = self.forward(*input, *kwargs)
File "/home/user/LAL-Parser/src_joint/KM_parser.py", line 1170, in forward
res, current_attns = attn(res, batch_idxs)
File "/home/user/.local/lib/python3.6/site-packages/torch/nn/modules/module.py", line 550, in call
result = self.forward(input, **kwargs)
File "/home/user/LAL-Parser/src_joint/KM_parser.py", line 404, in forward
return self.layer_norm(outputs + residual), attns_padded
RuntimeError: The size of tensor a (39) must match the size of tensor b (35) at non-singleton dimension 0