sheng-z / stog

AMR Parsing as Sequence-to-Graph Transduction
MIT License
154 stars 36 forks source link

Occasional problem with training on subsets of AMR 2.0 #16

Open sctratz opened 4 years ago

sctratz commented 4 years ago

I'm trying to train the AMR parser on subsets of AMR 2.0 in order to see how performance scales with the number of training examples. Normally, it works just fine. But, for some subsets, I end up encountering errors. Below is the output I get when training using just 75% of the AMR 2.0 training data. I've attached a list of the training example ids in case that it is helpful.

Step 1

python -u -m stog.commands.train data/subsets/train_75_s0/config.yaml &> RUN75_STEP1.log

Step 2

python -u -m stog.commands.predict --archive-file data/subsets/train_75_s0/ckpt-dir \ --weights-file data/subsets/train_75_s0/ckpt-dir/best.th \ --input-file data/subsets/train_75_s0/test.txt.features.preproc \ --batch-size 32 \ --use-dataset-reader \ --cuda-device 0 \ --output-file data/subsets/train_75_s0/test.pred.txt \ --silent \ --beam-size 5 \ --predictor STOG

Step 3

./scripts/postprocess_2.0.sh data/subsets/train_75_s0/test.pred.txt

Step 4

./scripts/compute_smatch.sh data/subsets/train_75_s0/test.pred.txt data/AMR/amr_2.0/test.txt

Step 4 output

Error in parsing AMR (vv1 / beyond:domain (vv2 / suppose-02:ARG1 (vv3 / i):ARG2 (vv4 / keep-01:ARG0 vv3:ARG1 (vv6 / horse:mod 1/ Traceback (most recent call last): File "smatch/smatch.py", line 837, in main(args) File "smatch/smatch.py", line 737, in main amr1.rename_node(prefix1) AttributeError: 'NoneType' object has no attribute 'rename_node' Smatch -> P: , R: , F: Error in parsing AMR (vv1 / beyond:label (vv2 / suppose-02:label (vv3 / i):label (vv4 / keep-01:label vv3:label (vv6 / horse:label 1/ Traceback (most recent call last): File "smatch/smatch.py", line 837, in main(args) File "smatch/smatch.py", line 737, in main amr1.rename_node(prefix1) AttributeError: 'NoneType' object has no attribute 'rename_node' Unlabeled -> P: , R: , F: Error in parsing AMR (vv1 / beyond:domain (vv2 / suppose-01:ARG1 (vv3 / i):ARG2 (vv4 / keep-01:ARG0 vv3:ARG1 (vv6 / horse:mod 1/ Traceback (most recent call last): File "smatch/smatch.py", line 837, in main(args) File "smatch/smatch.py", line 737, in main amr1.rename_node(prefix1) AttributeError: 'NoneType' object has no attribute 'rename_node' No WSD -> P: , R: , F: Error in parsing AMR (vv1 / beyond :domain (vv2 / suppose-02 :ARG1 (vv3 / i) :ARG2 (vv4 / keep-01 :ARG0 vv3 :ARG1 (vv6 / horse :mod 1/ Traceback (most recent call last): File "scores.py", line 121, in dict_pred = var2concept(amr_pred) File "scores.py", line 103, in var2concept for n, v in zip(amr.nodes, amr.node_values): AttributeError: 'NoneType' object has no attribute 'nodes'

training_example_ids_list.txt