search

XuezheMax / NeuroNLP2

Deep neural models for core NLP tasks (Pytorch version)
GNU General Public License v3.0
441 stars 89 forks source link

Gold scores for graph parser #21

Closed ianupright closed 6 years ago

ianupright commented 6 years ago

Hi,

I'm having trouble reproducing the results of the paper, and getting much lower scores. I was wondering if you happen to have the gold tag scores for 3.3.0 converted PTB for the BIAF: re-impl. It seems likely I'm getting worse scores on the gold StackPtr as well but it takes longer to run and verify.

Thanks!

XuezheMax commented 6 years ago

No, the parsers (both BiAF and StackPtr) are quite stable, with standard variance of UAS around 0.1. Please specify the version of python and pytorch you are using. Note that the code was only debugged under python 2.7. If you were using Python 3, it is highly recommended to switch to python 2.7 to verity the model.

ianupright commented 6 years ago

My setup:

Ubuntu 16.04 w/cuda driver 396.45 cuda 8.0 pytorch 0.3.1 python 2.7.14

For identical corpus verification I ran this using these files (retagged version): https://worksheets.codalab.org/bundles/0xa3d57fa7bae042aaaa71c98eb6511869/

However, this is 3.5.0, with I believe a better tagger than with Stanford. On Dozat's tensorflow biaffine, these files give better scores than 3.3.0 and better than published in the paper. I'm also getting poor scores with 3.3.0 and also with the Stack based parser as well.

ianupright commented 6 years ago

loading embedding: sskip from sskip.100.vectors.gz 2018-07-27 17:24:21,452 - GraphParser - INFO - Creating Alphabets 2018-07-27 17:24:21,453 - Create Alphabets - INFO - Creating Alphabets: models/parsing/biaffine/alphabets/ 2018-07-27 17:24:28,428 - Create Alphabets - INFO - Total Vocabulary Size: 39398 2018-07-27 17:24:28,428 - Create Alphabets - INFO - Total Singleton Size: 17417 2018-07-27 17:24:28,445 - Create Alphabets - INFO - Total Vocabulary Size (w.o rare words): 34279 2018-07-27 17:24:29,284 - Create Alphabets - INFO - Word Alphabet Size (Singleton): 35374 (12298) 2018-07-27 17:24:29,284 - Create Alphabets - INFO - Character Alphabet Size: 83 2018-07-27 17:24:29,284 - Create Alphabets - INFO - POS Alphabet Size: 48 2018-07-27 17:24:29,285 - Create Alphabets - INFO - Type Alphabet Size: 47 2018-07-27 17:24:29,286 - GraphParser - INFO - Word Alphabet Size: 35374 2018-07-27 17:24:29,286 - GraphParser - INFO - Character Alphabet Size: 83 2018-07-27 17:24:29,286 - GraphParser - INFO - POS Alphabet Size: 48 2018-07-27 17:24:29,286 - GraphParser - INFO - Type Alphabet Size: 47 2018-07-27 17:24:29,286 - GraphParser - INFO - Reading Data Reading data from /usr/local/biaffineConfig/data/PTB/current/train.conll reading data: 10000 reading data: 20000 reading data: 30000 Total number of data: 39832 Reading data from /usr/local/biaffineConfig/data/PTB/current/dev.conll Total number of data: 1700 Reading data from /usr/local/biaffineConfig/data/PTB/current/test.conll Total number of data: 2416 2018-07-27 17:24:47,341 - GraphParser - INFO - punctuations(5): ':' "''" '.' '``' ',' word OOV: 1872 2018-07-27 17:24:47,610 - GraphParser - INFO - Embedding dim: word=100 (fine tune), char=100 (enabled), pos=100 (enabled) 2018-07-27 17:24:47,610 - GraphParser - INFO - CNN: filter=100, kernel=3 2018-07-27 17:24:47,610 - GraphParser - INFO - RNN: FastLSTM, num_layer=3, hidden=512, arc_space=512, type_space=128 2018-07-27 17:24:47,610 - GraphParser - INFO - train: obj: cross_entropy, l2: 0.000000, (#data: 39831, batch: 32, clip: 5.00, unk replace: 0.50) 2018-07-27 17:24:47,610 - GraphParser - INFO - dropout(in, out, rnn): (0.33, 0.33, (0.33, 0.33)) 2018-07-27 17:24:47,610 - GraphParser - INFO - decoding algorithm: mst 2018-07-27 17:24:47,610 - GraphParser - INFO - opt: adam, betas=(0.9, 0.9), eps=1.0e-04

(slightly abbreviated log)

Epoch 1 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 34874, lcorr: 33883, total: 40117, uas: 86.93%, las: 84.46%, ucm: 25.41%, lcm: 19.59% (epoch: 1) best dev Wo Punct: ucorr: 34874, lcorr: 33883, total: 40117, uas: 86.93%, las: 84.46%, ucm: 25.41%, lcm: 19.59% (epoch: 1) best dev Root: corr: 1619, total: 1700, acc: 95.24% (epoch: 1) best test W. Punct: ucorr: 49341, lcorr: 48035, total: 56684, uas: 87.05%, las: 84.74%, ucm: 26.12%, lcm: 20.20% (epoch: 1) best test Wo Punct: ucorr: 49341, lcorr: 48035, total: 56684, uas: 87.05%, las: 84.74%, ucm: 26.12%, lcm: 20.20% (epoch: 1) best test Root: corr: 2289, total: 2416, acc: 94.74% (epoch: 1) Epoch 2 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 35912, lcorr: 34995, total: 40117, uas: 89.52%, las: 87.23%, ucm: 31.18%, lcm: 24.41% (epoch: 2) best dev Wo Punct: ucorr: 35912, lcorr: 34995, total: 40117, uas: 89.52%, las: 87.23%, ucm: 31.18%, lcm: 24.41% (epoch: 2) best dev Root: corr: 1644, total: 1700, acc: 96.71% (epoch: 2) best test W. Punct: ucorr: 50872, lcorr: 49712, total: 56684, uas: 89.75%, las: 87.70%, ucm: 32.28%, lcm: 25.99% (epoch: 2) best test Wo Punct: ucorr: 50872, lcorr: 49712, total: 56684, uas: 89.75%, las: 87.70%, ucm: 32.28%, lcm: 25.99% (epoch: 2) best test Root: corr: 2310, total: 2416, acc: 95.61% (epoch: 2) Epoch 3 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 36471, lcorr: 35582, total: 40117, uas: 90.91%, las: 88.70%, ucm: 36.41%, lcm: 28.00% (epoch: 3) best dev Wo Punct: ucorr: 36471, lcorr: 35582, total: 40117, uas: 90.91%, las: 88.70%, ucm: 36.41%, lcm: 28.00% (epoch: 3) best dev Root: corr: 1638, total: 1700, acc: 96.35% (epoch: 3) best test W. Punct: ucorr: 51505, lcorr: 50333, total: 56684, uas: 90.86%, las: 88.80%, ucm: 35.43%, lcm: 27.81% (epoch: 3) best test Wo Punct: ucorr: 51505, lcorr: 50333, total: 56684, uas: 90.86%, las: 88.80%, ucm: 35.43%, lcm: 27.81% (epoch: 3) best test Root: corr: 2314, total: 2416, acc: 95.78% (epoch: 3) Epoch 4 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 36735, lcorr: 35908, total: 40117, uas: 91.57%, las: 89.51%, ucm: 38.88%, lcm: 30.41% (epoch: 4) best dev Wo Punct: ucorr: 36735, lcorr: 35908, total: 40117, uas: 91.57%, las: 89.51%, ucm: 38.88%, lcm: 30.41% (epoch: 4) best dev Root: corr: 1651, total: 1700, acc: 97.12% (epoch: 4) best test W. Punct: ucorr: 51903, lcorr: 50836, total: 56684, uas: 91.57%, las: 89.68%, ucm: 39.16%, lcm: 31.33% (epoch: 4) best test Wo Punct: ucorr: 51903, lcorr: 50836, total: 56684, uas: 91.57%, las: 89.68%, ucm: 39.16%, lcm: 31.33% (epoch: 4) best test Root: corr: 2340, total: 2416, acc: 96.85% (epoch: 4) Epoch 5 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 36879, lcorr: 36104, total: 40117, uas: 91.93%, las: 90.00%, ucm: 40.47%, lcm: 31.76% (epoch: 5) best dev Wo Punct: ucorr: 36879, lcorr: 36104, total: 40117, uas: 91.93%, las: 90.00%, ucm: 40.47%, lcm: 31.76% (epoch: 5) best dev Root: corr: 1649, total: 1700, acc: 97.00% (epoch: 5) best test W. Punct: ucorr: 52328, lcorr: 51272, total: 56684, uas: 92.32%, las: 90.45%, ucm: 40.98%, lcm: 32.86% (epoch: 5) best test Wo Punct: ucorr: 52328, lcorr: 51272, total: 56684, uas: 92.32%, las: 90.45%, ucm: 40.98%, lcm: 32.86% (epoch: 5) best test Root: corr: 2329, total: 2416, acc: 96.40% (epoch: 5) Epoch 6 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37156, lcorr: 36372, total: 40117, uas: 92.62%, las: 90.66%, ucm: 43.53%, lcm: 33.29% (epoch: 6) best dev Wo Punct: ucorr: 37156, lcorr: 36372, total: 40117, uas: 92.62%, las: 90.66%, ucm: 43.53%, lcm: 33.29% (epoch: 6) best dev Root: corr: 1658, total: 1700, acc: 97.53% (epoch: 6) best test W. Punct: ucorr: 52599, lcorr: 51619, total: 56684, uas: 92.79%, las: 91.06%, ucm: 42.84%, lcm: 34.60% (epoch: 6) best test Wo Punct: ucorr: 52599, lcorr: 51619, total: 56684, uas: 92.79%, las: 91.06%, ucm: 42.84%, lcm: 34.60% (epoch: 6) best test Root: corr: 2351, total: 2416, acc: 97.31% (epoch: 6) Epoch 7 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37222, lcorr: 36450, total: 40117, uas: 92.78%, las: 90.86%, ucm: 43.94%, lcm: 34.18% (epoch: 7) best dev Wo Punct: ucorr: 37222, lcorr: 36450, total: 40117, uas: 92.78%, las: 90.86%, ucm: 43.94%, lcm: 34.18% (epoch: 7) best dev Root: corr: 1655, total: 1700, acc: 97.35% (epoch: 7) best test W. Punct: ucorr: 52805, lcorr: 51852, total: 56684, uas: 93.16%, las: 91.48%, ucm: 44.29%, lcm: 35.89% (epoch: 7) best test Wo Punct: ucorr: 52805, lcorr: 51852, total: 56684, uas: 93.16%, las: 91.48%, ucm: 44.29%, lcm: 35.89% (epoch: 7) best test Root: corr: 2356, total: 2416, acc: 97.52% (epoch: 7) Epoch 8 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37327, lcorr: 36592, total: 40117, uas: 93.05%, las: 91.21%, ucm: 45.71%, lcm: 35.65% (epoch: 8) best dev Wo Punct: ucorr: 37327, lcorr: 36592, total: 40117, uas: 93.05%, las: 91.21%, ucm: 45.71%, lcm: 35.65% (epoch: 8) best dev Root: corr: 1655, total: 1700, acc: 97.35% (epoch: 8) best test W. Punct: ucorr: 52913, lcorr: 51953, total: 56684, uas: 93.35%, las: 91.65%, ucm: 45.20%, lcm: 36.18% (epoch: 8) best test Wo Punct: ucorr: 52913, lcorr: 51953, total: 56684, uas: 93.35%, las: 91.65%, ucm: 45.20%, lcm: 36.18% (epoch: 8) best test Root: corr: 2361, total: 2416, acc: 97.72% (epoch: 8) Epoch 9 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37427, lcorr: 36688, total: 40117, uas: 93.29%, las: 91.45%, ucm: 47.29%, lcm: 36.53% (epoch: 9) best dev Wo Punct: ucorr: 37427, lcorr: 36688, total: 40117, uas: 93.29%, las: 91.45%, ucm: 47.29%, lcm: 36.53% (epoch: 9) best dev Root: corr: 1651, total: 1700, acc: 97.12% (epoch: 9) best test W. Punct: ucorr: 53132, lcorr: 52134, total: 56684, uas: 93.73%, las: 91.97%, ucm: 46.85%, lcm: 37.54% (epoch: 9) best test Wo Punct: ucorr: 53132, lcorr: 52134, total: 56684, uas: 93.73%, las: 91.97%, ucm: 46.85%, lcm: 37.54% (epoch: 9) best test Root: corr: 2358, total: 2416, acc: 97.60% (epoch: 9) Epoch 10 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37457, lcorr: 36725, total: 40117, uas: 93.37%, las: 91.54%, ucm: 47.41%, lcm: 37.59% (epoch: 10) best dev Wo Punct: ucorr: 37457, lcorr: 36725, total: 40117, uas: 93.37%, las: 91.54%, ucm: 47.41%, lcm: 37.59% (epoch: 10) best dev Root: corr: 1658, total: 1700, acc: 97.53% (epoch: 10) best test W. Punct: ucorr: 53099, lcorr: 52167, total: 56684, uas: 93.68%, las: 92.03%, ucm: 46.65%, lcm: 37.79% (epoch: 10) best test Wo Punct: ucorr: 53099, lcorr: 52167, total: 56684, uas: 93.68%, las: 92.03%, ucm: 46.65%, lcm: 37.79% (epoch: 10) best test Root: corr: 2359, total: 2416, acc: 97.64% (epoch: 10) Epoch 11 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37505, lcorr: 36825, total: 40117, uas: 93.49%, las: 91.79%, ucm: 47.24%, lcm: 38.00% (epoch: 11) best dev Wo Punct: ucorr: 37505, lcorr: 36825, total: 40117, uas: 93.49%, las: 91.79%, ucm: 47.24%, lcm: 38.00% (epoch: 11) best dev Root: corr: 1657, total: 1700, acc: 97.47% (epoch: 11) best test W. Punct: ucorr: 53125, lcorr: 52207, total: 56684, uas: 93.72%, las: 92.10%, ucm: 47.52%, lcm: 38.91% (epoch: 11) best test Wo Punct: ucorr: 53125, lcorr: 52207, total: 56684, uas: 93.72%, las: 92.10%, ucm: 47.52%, lcm: 38.91% (epoch: 11) best test Root: corr: 2358, total: 2416, acc: 97.60% (epoch: 11) Epoch 12 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37603, lcorr: 36891, total: 40117, uas: 93.73%, las: 91.96%, ucm: 49.41%, lcm: 38.18% (epoch: 12) best dev Wo Punct: ucorr: 37603, lcorr: 36891, total: 40117, uas: 93.73%, las: 91.96%, ucm: 49.41%, lcm: 38.18% (epoch: 12) best dev Root: corr: 1661, total: 1700, acc: 97.71% (epoch: 12) best test W. Punct: ucorr: 53275, lcorr: 52358, total: 56684, uas: 93.99%, las: 92.37%, ucm: 48.92%, lcm: 40.11% (epoch: 12) best test Wo Punct: ucorr: 53275, lcorr: 52358, total: 56684, uas: 93.99%, las: 92.37%, ucm: 48.92%, lcm: 40.11% (epoch: 12) best test Root: corr: 2366, total: 2416, acc: 97.93% (epoch: 12) Epoch 13 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37598, lcorr: 36919, total: 40117, uas: 93.72%, las: 92.03%, ucm: 49.29%, lcm: 38.65% (epoch: 13) best dev Wo Punct: ucorr: 37598, lcorr: 36919, total: 40117, uas: 93.72%, las: 92.03%, ucm: 49.29%, lcm: 38.65% (epoch: 13) best dev Root: corr: 1658, total: 1700, acc: 97.53% (epoch: 13) best test W. Punct: ucorr: 53281, lcorr: 52359, total: 56684, uas: 94.00%, las: 92.37%, ucm: 48.92%, lcm: 39.57% (epoch: 13) best test Wo Punct: ucorr: 53281, lcorr: 52359, total: 56684, uas: 94.00%, las: 92.37%, ucm: 48.92%, lcm: 39.57% (epoch: 13) best test Root: corr: 2355, total: 2416, acc: 97.48% (epoch: 13) Epoch 14 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37663, lcorr: 36970, total: 40117, uas: 93.88%, las: 92.16%, ucm: 49.94%, lcm: 39.41% (epoch: 14) best dev Wo Punct: ucorr: 37663, lcorr: 36970, total: 40117, uas: 93.88%, las: 92.16%, ucm: 49.94%, lcm: 39.41% (epoch: 14) best dev Root: corr: 1657, total: 1700, acc: 97.47% (epoch: 14) best test W. Punct: ucorr: 53380, lcorr: 52457, total: 56684, uas: 94.17%, las: 92.54%, ucm: 49.67%, lcm: 40.19% (epoch: 14) best test Wo Punct: ucorr: 53380, lcorr: 52457, total: 56684, uas: 94.17%, las: 92.54%, ucm: 49.67%, lcm: 40.19% (epoch: 14) best test Root: corr: 2359, total: 2416, acc: 97.64% (epoch: 14) Epoch 15 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37725, lcorr: 37003, total: 40117, uas: 94.04%, las: 92.24%, ucm: 51.35%, lcm: 40.06% (epoch: 15) best dev Wo Punct: ucorr: 37725, lcorr: 37003, total: 40117, uas: 94.04%, las: 92.24%, ucm: 51.35%, lcm: 40.06% (epoch: 15) best dev Root: corr: 1660, total: 1700, acc: 97.65% (epoch: 15) best test W. Punct: ucorr: 53410, lcorr: 52487, total: 56684, uas: 94.22%, las: 92.60%, ucm: 49.21%, lcm: 39.94% (epoch: 15) best test Wo Punct: ucorr: 53410, lcorr: 52487, total: 56684, uas: 94.22%, las: 92.60%, ucm: 49.21%, lcm: 39.94% (epoch: 15) best test Root: corr: 2364, total: 2416, acc: 97.85% (epoch: 15) Epoch 16 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37725, lcorr: 37003, total: 40117, uas: 94.04%, las: 92.24%, ucm: 51.35%, lcm: 40.06% (epoch: 15) best dev Wo Punct: ucorr: 37725, lcorr: 37003, total: 40117, uas: 94.04%, las: 92.24%, ucm: 51.35%, lcm: 40.06% (epoch: 15) best dev Root: corr: 1660, total: 1700, acc: 97.65% (epoch: 15) best test W. Punct: ucorr: 53410, lcorr: 52487, total: 56684, uas: 94.22%, las: 92.60%, ucm: 49.21%, lcm: 39.94% (epoch: 15) best test Wo Punct: ucorr: 53410, lcorr: 52487, total: 56684, uas: 94.22%, las: 92.60%, ucm: 49.21%, lcm: 39.94% (epoch: 15) best test Root: corr: 2364, total: 2416, acc: 97.85% (epoch: 15) Epoch 17 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37723, lcorr: 37045, total: 40117, uas: 94.03%, las: 92.34%, ucm: 51.94%, lcm: 41.00% (epoch: 17) best dev Wo Punct: ucorr: 37723, lcorr: 37045, total: 40117, uas: 94.03%, las: 92.34%, ucm: 51.94%, lcm: 41.00% (epoch: 17) best dev Root: corr: 1663, total: 1700, acc: 97.82% (epoch: 17) best test W. Punct: ucorr: 53499, lcorr: 52622, total: 56684, uas: 94.38%, las: 92.83%, ucm: 50.62%, lcm: 41.85% (epoch: 17) best test Wo Punct: ucorr: 53499, lcorr: 52622, total: 56684, uas: 94.38%, las: 92.83%, ucm: 50.62%, lcm: 41.85% (epoch: 17) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 17) Epoch 18 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37723, lcorr: 37045, total: 40117, uas: 94.03%, las: 92.34%, ucm: 51.94%, lcm: 41.00% (epoch: 17) best dev Wo Punct: ucorr: 37723, lcorr: 37045, total: 40117, uas: 94.03%, las: 92.34%, ucm: 51.94%, lcm: 41.00% (epoch: 17) best dev Root: corr: 1663, total: 1700, acc: 97.82% (epoch: 17) best test W. Punct: ucorr: 53499, lcorr: 52622, total: 56684, uas: 94.38%, las: 92.83%, ucm: 50.62%, lcm: 41.85% (epoch: 17) best test Wo Punct: ucorr: 53499, lcorr: 52622, total: 56684, uas: 94.38%, las: 92.83%, ucm: 50.62%, lcm: 41.85% (epoch: 17) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 17) Epoch 19 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37756, lcorr: 37046, total: 40117, uas: 94.11%, las: 92.34%, ucm: 52.35%, lcm: 39.82% (epoch: 19) best dev Wo Punct: ucorr: 37756, lcorr: 37046, total: 40117, uas: 94.11%, las: 92.34%, ucm: 52.35%, lcm: 39.82% (epoch: 19) best dev Root: corr: 1664, total: 1700, acc: 97.88% (epoch: 19) best test W. Punct: ucorr: 53554, lcorr: 52659, total: 56684, uas: 94.48%, las: 92.90%, ucm: 50.79%, lcm: 41.43% (epoch: 19) best test Wo Punct: ucorr: 53554, lcorr: 52659, total: 56684, uas: 94.48%, las: 92.90%, ucm: 50.79%, lcm: 41.43% (epoch: 19) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 19) Epoch 20 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37815, lcorr: 37118, total: 40117, uas: 94.26%, las: 92.52%, ucm: 50.94%, lcm: 39.71% (epoch: 20) best dev Wo Punct: ucorr: 37815, lcorr: 37118, total: 40117, uas: 94.26%, las: 92.52%, ucm: 50.94%, lcm: 39.71% (epoch: 20) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 20) best test W. Punct: ucorr: 53610, lcorr: 52741, total: 56684, uas: 94.58%, las: 93.04%, ucm: 50.91%, lcm: 41.89% (epoch: 20) best test Wo Punct: ucorr: 53610, lcorr: 52741, total: 56684, uas: 94.58%, las: 93.04%, ucm: 50.91%, lcm: 41.89% (epoch: 20) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 20) Epoch 21 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37815, lcorr: 37118, total: 40117, uas: 94.26%, las: 92.52%, ucm: 50.94%, lcm: 39.71% (epoch: 20) best dev Wo Punct: ucorr: 37815, lcorr: 37118, total: 40117, uas: 94.26%, las: 92.52%, ucm: 50.94%, lcm: 39.71% (epoch: 20) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 20) best test W. Punct: ucorr: 53610, lcorr: 52741, total: 56684, uas: 94.58%, las: 93.04%, ucm: 50.91%, lcm: 41.89% (epoch: 20) best test Wo Punct: ucorr: 53610, lcorr: 52741, total: 56684, uas: 94.58%, las: 93.04%, ucm: 50.91%, lcm: 41.89% (epoch: 20) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 20) Epoch 22 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37835, lcorr: 37170, total: 40117, uas: 94.31%, las: 92.65%, ucm: 52.24%, lcm: 41.12% (epoch: 22) best dev Wo Punct: ucorr: 37835, lcorr: 37170, total: 40117, uas: 94.31%, las: 92.65%, ucm: 52.24%, lcm: 41.12% (epoch: 22) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 22) best test W. Punct: ucorr: 53653, lcorr: 52808, total: 56684, uas: 94.65%, las: 93.16%, ucm: 51.99%, lcm: 43.17% (epoch: 22) best test Wo Punct: ucorr: 53653, lcorr: 52808, total: 56684, uas: 94.65%, las: 93.16%, ucm: 51.99%, lcm: 43.17% (epoch: 22) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 22) Epoch 23 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37835, lcorr: 37170, total: 40117, uas: 94.31%, las: 92.65%, ucm: 52.24%, lcm: 41.12% (epoch: 22) best dev Wo Punct: ucorr: 37835, lcorr: 37170, total: 40117, uas: 94.31%, las: 92.65%, ucm: 52.24%, lcm: 41.12% (epoch: 22) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 22) best test W. Punct: ucorr: 53653, lcorr: 52808, total: 56684, uas: 94.65%, las: 93.16%, ucm: 51.99%, lcm: 43.17% (epoch: 22) best test Wo Punct: ucorr: 53653, lcorr: 52808, total: 56684, uas: 94.65%, las: 93.16%, ucm: 51.99%, lcm: 43.17% (epoch: 22) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 22) Epoch 24 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37835, lcorr: 37170, total: 40117, uas: 94.31%, las: 92.65%, ucm: 52.24%, lcm: 41.12% (epoch: 22) best dev Wo Punct: ucorr: 37835, lcorr: 37170, total: 40117, uas: 94.31%, las: 92.65%, ucm: 52.24%, lcm: 41.12% (epoch: 22) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 22) best test W. Punct: ucorr: 53653, lcorr: 52808, total: 56684, uas: 94.65%, las: 93.16%, ucm: 51.99%, lcm: 43.17% (epoch: 22) best test Wo Punct: ucorr: 53653, lcorr: 52808, total: 56684, uas: 94.65%, las: 93.16%, ucm: 51.99%, lcm: 43.17% (epoch: 22) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 22) Epoch 25 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 37871, lcorr: 37170, total: 40117, uas: 94.40%, las: 92.65%, ucm: 53.12%, lcm: 40.76% (epoch: 25) best dev Wo Punct: ucorr: 37871, lcorr: 37170, total: 40117, uas: 94.40%, las: 92.65%, ucm: 53.12%, lcm: 40.76% (epoch: 25) best dev Root: corr: 1670, total: 1700, acc: 98.24% (epoch: 25) best test W. Punct: ucorr: 53677, lcorr: 52804, total: 56684, uas: 94.70%, las: 93.16%, ucm: 52.44%, lcm: 42.96% (epoch: 25) best test Wo Punct: ucorr: 53677, lcorr: 52804, total: 56684, uas: 94.70%, las: 93.16%, ucm: 52.44%, lcm: 42.96% (epoch: 25) best test Root: corr: 2367, total: 2416, acc: 97.97% (epoch: 25) Epoch 26 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37869, lcorr: 37195, total: 40117, uas: 94.40%, las: 92.72%, ucm: 52.24%, lcm: 41.06% (epoch: 26) best dev Wo Punct: ucorr: 37869, lcorr: 37195, total: 40117, uas: 94.40%, las: 92.72%, ucm: 52.24%, lcm: 41.06% (epoch: 26) best dev Root: corr: 1662, total: 1700, acc: 97.76% (epoch: 26) best test W. Punct: ucorr: 53708, lcorr: 52873, total: 56684, uas: 94.75%, las: 93.28%, ucm: 52.73%, lcm: 43.29% (epoch: 26) best test Wo Punct: ucorr: 53708, lcorr: 52873, total: 56684, uas: 94.75%, las: 93.28%, ucm: 52.73%, lcm: 43.29% (epoch: 26) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 26) Epoch 27 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37924, lcorr: 37260, total: 40117, uas: 94.53%, las: 92.88%, ucm: 52.94%, lcm: 41.76% (epoch: 27) best dev Wo Punct: ucorr: 37924, lcorr: 37260, total: 40117, uas: 94.53%, las: 92.88%, ucm: 52.94%, lcm: 41.76% (epoch: 27) best dev Root: corr: 1670, total: 1700, acc: 98.24% (epoch: 27) best test W. Punct: ucorr: 53794, lcorr: 52943, total: 56684, uas: 94.90%, las: 93.40%, ucm: 53.97%, lcm: 44.45% (epoch: 27) best test Wo Punct: ucorr: 53794, lcorr: 52943, total: 56684, uas: 94.90%, las: 93.40%, ucm: 53.97%, lcm: 44.45% (epoch: 27) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 27) Epoch 28 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37924, lcorr: 37260, total: 40117, uas: 94.53%, las: 92.88%, ucm: 52.94%, lcm: 41.76% (epoch: 27) best dev Wo Punct: ucorr: 37924, lcorr: 37260, total: 40117, uas: 94.53%, las: 92.88%, ucm: 52.94%, lcm: 41.76% (epoch: 27) best dev Root: corr: 1670, total: 1700, acc: 98.24% (epoch: 27) best test W. Punct: ucorr: 53794, lcorr: 52943, total: 56684, uas: 94.90%, las: 93.40%, ucm: 53.97%, lcm: 44.45% (epoch: 27) best test Wo Punct: ucorr: 53794, lcorr: 52943, total: 56684, uas: 94.90%, las: 93.40%, ucm: 53.97%, lcm: 44.45% (epoch: 27) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 27) Epoch 29 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37911, lcorr: 37267, total: 40117, uas: 94.50%, las: 92.90%, ucm: 52.94%, lcm: 41.71% (epoch: 29) best dev Wo Punct: ucorr: 37911, lcorr: 37267, total: 40117, uas: 94.50%, las: 92.90%, ucm: 52.94%, lcm: 41.71% (epoch: 29) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 29) best test W. Punct: ucorr: 53825, lcorr: 52960, total: 56684, uas: 94.96%, las: 93.43%, ucm: 52.73%, lcm: 43.29% (epoch: 29) best test Wo Punct: ucorr: 53825, lcorr: 52960, total: 56684, uas: 94.96%, las: 93.43%, ucm: 52.73%, lcm: 43.29% (epoch: 29) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 29) Epoch 30 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37911, lcorr: 37267, total: 40117, uas: 94.50%, las: 92.90%, ucm: 52.94%, lcm: 41.71% (epoch: 29) best dev Wo Punct: ucorr: 37911, lcorr: 37267, total: 40117, uas: 94.50%, las: 92.90%, ucm: 52.94%, lcm: 41.71% (epoch: 29) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 29) best test W. Punct: ucorr: 53825, lcorr: 52960, total: 56684, uas: 94.96%, las: 93.43%, ucm: 52.73%, lcm: 43.29% (epoch: 29) best test Wo Punct: ucorr: 53825, lcorr: 52960, total: 56684, uas: 94.96%, las: 93.43%, ucm: 52.73%, lcm: 43.29% (epoch: 29) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 29) Epoch 31 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37911, lcorr: 37267, total: 40117, uas: 94.50%, las: 92.90%, ucm: 52.94%, lcm: 41.71% (epoch: 29) best dev Wo Punct: ucorr: 37911, lcorr: 37267, total: 40117, uas: 94.50%, las: 92.90%, ucm: 52.94%, lcm: 41.71% (epoch: 29) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 29) best test W. Punct: ucorr: 53825, lcorr: 52960, total: 56684, uas: 94.96%, las: 93.43%, ucm: 52.73%, lcm: 43.29% (epoch: 29) best test Wo Punct: ucorr: 53825, lcorr: 52960, total: 56684, uas: 94.96%, las: 93.43%, ucm: 52.73%, lcm: 43.29% (epoch: 29) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 29) Epoch 32 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 37920, lcorr: 37267, total: 40117, uas: 94.52%, las: 92.90%, ucm: 53.53%, lcm: 42.06% (epoch: 32) best dev Wo Punct: ucorr: 37920, lcorr: 37267, total: 40117, uas: 94.52%, las: 92.90%, ucm: 53.53%, lcm: 42.06% (epoch: 32) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 32) best test W. Punct: ucorr: 53780, lcorr: 52946, total: 56684, uas: 94.88%, las: 93.41%, ucm: 53.27%, lcm: 43.67% (epoch: 32) best test Wo Punct: ucorr: 53780, lcorr: 52946, total: 56684, uas: 94.88%, las: 93.41%, ucm: 53.27%, lcm: 43.67% (epoch: 32) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 32) Epoch 33 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37920, lcorr: 37267, total: 40117, uas: 94.52%, las: 92.90%, ucm: 53.53%, lcm: 42.06% (epoch: 32) best dev Wo Punct: ucorr: 37920, lcorr: 37267, total: 40117, uas: 94.52%, las: 92.90%, ucm: 53.53%, lcm: 42.06% (epoch: 32) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 32) best test W. Punct: ucorr: 53780, lcorr: 52946, total: 56684, uas: 94.88%, las: 93.41%, ucm: 53.27%, lcm: 43.67% (epoch: 32) best test Wo Punct: ucorr: 53780, lcorr: 52946, total: 56684, uas: 94.88%, las: 93.41%, ucm: 53.27%, lcm: 43.67% (epoch: 32) best test Root: corr: 2370, total: 2416, acc: 98.10% (epoch: 32) Epoch 34 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37944, lcorr: 37289, total: 40117, uas: 94.58%, las: 92.95%, ucm: 53.35%, lcm: 42.47% (epoch: 34) best dev Wo Punct: ucorr: 37944, lcorr: 37289, total: 40117, uas: 94.58%, las: 92.95%, ucm: 53.35%, lcm: 42.47% (epoch: 34) best dev Root: corr: 1671, total: 1700, acc: 98.29% (epoch: 34) best test W. Punct: ucorr: 53798, lcorr: 52944, total: 56684, uas: 94.91%, las: 93.40%, ucm: 53.27%, lcm: 44.12% (epoch: 34) best test Wo Punct: ucorr: 53798, lcorr: 52944, total: 56684, uas: 94.91%, las: 93.40%, ucm: 53.27%, lcm: 44.12% (epoch: 34) best test Root: corr: 2367, total: 2416, acc: 97.97% (epoch: 34) Epoch 35 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37944, lcorr: 37289, total: 40117, uas: 94.58%, las: 92.95%, ucm: 53.35%, lcm: 42.47% (epoch: 34) best dev Wo Punct: ucorr: 37944, lcorr: 37289, total: 40117, uas: 94.58%, las: 92.95%, ucm: 53.35%, lcm: 42.47% (epoch: 34) best dev Root: corr: 1671, total: 1700, acc: 98.29% (epoch: 34) best test W. Punct: ucorr: 53798, lcorr: 52944, total: 56684, uas: 94.91%, las: 93.40%, ucm: 53.27%, lcm: 44.12% (epoch: 34) best test Wo Punct: ucorr: 53798, lcorr: 52944, total: 56684, uas: 94.91%, las: 93.40%, ucm: 53.27%, lcm: 44.12% (epoch: 34) best test Root: corr: 2367, total: 2416, acc: 97.97% (epoch: 34) Epoch 36 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 37935, lcorr: 37290, total: 40117, uas: 94.56%, las: 92.95%, ucm: 53.18%, lcm: 42.18% (epoch: 36) best dev Wo Punct: ucorr: 37935, lcorr: 37290, total: 40117, uas: 94.56%, las: 92.95%, ucm: 53.18%, lcm: 42.18% (epoch: 36) best dev Root: corr: 1663, total: 1700, acc: 97.82% (epoch: 36) best test W. Punct: ucorr: 53779, lcorr: 52971, total: 56684, uas: 94.88%, las: 93.45%, ucm: 53.39%, lcm: 44.74% (epoch: 36) best test Wo Punct: ucorr: 53779, lcorr: 52971, total: 56684, uas: 94.88%, las: 93.45%, ucm: 53.39%, lcm: 44.74% (epoch: 36) best test Root: corr: 2360, total: 2416, acc: 97.68% (epoch: 36) Epoch 37 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 37980, lcorr: 37325, total: 40117, uas: 94.67%, las: 93.04%, ucm: 54.12%, lcm: 42.53% (epoch: 37) best dev Wo Punct: ucorr: 37980, lcorr: 37325, total: 40117, uas: 94.67%, las: 93.04%, ucm: 54.12%, lcm: 42.53% (epoch: 37) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 37) best test W. Punct: ucorr: 53859, lcorr: 53027, total: 56684, uas: 95.02%, las: 93.55%, ucm: 53.35%, lcm: 44.04% (epoch: 37) best test Wo Punct: ucorr: 53859, lcorr: 53027, total: 56684, uas: 95.02%, las: 93.55%, ucm: 53.35%, lcm: 44.04% (epoch: 37) best test Root: corr: 2369, total: 2416, acc: 98.05% (epoch: 37) Epoch 38 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 39 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 40 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 41 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 42 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 43 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 44 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=5, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 45 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=6, decay=0)): best dev W. Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Wo Punct: ucorr: 38012, lcorr: 37349, total: 40117, uas: 94.75%, las: 93.10%, ucm: 54.71%, lcm: 43.00% (epoch: 38) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 38) best test W. Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Wo Punct: ucorr: 53871, lcorr: 53044, total: 56684, uas: 95.04%, las: 93.58%, ucm: 53.97%, lcm: 44.33% (epoch: 38) best test Root: corr: 2368, total: 2416, acc: 98.01% (epoch: 38) Epoch 46 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=7, decay=0)): best dev W. Punct: ucorr: 38002, lcorr: 37355, total: 40117, uas: 94.73%, las: 93.12%, ucm: 54.47%, lcm: 43.29% (epoch: 46) best dev Wo Punct: ucorr: 38002, lcorr: 37355, total: 40117, uas: 94.73%, las: 93.12%, ucm: 54.47%, lcm: 43.29% (epoch: 46) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 46) best test W. Punct: ucorr: 53913, lcorr: 53110, total: 56684, uas: 95.11%, las: 93.69%, ucm: 54.84%, lcm: 45.16% (epoch: 46) best test Wo Punct: ucorr: 53913, lcorr: 53110, total: 56684, uas: 95.11%, las: 93.69%, ucm: 54.84%, lcm: 45.16% (epoch: 46) best test Root: corr: 2371, total: 2416, acc: 98.14% (epoch: 46) Epoch 47 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38002, lcorr: 37355, total: 40117, uas: 94.73%, las: 93.12%, ucm: 54.47%, lcm: 43.29% (epoch: 46) best dev Wo Punct: ucorr: 38002, lcorr: 37355, total: 40117, uas: 94.73%, las: 93.12%, ucm: 54.47%, lcm: 43.29% (epoch: 46) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 46) best test W. Punct: ucorr: 53913, lcorr: 53110, total: 56684, uas: 95.11%, las: 93.69%, ucm: 54.84%, lcm: 45.16% (epoch: 46) best test Wo Punct: ucorr: 53913, lcorr: 53110, total: 56684, uas: 95.11%, las: 93.69%, ucm: 54.84%, lcm: 45.16% (epoch: 46) best test Root: corr: 2371, total: 2416, acc: 98.14% (epoch: 46) Epoch 48 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 38002, lcorr: 37355, total: 40117, uas: 94.73%, las: 93.12%, ucm: 54.47%, lcm: 43.29% (epoch: 46) best dev Wo Punct: ucorr: 38002, lcorr: 37355, total: 40117, uas: 94.73%, las: 93.12%, ucm: 54.47%, lcm: 43.29% (epoch: 46) best dev Root: corr: 1665, total: 1700, acc: 97.94% (epoch: 46) best test W. Punct: ucorr: 53913, lcorr: 53110, total: 56684, uas: 95.11%, las: 93.69%, ucm: 54.84%, lcm: 45.16% (epoch: 46) best test Wo Punct: ucorr: 53913, lcorr: 53110, total: 56684, uas: 95.11%, las: 93.69%, ucm: 54.84%, lcm: 45.16% (epoch: 46) best test Root: corr: 2371, total: 2416, acc: 98.14% (epoch: 46) Epoch 49 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 38054, lcorr: 37387, total: 40117, uas: 94.86%, las: 93.19%, ucm: 55.88%, lcm: 43.65% (epoch: 49) best dev Wo Punct: ucorr: 38054, lcorr: 37387, total: 40117, uas: 94.86%, las: 93.19%, ucm: 55.88%, lcm: 43.65% (epoch: 49) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 49) best test W. Punct: ucorr: 53937, lcorr: 53106, total: 56684, uas: 95.15%, las: 93.69%, ucm: 54.39%, lcm: 44.87% (epoch: 49) best test Wo Punct: ucorr: 53937, lcorr: 53106, total: 56684, uas: 95.15%, las: 93.69%, ucm: 54.39%, lcm: 44.87% (epoch: 49) best test Root: corr: 2366, total: 2416, acc: 97.93% (epoch: 49) Epoch 50 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38054, lcorr: 37387, total: 40117, uas: 94.86%, las: 93.19%, ucm: 55.88%, lcm: 43.65% (epoch: 49) best dev Wo Punct: ucorr: 38054, lcorr: 37387, total: 40117, uas: 94.86%, las: 93.19%, ucm: 55.88%, lcm: 43.65% (epoch: 49) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 49) best test W. Punct: ucorr: 53937, lcorr: 53106, total: 56684, uas: 95.15%, las: 93.69%, ucm: 54.39%, lcm: 44.87% (epoch: 49) best test Wo Punct: ucorr: 53937, lcorr: 53106, total: 56684, uas: 95.15%, las: 93.69%, ucm: 54.39%, lcm: 44.87% (epoch: 49) best test Root: corr: 2366, total: 2416, acc: 97.93% (epoch: 49) Epoch 51 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 38054, lcorr: 37387, total: 40117, uas: 94.86%, las: 93.19%, ucm: 55.88%, lcm: 43.65% (epoch: 49) best dev Wo Punct: ucorr: 38054, lcorr: 37387, total: 40117, uas: 94.86%, las: 93.19%, ucm: 55.88%, lcm: 43.65% (epoch: 49) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 49) best test W. Punct: ucorr: 53937, lcorr: 53106, total: 56684, uas: 95.15%, las: 93.69%, ucm: 54.39%, lcm: 44.87% (epoch: 49) best test Wo Punct: ucorr: 53937, lcorr: 53106, total: 56684, uas: 95.15%, las: 93.69%, ucm: 54.39%, lcm: 44.87% (epoch: 49) best test Root: corr: 2366, total: 2416, acc: 97.93% (epoch: 49) Epoch 52 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 38041, lcorr: 37393, total: 40117, uas: 94.83%, las: 93.21%, ucm: 55.12%, lcm: 43.24% (epoch: 52) best dev Wo Punct: ucorr: 38041, lcorr: 37393, total: 40117, uas: 94.83%, las: 93.21%, ucm: 55.12%, lcm: 43.24% (epoch: 52) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 52) best test W. Punct: ucorr: 53935, lcorr: 53117, total: 56684, uas: 95.15%, las: 93.71%, ucm: 55.26%, lcm: 46.56% (epoch: 52) best test Wo Punct: ucorr: 53935, lcorr: 53117, total: 56684, uas: 95.15%, las: 93.71%, ucm: 55.26%, lcm: 46.56% (epoch: 52) best test Root: corr: 2371, total: 2416, acc: 98.14% (epoch: 52) Epoch 53 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38041, lcorr: 37393, total: 40117, uas: 94.83%, las: 93.21%, ucm: 55.12%, lcm: 43.24% (epoch: 52) best dev Wo Punct: ucorr: 38041, lcorr: 37393, total: 40117, uas: 94.83%, las: 93.21%, ucm: 55.12%, lcm: 43.24% (epoch: 52) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 52) best test W. Punct: ucorr: 53935, lcorr: 53117, total: 56684, uas: 95.15%, las: 93.71%, ucm: 55.26%, lcm: 46.56% (epoch: 52) best test Wo Punct: ucorr: 53935, lcorr: 53117, total: 56684, uas: 95.15%, las: 93.71%, ucm: 55.26%, lcm: 46.56% (epoch: 52) best test Root: corr: 2371, total: 2416, acc: 98.14% (epoch: 52) Epoch 54 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 38034, lcorr: 37408, total: 40117, uas: 94.81%, las: 93.25%, ucm: 55.06%, lcm: 43.82% (epoch: 54) best dev Wo Punct: ucorr: 38034, lcorr: 37408, total: 40117, uas: 94.81%, las: 93.25%, ucm: 55.06%, lcm: 43.82% (epoch: 54) best dev Root: corr: 1663, total: 1700, acc: 97.82% (epoch: 54) best test W. Punct: ucorr: 53903, lcorr: 53102, total: 56684, uas: 95.09%, las: 93.68%, ucm: 55.05%, lcm: 46.03% (epoch: 54) best test Wo Punct: ucorr: 53903, lcorr: 53102, total: 56684, uas: 95.09%, las: 93.68%, ucm: 55.05%, lcm: 46.03% (epoch: 54) best test Root: corr: 2364, total: 2416, acc: 97.85% (epoch: 54) Epoch 55 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38034, lcorr: 37408, total: 40117, uas: 94.81%, las: 93.25%, ucm: 55.06%, lcm: 43.82% (epoch: 54) best dev Wo Punct: ucorr: 38034, lcorr: 37408, total: 40117, uas: 94.81%, las: 93.25%, ucm: 55.06%, lcm: 43.82% (epoch: 54) best dev Root: corr: 1663, total: 1700, acc: 97.82% (epoch: 54) best test W. Punct: ucorr: 53903, lcorr: 53102, total: 56684, uas: 95.09%, las: 93.68%, ucm: 55.05%, lcm: 46.03% (epoch: 54) best test Wo Punct: ucorr: 53903, lcorr: 53102, total: 56684, uas: 95.09%, las: 93.68%, ucm: 55.05%, lcm: 46.03% (epoch: 54) best test Root: corr: 2364, total: 2416, acc: 97.85% (epoch: 54) Epoch 56 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 38034, lcorr: 37408, total: 40117, uas: 94.81%, las: 93.25%, ucm: 55.06%, lcm: 43.82% (epoch: 54) best dev Wo Punct: ucorr: 38034, lcorr: 37408, total: 40117, uas: 94.81%, las: 93.25%, ucm: 55.06%, lcm: 43.82% (epoch: 54) best dev Root: corr: 1663, total: 1700, acc: 97.82% (epoch: 54) best test W. Punct: ucorr: 53903, lcorr: 53102, total: 56684, uas: 95.09%, las: 93.68%, ucm: 55.05%, lcm: 46.03% (epoch: 54) best test Wo Punct: ucorr: 53903, lcorr: 53102, total: 56684, uas: 95.09%, las: 93.68%, ucm: 55.05%, lcm: 46.03% (epoch: 54) best test Root: corr: 2364, total: 2416, acc: 97.85% (epoch: 54) Epoch 57 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 38062, lcorr: 37416, total: 40117, uas: 94.88%, las: 93.27%, ucm: 55.65%, lcm: 43.65% (epoch: 57) best dev Wo Punct: ucorr: 38062, lcorr: 37416, total: 40117, uas: 94.88%, las: 93.27%, ucm: 55.65%, lcm: 43.65% (epoch: 57) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 57) best test W. Punct: ucorr: 53973, lcorr: 53160, total: 56684, uas: 95.22%, las: 93.78%, ucm: 55.59%, lcm: 46.19% (epoch: 57) best test Wo Punct: ucorr: 53973, lcorr: 53160, total: 56684, uas: 95.22%, las: 93.78%, ucm: 55.59%, lcm: 46.19% (epoch: 57) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 57) Epoch 58 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38062, lcorr: 37416, total: 40117, uas: 94.88%, las: 93.27%, ucm: 55.65%, lcm: 43.65% (epoch: 57) best dev Wo Punct: ucorr: 38062, lcorr: 37416, total: 40117, uas: 94.88%, las: 93.27%, ucm: 55.65%, lcm: 43.65% (epoch: 57) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 57) best test W. Punct: ucorr: 53973, lcorr: 53160, total: 56684, uas: 95.22%, las: 93.78%, ucm: 55.59%, lcm: 46.19% (epoch: 57) best test Wo Punct: ucorr: 53973, lcorr: 53160, total: 56684, uas: 95.22%, las: 93.78%, ucm: 55.59%, lcm: 46.19% (epoch: 57) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 57) Epoch 59 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 38062, lcorr: 37416, total: 40117, uas: 94.88%, las: 93.27%, ucm: 55.65%, lcm: 43.65% (epoch: 57) best dev Wo Punct: ucorr: 38062, lcorr: 37416, total: 40117, uas: 94.88%, las: 93.27%, ucm: 55.65%, lcm: 43.65% (epoch: 57) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 57) best test W. Punct: ucorr: 53973, lcorr: 53160, total: 56684, uas: 95.22%, las: 93.78%, ucm: 55.59%, lcm: 46.19% (epoch: 57) best test Wo Punct: ucorr: 53973, lcorr: 53160, total: 56684, uas: 95.22%, las: 93.78%, ucm: 55.59%, lcm: 46.19% (epoch: 57) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 57) Epoch 60 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 61 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 62 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 63 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 64 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 65 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 66 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=5, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 67 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=6, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 68 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=7, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 69 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=8, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 70 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=9, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 71 (FastLSTM, optim: adam, learning rate=0.001000, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=10, decay=0)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 72 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=1)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 73 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=1)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 74 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=1)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 75 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=1)): best dev W. Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Wo Punct: ucorr: 38103, lcorr: 37464, total: 40117, uas: 94.98%, las: 93.39%, ucm: 55.29%, lcm: 43.59% (epoch: 60) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 60) best test W. Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Wo Punct: ucorr: 53965, lcorr: 53157, total: 56684, uas: 95.20%, las: 93.78%, ucm: 55.01%, lcm: 45.45% (epoch: 60) best test Root: corr: 2374, total: 2416, acc: 98.26% (epoch: 60) Epoch 76 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 77 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 78 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 79 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 80 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 81 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 82 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=5, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 83 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=6, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 84 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=7, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 85 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=8, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 86 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=9, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 87 (FastLSTM, optim: adam, learning rate=0.000750, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=10, decay=1)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 88 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=2)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 89 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=2)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 90 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=2)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 91 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=2)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 92 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=2)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 93 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=5, decay=2)): best dev W. Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Wo Punct: ucorr: 38119, lcorr: 37488, total: 40117, uas: 95.02%, las: 93.45%, ucm: 56.12%, lcm: 44.65% (epoch: 76) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 76) best test W. Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Wo Punct: ucorr: 54055, lcorr: 53229, total: 56684, uas: 95.36%, las: 93.90%, ucm: 55.88%, lcm: 45.78% (epoch: 76) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 76) Epoch 94 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=6, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 95 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 96 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 97 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 98 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 99 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 100 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=5, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 101 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=6, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 102 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=7, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 103 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=8, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 104 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=9, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 105 (FastLSTM, optim: adam, learning rate=0.000563, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=10, decay=2)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 106 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 107 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 108 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 109 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 110 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 111 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=5, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 112 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=6, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 113 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=7, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 114 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=8, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 115 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=9, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 116 (FastLSTM, optim: adam, learning rate=0.000422, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=10, decay=3)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 117 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=0, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 118 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=1, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 119 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=2, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 120 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=3, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 121 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=4, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 122 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=5, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 123 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=6, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 124 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=7, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 125 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=8, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 126 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=9, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 127 (FastLSTM, optim: adam, learning rate=0.000316, eps=1.0e-04, decay rate=0.75 (schedule=10, patient=10, decay=4)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 128 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=0, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 129 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=1, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 130 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=2, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 131 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=3, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 132 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=4, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 133 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=5, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 134 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=6, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 135 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=7, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 136 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=8, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 137 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=9, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 138 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=10, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 139 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=11, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 140 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=12, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 141 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=13, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 142 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=14, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 143 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=15, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 144 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=16, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 145 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=17, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 146 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=18, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 147 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=19, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 148 (FastLSTM, optim: adam, learning rate=0.000237, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=20, decay=5)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 149 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=0, decay=6)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 150 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=1, decay=6)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 151 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=2, decay=6)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 152 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=3, decay=6)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 153 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=4, decay=6)): best dev W. Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Wo Punct: ucorr: 38158, lcorr: 37532, total: 40117, uas: 95.12%, las: 93.56%, ucm: 57.59%, lcm: 45.71% (epoch: 94) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 94) best test W. Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Wo Punct: ucorr: 54042, lcorr: 53239, total: 56684, uas: 95.34%, las: 93.92%, ucm: 56.21%, lcm: 46.23% (epoch: 94) best test Root: corr: 2375, total: 2416, acc: 98.30% (epoch: 94) Epoch 154 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=5, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 155 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=0, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 156 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=1, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 157 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=2, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 158 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=3, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 159 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=4, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 160 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=5, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 161 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=6, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 162 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=7, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 163 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=8, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 164 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=9, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 165 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=10, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 166 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=11, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 167 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=12, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 168 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=13, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 169 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=14, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 170 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=15, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 171 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=16, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 172 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=17, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 173 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=18, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 174 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=19, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 175 (FastLSTM, optim: adam, learning rate=0.000178, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=20, decay=6)): best dev W. Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Wo Punct: ucorr: 38148, lcorr: 37537, total: 40117, uas: 95.09%, las: 93.57%, ucm: 56.71%, lcm: 45.00% (epoch: 154) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 154) best test W. Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Wo Punct: ucorr: 54069, lcorr: 53261, total: 56684, uas: 95.39%, las: 93.96%, ucm: 56.58%, lcm: 46.94% (epoch: 154) best test Root: corr: 2373, total: 2416, acc: 98.22% (epoch: 154) Epoch 176 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=0, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 177 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=0, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 178 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=1, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 179 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=2, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 180 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=3, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 181 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=4, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 182 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=5, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 183 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=6, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 184 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=7, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 185 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=8, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 186 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=9, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 187 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=10, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 188 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=11, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 189 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=12, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 190 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=13, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 191 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=14, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 192 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=15, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 193 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=16, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 194 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=17, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 195 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=18, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 196 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=19, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 197 (FastLSTM, optim: adam, learning rate=0.000133, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=20, decay=7)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 198 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=0, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 199 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=1, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 200 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=2, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 201 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=3, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 202 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=4, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 203 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=5, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 204 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=6, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 205 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=7, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 206 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=8, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 207 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=9, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 208 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=10, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 209 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=11, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 210 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=12, decay=8)): best dev W. Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Wo Punct: ucorr: 38159, lcorr: 37537, total: 40117, uas: 95.12%, las: 93.57%, ucm: 56.71%, lcm: 44.82% (epoch: 176) best dev Root: corr: 1667, total: 1700, acc: 98.06% (epoch: 176) best test W. Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Wo Punct: ucorr: 54069, lcorr: 53279, total: 56684, uas: 95.39%, las: 93.99%, ucm: 56.75%, lcm: 47.14% (epoch: 176) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 176) Epoch 211 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=13, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 212 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=0, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 213 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=1, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 214 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=2, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 215 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=3, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 216 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=4, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 217 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=5, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 218 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=6, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 219 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=7, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 220 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=8, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 221 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=9, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 222 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=10, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 223 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=11, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 224 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=12, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 225 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=13, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 226 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=14, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 227 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=15, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 228 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=16, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 229 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=17, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 230 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=18, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 231 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=19, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211) Epoch 232 (FastLSTM, optim: adam, learning rate=0.000100, eps=1.0e-04, decay rate=0.75 (schedule=20, patient=20, decay=8)): best dev W. Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Wo Punct: ucorr: 38168, lcorr: 37539, total: 40117, uas: 95.14%, las: 93.57%, ucm: 57.06%, lcm: 45.35% (epoch: 211) best dev Root: corr: 1666, total: 1700, acc: 98.00% (epoch: 211) best test W. Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Wo Punct: ucorr: 54063, lcorr: 53281, total: 56684, uas: 95.38%, las: 94.00%, ucm: 56.71%, lcm: 47.27% (epoch: 211) best test Root: corr: 2372, total: 2416, acc: 98.18% (epoch: 211)

XuezheMax commented 6 years ago

Oh, I found the reason. It seems that your punctuation set is not correct. See that the results w/w.o punctuation are exactly the same. I guess it is because you used a different pos tagger, which makes a different set of pos tags for punctuations. You can specify the punctuation by the --punctuation argument.

XuezheMax commented 6 years ago

The results reported in our and in Dozat's paper are the ones with punctuation excluded.

XuezheMax commented 6 years ago

For the StackPtr parser, make sure to set beam=5 to reproduce the scores in the paper. It is slow because the decoding procedure is auto-regressive.

ianupright commented 6 years ago

Thank-you very much for noticing that! It was a punctuation related issue on my end.