search

uclnlp / jack

Jack the Reader
MIT License
257 stars 82 forks source link

Check KBP models #362

Closed pminervini closed 6 years ago

pminervini commented 6 years ago

DistMult is not really training:

$ python3 ./bin/jack-train.py with config=conf/lp/distmult.yaml 
[..]
INFO - jack.core.reader - Preparing training data...
INFO - jack.core.input_module - OnlineInputModule pre-processes data on-the-fly in first epoch and caches results for subsequent epochs! That means, first epoch might be slower.
INFO - jack.core.reader - Number of parameters: 8192400
INFO - jack.core.reader - Start training...
INFO - jack.util.hooks - Epoch 1    Iter 100    train loss 0.6931478554010391
INFO - jack.util.hooks - Epoch 1    Iter 100    ETA: 03:51:09, 18-03-13 15:42:51 (0.02%)    ETA(epoch): 00:02:15 (2.26%)
INFO - jack.util.hooks - Epoch 1    Iter 100    Examples/s 3331.16
INFO - jack.util.hooks - Epoch 1    Iter 200    train loss 0.693147538304329
INFO - jack.util.hooks - Epoch 1    Iter 200    ETA: 02:33:24, 18-03-13 14:25:06 (0.05%)    ETA(epoch): 00:01:27 (4.52%)
INFO - jack.util.hooks - Epoch 1    Iter 200    Examples/s 3113.81
INFO - jack.util.hooks - Epoch 1    Iter 300    train loss 0.6931469184160233
INFO - jack.util.hooks - Epoch 1    Iter 300    ETA: 02:05:57, 18-03-13 13:57:40 (0.07%)    ETA(epoch): 00:01:10 (6.79%)
INFO - jack.util.hooks - Epoch 1    Iter 300    Examples/s 3313.12
INFO - jack.util.hooks - Epoch 1    Iter 400    train loss 0.6931471478939056
INFO - jack.util.hooks - Epoch 1    Iter 400    ETA: 01:51:43, 18-03-13 13:43:28 (0.09%)    ETA(epoch): 00:01:01 (9.05%)
INFO - jack.util.hooks - Epoch 1    Iter 400    Examples/s 3407.57
INFO - jack.util.hooks - Epoch 1    Iter 500    train loss 0.6931466555595398
INFO - jack.util.hooks - Epoch 1    Iter 500    ETA: 01:43:06, 18-03-13 13:34:51 (0.11%)    ETA(epoch): 00:00:54 (11.31%)
INFO - jack.util.hooks - Epoch 1    Iter 500    Examples/s 3427.17
INFO - jack.util.hooks - Epoch 1    Iter 600    train loss 0.6931470322608948
INFO - jack.util.hooks - Epoch 1    Iter 600    ETA: 01:37:22, 18-03-13 13:29:09 (0.14%)    ETA(epoch): 00:00:50 (13.57%)
INFO - jack.util.hooks - Epoch 1    Iter 600    Examples/s 3419.35
INFO - jack.util.hooks - Epoch 1    Iter 700    train loss 0.6931466782093048
INFO - jack.util.hooks - Epoch 1    Iter 700    ETA: 01:33:03, 18-03-13 13:24:50 (0.16%)    ETA(epoch): 00:00:47 (15.83%)
INFO - jack.util.hooks - Epoch 1    Iter 700    Examples/s 3501.43
INFO - jack.util.hooks - Epoch 1    Iter 800    train loss 0.693147474527359
INFO - jack.util.hooks - Epoch 1    Iter 800    ETA: 01:30:34, 18-03-13 13:22:23 (0.18%)    ETA(epoch): 00:00:44 (18.10%)