search

castorini / hedwig

PyTorch deep learning models for document classification
Apache License 2.0
590 stars 125 forks source link

Killed message on trying models.reg_lstm #70

Open bikashg opened 3 years ago

bikashg commented 3 years ago

On executing this command:

python -m models.reg_lstm --dataset Reuters --mode static --batch-size 32 --lr 0.01 --epochs 30 --bidirectional --num-layers 1 --hidden-dim 512 --wdrop 0.1 --embed-droprate 0.2 --dropout 0.5 --beta-ema 0.99 --seed 3435,

I get the following response:

  0%|         | 0/3000001 [00:00<?, ?it/s]Skipping token 3000000 with 1-dimensional vector ['300']; likely a header
100%██████████████████| 3000001/3000001 [03:33<00:00, 14061.26it/s]
Killed

The process seems to have completed (shows 100%) but there is a Killed message at the end.

achyudh commented 3 years ago

I've seen this happen in cases where there isn't enough system memory. Can you please check if that's the issue by monitoring memory usage?