search

moraieu / query-selector

LONG-TERM SERIES FORECASTING WITH QUERYSELECTOR – EFFICIENT MODEL OF SPARSEATTENTION
Apache License 2.0
75 stars 18 forks source link

Dimension Mismatch #4

Closed bcjanmay closed 2 years ago

bcjanmay commented 2 years ago

Hello,

I am trying to reproduce the results for ETTh1 dataset.

When running the following file in Colab: !python -u train.py --data ETTh1 --input_len 240 --output_len 24 --seq_len 48 --dec_seq_len 48 --pred_len 24 --features S --iterations 10 --exps 5 --hidden_size 96 --n_heads 3 --n_encoder_layers 3 --encoder_attention full --n_decoder_layers 3 --decoder_attention full --batch_size 32 --embedding_size 24 --dropout 0.1

I run into the following error: File "train.py", line 189, in main() File "train.py", line 185, in main preform_experiment(args) File "train.py", line 155, in preform_experiment preds, trues = run_iteration(deepspeed_engine if args.deepspeed else model , train_loader, args, training=True, message=' Run {:>3}, iteration: {:>3}: '.format(args.run_num, iter)) File "train.py", line 109, in run_iteration result = model(batch) File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl result = self.forward(*input, *kwargs) File "/content/drive/MyDrive/Query/model.py", line 287, in forward e = self.encs0)) File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl result = self.forward(input, **kwargs) File "/content/drive/MyDrive/Query/model.py", line 239, in forward return super(Linear, self).forward(x) File "/usr/local/lib/python3.7/dist-packages/torch/nn/modules/linear.py", line 93, in forward return F.linear(input, self.weight, self.bias) File "/usr/local/lib/python3.7/dist-packages/torch/nn/functional.py", line 1692, in linear output = input.matmul(weight.t()) RuntimeError: mat1 dim 1 must match mat2 dim 0

Can you please help me resolve this issue?, thank you.

best wishes Janamejaya

j-klm commented 2 years ago

When using --features S and default target, arguments _inputlen and _outputlen should be set to 1.

bcjanmay commented 2 years ago

Thank you, I will try it.

bcjanmay commented 2 years ago

Hello,

I ran into one more error, can you please let me know the means to solve this?, thank you.

File "train.py", line 189, in main() File "train.py", line 185, in main preform_experiment(args) File "train.py", line 158, in preform_experiment ipc.sendPartials(iter, mse, mae) File "/content/drive/MyDrive/Query/ipc.py", line 61, in sendPartials c.connect(('localhost', PORT)) ConnectionRefusedError: [Errno 111] Connection refused

best wishes Janmay