search

dchang56 / gct-pytorch

Graph Convolutional Transformer implemented in pytorch
8 stars 1 forks source link

Its strange，eval_AUROC = 0.5， eval_AUROC always be 0.5 #1

Open ArtificialZeng opened 3 months ago

ArtificialZeng commented 3 months ago

lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use zero_division parameter to control this behavior. _warn_prf(average, modifier, msg_start, len(result)) 03/21/2024 18:03:19 - INFO - main - Checkpoint Eval Results 03/21/2024 18:03:19 - INFO - main - eval_loss = 1.265030026435852 03/21/2024 18:03:19 - INFO - main - eval_AUCPR = 0.5357142857142857 03/21/2024 18:03:19 - INFO - main - eval_AUROC = 0.5

Iteration: 100%|██████████| 7/7 [00:00<00:00, 31.52it/s]

Epoch: 62%|██████▏ | 4409/7143 [17:00<10:21, 4.40it/s]

Iteration: 0%| | 0/7 [00:00<?, ?it/s]

Evaluating: 0it [00:00, ?it/s] Evaluating: 1it [00:00, 126.64it/s] /home/zengzijian/anaconda3/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use zero_division parameter to control this behavior. _warn_prf(average, modifier, msg_start, len(result)) 03/21/2024 18:03:19 - INFO - main - Checkpoint Eval Results 03/21/2024 18:03:19 - INFO - main - eval_loss = 1.2649954557418823 03/21/2024 18:03:19 - INFO - main - eval_AUCPR = 0.5357142857142857 03/21/2024 18:03:19 - INFO - main - eval_AUROC = 0.5

ArtificialZeng commented 3 months ago

This is my script:

nohup python train.py --data_dir /home/zengzijian/working_dir/eicu-collaborative-research-database-demo-2.0.1 --output_dir /home/zengzijian/working_dir/gct_pytorch/gct-pytorch/data --fold 0 --do_train --do_eval --do_test --num_train_epochs 10 --max_steps 50000 --logging_steps 200 --learning_rate 0.0005 > train_0321_ran42.log 2>&1 &