search

tsujuifu / pytorch_empirical-mvm

A PyTorch implementation of EmpiricalMVM
39 stars 2 forks source link

Performance discrepancy on Didemo-retrieval #4

Closed nguyentthong closed 1 year ago

nguyentthong commented 1 year ago

Hi,

Thank you for your interesting work. I have downloaded your best pre-trained checkpoint here and fine-tuned the model on the DIDEMO-retrieval dataset.

However, the test scores I have obtained are 39.84/69.77/79.57, which shows a large discrepancy compared with the numbers in the README file and the paper (Table 9).

I have used the original configuration in the repo. Can I ask whether the aforementioned checkpoint is the checkpoint used in Table 9 of the paper, or whether there is any other issue?

Thank you so much. Regards, Thong

tsujuifu commented 1 year ago

You can first adopt the downstream ckpt to ensure the environment is correct. During training, increasing the batch_size can help improve text-to-video retrieval.

nguyentthong commented 1 year ago

Thank you for your response. Let me try increasing the batch size for the retrieval task.

I have one more question. Does the number of epochs have an important effect upon the performance? In addition to the DIDEMO-retrieval, I have also fine-tuned VIOLETv2 on MSVD-QA, MSRVTT-QA, and TGIF-Frame, and found out that the performances are approximately 1 point behind those in the paper (I managed to increase the batch size equal to the paper batch size but my epoch is double the paper epoch).

tsujuifu commented 1 year ago

I think the number of epochs is not that sensitive. Most downstream tasks should be done (the best) in 20 epochs (but not very sure since I did not preserve the log 😂).

nguyentthong commented 1 year ago

Hello @tsujuifu,

I have tried running the MSVD-QA experiment again. However, with all random seeds, batch sizes, and number of epochs, I could not achieve the paper performance 😂.

I would like to send you the arguments I have used for the best experiment, and the result log.

Arguments:

{
    "type": "qaoe",
    "data_dir": "_downstream",
    "dataset": "msvd",
    "task": "msvd-qa",
    "size_img": 224,
    "size_frame": 5,
    "size_txt": 25,
    "size_vocab": 1000,
    "size_test": 13157,
    "size_epoch": 20,
    "size_batch": 12,
    "lr": 2e-05,
    "decay": 0.001,
    "max_grad_norm": 1.0,
    "use_checkpoint": true,
    "deepspeed": true,
    "vis_backbone_init": "3d",
    "kinetics": 600,
    "vis_backbone": "vidswin",
    "vis_backbone_size": "base",
    "txt_backbone": "bert-base-uncased",
    "txt_backbone_embed_only": true,
    "fusion_encoder": "bert-base-uncased",
    "path_ckpt": "_pretrain/ckpt_pretrain_3d-init_webvid-cc_2d_rm-bm_0.3_ep10.pt"
}

Result log:

07/14/2023 07:23:38 - INFO - __main__ -   Saved training meta infomation...
07/14/2023 07:23:38 - INFO - __main__ -   Zero-shot Evaluation
07/14/2023 07:25:26 - INFO - __main__ -   ZS (val): 9.34, 16.43
07/14/2023 07:28:54 - INFO - __main__ -   ZS (test): 9.23, 17.49
07/14/2023 07:29:05 - INFO - __main__ -   Start training....
07/14/2023 07:29:07 - INFO - __main__ -   ep: 1, step: 1, lr_swin: 1.00e-08, lr_bert: 1.00e-08, max memory: 5.27 GB
07/14/2023 07:29:23 - INFO - __main__ -   ep: 1, step: 21, lr_swin: 3.21e-07, lr_bert: 3.21e-07, max memory: 33.04 GB
07/14/2023 07:29:38 - INFO - __main__ -   ep: 1, step: 41, lr_swin: 6.42e-07, lr_bert: 6.42e-07, max memory: 33.04 GB
07/14/2023 07:29:53 - INFO - __main__ -   ep: 1, step: 61, lr_swin: 9.63e-07, lr_bert: 9.63e-07, max memory: 33.04 GB
07/14/2023 07:30:08 - INFO - __main__ -   ep: 1, step: 81, lr_swin: 1.28e-06, lr_bert: 1.28e-06, max memory: 33.04 GB
07/14/2023 07:30:24 - INFO - __main__ -   ep: 1, step: 101, lr_swin: 1.61e-06, lr_bert: 1.61e-06, max memory: 33.04 GB
07/14/2023 07:30:39 - INFO - __main__ -   ep: 1, step: 121, lr_swin: 1.93e-06, lr_bert: 1.93e-06, max memory: 33.04 GB
07/14/2023 07:30:54 - INFO - __main__ -   ep: 1, step: 141, lr_swin: 2.25e-06, lr_bert: 2.25e-06, max memory: 33.04 GB
07/14/2023 07:31:10 - INFO - __main__ -   ep: 1, step: 161, lr_swin: 2.57e-06, lr_bert: 2.57e-06, max memory: 33.04 GB
07/14/2023 07:31:25 - INFO - __main__ -   ep: 1, step: 181, lr_swin: 2.89e-06, lr_bert: 2.89e-06, max memory: 33.04 GB
07/14/2023 07:31:40 - INFO - __main__ -   ep: 1, step: 201, lr_swin: 3.21e-06, lr_bert: 3.21e-06, max memory: 33.04 GB
07/14/2023 07:31:56 - INFO - __main__ -   ep: 1, step: 221, lr_swin: 3.53e-06, lr_bert: 3.53e-06, max memory: 33.04 GB
07/14/2023 07:32:11 - INFO - __main__ -   ep: 1, step: 241, lr_swin: 3.85e-06, lr_bert: 3.85e-06, max memory: 33.04 GB
07/14/2023 07:32:26 - INFO - __main__ -   ep: 1, step: 261, lr_swin: 4.17e-06, lr_bert: 4.17e-06, max memory: 33.04 GB
07/14/2023 07:32:41 - INFO - __main__ -   ep: 1, step: 281, lr_swin: 4.49e-06, lr_bert: 4.49e-06, max memory: 33.04 GB
07/14/2023 07:32:57 - INFO - __main__ -   ep: 1, step: 301, lr_swin: 4.82e-06, lr_bert: 4.82e-06, max memory: 33.04 GB
07/14/2023 07:33:12 - INFO - __main__ -   ep: 1, step: 321, lr_swin: 5.14e-06, lr_bert: 5.14e-06, max memory: 33.04 GB
07/14/2023 07:33:27 - INFO - __main__ -   ep: 1, step: 341, lr_swin: 5.46e-06, lr_bert: 5.46e-06, max memory: 33.04 GB
07/14/2023 07:33:43 - INFO - __main__ -   ep: 1, step: 361, lr_swin: 5.78e-06, lr_bert: 5.78e-06, max memory: 33.04 GB
07/14/2023 07:33:58 - INFO - __main__ -   ep: 1, step: 381, lr_swin: 6.10e-06, lr_bert: 6.10e-06, max memory: 33.04 GB
07/14/2023 07:34:13 - INFO - __main__ -   ep: 1, step: 401, lr_swin: 6.42e-06, lr_bert: 6.42e-06, max memory: 33.04 GB
07/14/2023 07:34:28 - INFO - __main__ -   ep: 1, step: 421, lr_swin: 6.74e-06, lr_bert: 6.74e-06, max memory: 33.04 GB
07/14/2023 07:34:44 - INFO - __main__ -   ep: 1, step: 441, lr_swin: 7.06e-06, lr_bert: 7.06e-06, max memory: 33.04 GB
07/14/2023 07:34:59 - INFO - __main__ -   ep: 1, step: 461, lr_swin: 7.38e-06, lr_bert: 7.38e-06, max memory: 33.04 GB
07/14/2023 07:35:14 - INFO - __main__ -   ep: 1, step: 481, lr_swin: 7.70e-06, lr_bert: 7.70e-06, max memory: 33.04 GB
07/14/2023 07:35:30 - INFO - __main__ -   ep: 1, step: 501, lr_swin: 8.03e-06, lr_bert: 8.03e-06, max memory: 33.04 GB
07/14/2023 07:35:45 - INFO - __main__ -   ep: 1, step: 521, lr_swin: 8.35e-06, lr_bert: 8.35e-06, max memory: 33.04 GB
07/14/2023 07:36:00 - INFO - __main__ -   ep: 1, step: 541, lr_swin: 8.67e-06, lr_bert: 8.67e-06, max memory: 33.04 GB
07/14/2023 07:36:16 - INFO - __main__ -   ep: 1, step: 561, lr_swin: 8.99e-06, lr_bert: 8.99e-06, max memory: 33.04 GB
07/14/2023 07:36:31 - INFO - __main__ -   ep: 1, step: 581, lr_swin: 9.31e-06, lr_bert: 9.31e-06, max memory: 33.04 GB
07/14/2023 07:36:46 - INFO - __main__ -   ep: 1, step: 601, lr_swin: 9.63e-06, lr_bert: 9.63e-06, max memory: 33.04 GB
07/14/2023 07:37:01 - INFO - __main__ -   ep: 1, step: 621, lr_swin: 9.95e-06, lr_bert: 9.95e-06, max memory: 33.04 GB
07/14/2023 07:37:17 - INFO - __main__ -   ep: 1, step: 641, lr_swin: 1.03e-05, lr_bert: 1.03e-05, max memory: 33.04 GB
07/14/2023 07:37:32 - INFO - __main__ -   ep: 1, step: 661, lr_swin: 1.06e-05, lr_bert: 1.06e-05, max memory: 33.04 GB
07/14/2023 07:37:47 - INFO - __main__ -   ep: 1, step: 681, lr_swin: 1.09e-05, lr_bert: 1.09e-05, max memory: 33.04 GB
07/14/2023 07:38:03 - INFO - __main__ -   ep: 1, step: 701, lr_swin: 1.12e-05, lr_bert: 1.12e-05, max memory: 33.04 GB
07/14/2023 07:38:18 - INFO - __main__ -   ep: 1, step: 721, lr_swin: 1.16e-05, lr_bert: 1.16e-05, max memory: 33.04 GB
07/14/2023 07:38:33 - INFO - __main__ -   ep: 1, step: 741, lr_swin: 1.19e-05, lr_bert: 1.19e-05, max memory: 33.04 GB
07/14/2023 07:38:48 - INFO - __main__ -   ep: 1, step: 761, lr_swin: 1.22e-05, lr_bert: 1.22e-05, max memory: 33.04 GB
07/14/2023 07:39:04 - INFO - __main__ -   ep: 1, step: 781, lr_swin: 1.25e-05, lr_bert: 1.25e-05, max memory: 33.04 GB
07/14/2023 07:39:19 - INFO - __main__ -   ep: 1, step: 801, lr_swin: 1.28e-05, lr_bert: 1.28e-05, max memory: 33.04 GB
07/14/2023 07:39:34 - INFO - __main__ -   ep: 1, step: 821, lr_swin: 1.32e-05, lr_bert: 1.32e-05, max memory: 33.04 GB
07/14/2023 07:39:50 - INFO - __main__ -   ep: 1, step: 841, lr_swin: 1.35e-05, lr_bert: 1.35e-05, max memory: 33.04 GB
07/14/2023 07:40:05 - INFO - __main__ -   ep: 1, step: 861, lr_swin: 1.38e-05, lr_bert: 1.38e-05, max memory: 33.04 GB
07/14/2023 07:40:20 - INFO - __main__ -   ep: 1, step: 881, lr_swin: 1.41e-05, lr_bert: 1.41e-05, max memory: 33.04 GB
07/14/2023 07:40:35 - INFO - __main__ -   ep: 1, step: 901, lr_swin: 1.44e-05, lr_bert: 1.44e-05, max memory: 33.04 GB
07/14/2023 07:40:51 - INFO - __main__ -   ep: 1, step: 921, lr_swin: 1.48e-05, lr_bert: 1.48e-05, max memory: 33.04 GB
07/14/2023 07:41:06 - INFO - __main__ -   ep: 1, step: 941, lr_swin: 1.51e-05, lr_bert: 1.51e-05, max memory: 33.04 GB
07/14/2023 07:41:21 - INFO - __main__ -   ep: 1, step: 961, lr_swin: 1.54e-05, lr_bert: 1.54e-05, max memory: 33.04 GB
07/14/2023 07:41:37 - INFO - __main__ -   ep: 1, step: 981, lr_swin: 1.57e-05, lr_bert: 1.57e-05, max memory: 33.04 GB
07/14/2023 07:41:52 - INFO - __main__ -   ep: 1, step: 1001, lr_swin: 1.61e-05, lr_bert: 1.61e-05, max memory: 33.04 GB
07/14/2023 07:42:07 - INFO - __main__ -   ep: 1, step: 1021, lr_swin: 1.64e-05, lr_bert: 1.64e-05, max memory: 33.04 GB
07/14/2023 07:42:22 - INFO - __main__ -   ep: 1, step: 1041, lr_swin: 1.67e-05, lr_bert: 1.67e-05, max memory: 33.04 GB
07/14/2023 07:42:38 - INFO - __main__ -   ep: 1, step: 1061, lr_swin: 1.70e-05, lr_bert: 1.70e-05, max memory: 33.04 GB
07/14/2023 07:42:53 - INFO - __main__ -   ep: 1, step: 1081, lr_swin: 1.73e-05, lr_bert: 1.73e-05, max memory: 33.04 GB
07/14/2023 07:43:08 - INFO - __main__ -   ep: 1, step: 1101, lr_swin: 1.77e-05, lr_bert: 1.77e-05, max memory: 33.04 GB
07/14/2023 07:43:23 - INFO - __main__ -   ep: 1, step: 1121, lr_swin: 1.80e-05, lr_bert: 1.80e-05, max memory: 33.04 GB
07/14/2023 07:43:39 - INFO - __main__ -   ep: 1, step: 1141, lr_swin: 1.83e-05, lr_bert: 1.83e-05, max memory: 33.04 GB
07/14/2023 07:43:54 - INFO - __main__ -   ep: 1, step: 1161, lr_swin: 1.86e-05, lr_bert: 1.86e-05, max memory: 33.04 GB
07/14/2023 07:44:09 - INFO - __main__ -   ep: 1, step: 1181, lr_swin: 1.89e-05, lr_bert: 1.89e-05, max memory: 33.04 GB
07/14/2023 07:44:25 - INFO - __main__ -   ep: 1, step: 1201, lr_swin: 1.93e-05, lr_bert: 1.93e-05, max memory: 33.04 GB
07/14/2023 07:44:40 - INFO - __main__ -   ep: 1, step: 1221, lr_swin: 1.96e-05, lr_bert: 1.96e-05, max memory: 33.04 GB
07/14/2023 07:44:55 - INFO - __main__ -   ep: 1, step: 1241, lr_swin: 1.99e-05, lr_bert: 1.99e-05, max memory: 33.04 GB
07/14/2023 07:44:59 - INFO - __main__ -   ep: 1, step: 1246, lr_swin: 2.00e-05, lr_bert: 2.00e-05, max memory: 33.04 GB
07/14/2023 07:44:59 - INFO - __main__ -   Ep 0, Loss (train): 2.1780e+02
07/14/2023 07:46:46 - INFO - __main__ -   Ep 0, Acc (val): 49.81, 71.24
07/14/2023 07:50:17 - INFO - __main__ -   Ep 0, Acc (test): 50.66, 73.26
07/14/2023 07:50:20 - INFO - __main__ -   ep: 2, step: 1, lr_swin: 2.00e-05, lr_bert: 2.00e-05, max memory: 33.04 GB
07/14/2023 07:50:35 - INFO - __main__ -   ep: 2, step: 21, lr_swin: 2.00e-05, lr_bert: 2.00e-05, max memory: 33.04 GB
07/14/2023 07:50:51 - INFO - __main__ -   ep: 2, step: 41, lr_swin: 1.99e-05, lr_bert: 1.99e-05, max memory: 33.04 GB
07/14/2023 07:51:06 - INFO - __main__ -   ep: 2, step: 61, lr_swin: 1.99e-05, lr_bert: 1.99e-05, max memory: 33.04 GB
07/14/2023 07:51:21 - INFO - __main__ -   ep: 2, step: 81, lr_swin: 1.99e-05, lr_bert: 1.99e-05, max memory: 33.04 GB
07/14/2023 07:51:37 - INFO - __main__ -   ep: 2, step: 101, lr_swin: 1.98e-05, lr_bert: 1.98e-05, max memory: 33.04 GB
07/14/2023 07:51:52 - INFO - __main__ -   ep: 2, step: 121, lr_swin: 1.98e-05, lr_bert: 1.98e-05, max memory: 33.04 GB
07/14/2023 07:52:07 - INFO - __main__ -   ep: 2, step: 141, lr_swin: 1.98e-05, lr_bert: 1.98e-05, max memory: 33.04 GB
07/14/2023 07:52:22 - INFO - __main__ -   ep: 2, step: 161, lr_swin: 1.97e-05, lr_bert: 1.97e-05, max memory: 33.04 GB
07/14/2023 07:52:38 - INFO - __main__ -   ep: 2, step: 181, lr_swin: 1.97e-05, lr_bert: 1.97e-05, max memory: 33.04 GB
07/14/2023 07:52:53 - INFO - __main__ -   ep: 2, step: 201, lr_swin: 1.96e-05, lr_bert: 1.96e-05, max memory: 33.04 GB
07/14/2023 07:53:08 - INFO - __main__ -   ep: 2, step: 221, lr_swin: 1.96e-05, lr_bert: 1.96e-05, max memory: 33.04 GB
07/14/2023 07:53:24 - INFO - __main__ -   ep: 2, step: 241, lr_swin: 1.96e-05, lr_bert: 1.96e-05, max memory: 33.04 GB
07/14/2023 07:53:39 - INFO - __main__ -   ep: 2, step: 261, lr_swin: 1.95e-05, lr_bert: 1.95e-05, max memory: 33.04 GB
07/14/2023 07:53:54 - INFO - __main__ -   ep: 2, step: 281, lr_swin: 1.95e-05, lr_bert: 1.95e-05, max memory: 33.04 GB
07/14/2023 07:54:10 - INFO - __main__ -   ep: 2, step: 301, lr_swin: 1.95e-05, lr_bert: 1.95e-05, max memory: 33.04 GB
07/14/2023 07:54:25 - INFO - __main__ -   ep: 2, step: 321, lr_swin: 1.94e-05, lr_bert: 1.94e-05, max memory: 33.04 GB
07/14/2023 07:54:40 - INFO - __main__ -   ep: 2, step: 341, lr_swin: 1.94e-05, lr_bert: 1.94e-05, max memory: 33.04 GB
07/14/2023 07:54:55 - INFO - __main__ -   ep: 2, step: 361, lr_swin: 1.94e-05, lr_bert: 1.94e-05, max memory: 33.04 GB
07/14/2023 07:55:11 - INFO - __main__ -   ep: 2, step: 381, lr_swin: 1.93e-05, lr_bert: 1.93e-05, max memory: 33.04 GB
07/14/2023 07:55:26 - INFO - __main__ -   ep: 2, step: 401, lr_swin: 1.93e-05, lr_bert: 1.93e-05, max memory: 33.04 GB
07/14/2023 07:55:41 - INFO - __main__ -   ep: 2, step: 421, lr_swin: 1.93e-05, lr_bert: 1.93e-05, max memory: 33.04 GB
07/14/2023 07:55:57 - INFO - __main__ -   ep: 2, step: 441, lr_swin: 1.92e-05, lr_bert: 1.92e-05, max memory: 33.04 GB
07/14/2023 07:56:12 - INFO - __main__ -   ep: 2, step: 461, lr_swin: 1.92e-05, lr_bert: 1.92e-05, max memory: 33.04 GB
07/14/2023 07:56:27 - INFO - __main__ -   ep: 2, step: 481, lr_swin: 1.91e-05, lr_bert: 1.91e-05, max memory: 33.04 GB
07/14/2023 07:56:43 - INFO - __main__ -   ep: 2, step: 501, lr_swin: 1.91e-05, lr_bert: 1.91e-05, max memory: 33.04 GB
07/14/2023 07:56:58 - INFO - __main__ -   ep: 2, step: 521, lr_swin: 1.91e-05, lr_bert: 1.91e-05, max memory: 33.04 GB
07/14/2023 07:57:13 - INFO - __main__ -   ep: 2, step: 541, lr_swin: 1.90e-05, lr_bert: 1.90e-05, max memory: 33.04 GB
07/14/2023 07:57:29 - INFO - __main__ -   ep: 2, step: 561, lr_swin: 1.90e-05, lr_bert: 1.90e-05, max memory: 33.04 GB
07/14/2023 07:57:44 - INFO - __main__ -   ep: 2, step: 581, lr_swin: 1.90e-05, lr_bert: 1.90e-05, max memory: 33.04 GB
07/14/2023 07:57:59 - INFO - __main__ -   ep: 2, step: 601, lr_swin: 1.89e-05, lr_bert: 1.89e-05, max memory: 33.04 GB
07/14/2023 07:58:14 - INFO - __main__ -   ep: 2, step: 621, lr_swin: 1.89e-05, lr_bert: 1.89e-05, max memory: 33.04 GB
07/14/2023 07:58:30 - INFO - __main__ -   ep: 2, step: 641, lr_swin: 1.89e-05, lr_bert: 1.89e-05, max memory: 33.04 GB
07/14/2023 07:58:45 - INFO - __main__ -   ep: 2, step: 661, lr_swin: 1.88e-05, lr_bert: 1.88e-05, max memory: 33.04 GB
07/14/2023 07:59:00 - INFO - __main__ -   ep: 2, step: 681, lr_swin: 1.88e-05, lr_bert: 1.88e-05, max memory: 33.04 GB
07/14/2023 07:59:16 - INFO - __main__ -   ep: 2, step: 701, lr_swin: 1.88e-05, lr_bert: 1.88e-05, max memory: 33.04 GB
07/14/2023 07:59:31 - INFO - __main__ -   ep: 2, step: 721, lr_swin: 1.87e-05, lr_bert: 1.87e-05, max memory: 33.04 GB
07/14/2023 07:59:46 - INFO - __main__ -   ep: 2, step: 741, lr_swin: 1.87e-05, lr_bert: 1.87e-05, max memory: 33.04 GB
07/14/2023 08:00:02 - INFO - __main__ -   ep: 2, step: 761, lr_swin: 1.86e-05, lr_bert: 1.86e-05, max memory: 33.04 GB
07/14/2023 08:00:17 - INFO - __main__ -   ep: 2, step: 781, lr_swin: 1.86e-05, lr_bert: 1.86e-05, max memory: 33.04 GB
07/14/2023 08:00:32 - INFO - __main__ -   ep: 2, step: 801, lr_swin: 1.86e-05, lr_bert: 1.86e-05, max memory: 33.04 GB
07/14/2023 08:00:48 - INFO - __main__ -   ep: 2, step: 821, lr_swin: 1.85e-05, lr_bert: 1.85e-05, max memory: 33.04 GB
07/14/2023 08:01:03 - INFO - __main__ -   ep: 2, step: 841, lr_swin: 1.85e-05, lr_bert: 1.85e-05, max memory: 33.04 GB
07/14/2023 08:01:18 - INFO - __main__ -   ep: 2, step: 861, lr_swin: 1.85e-05, lr_bert: 1.85e-05, max memory: 33.04 GB
07/14/2023 08:01:34 - INFO - __main__ -   ep: 2, step: 881, lr_swin: 1.84e-05, lr_bert: 1.84e-05, max memory: 33.04 GB
07/14/2023 08:01:49 - INFO - __main__ -   ep: 2, step: 901, lr_swin: 1.84e-05, lr_bert: 1.84e-05, max memory: 33.04 GB
07/14/2023 08:02:04 - INFO - __main__ -   ep: 2, step: 921, lr_swin: 1.84e-05, lr_bert: 1.84e-05, max memory: 33.04 GB
07/14/2023 08:02:20 - INFO - __main__ -   ep: 2, step: 941, lr_swin: 1.83e-05, lr_bert: 1.83e-05, max memory: 33.04 GB
07/14/2023 08:02:35 - INFO - __main__ -   ep: 2, step: 961, lr_swin: 1.83e-05, lr_bert: 1.83e-05, max memory: 33.04 GB
07/14/2023 08:02:50 - INFO - __main__ -   ep: 2, step: 981, lr_swin: 1.83e-05, lr_bert: 1.83e-05, max memory: 33.04 GB
07/14/2023 08:03:06 - INFO - __main__ -   ep: 2, step: 1001, lr_swin: 1.82e-05, lr_bert: 1.82e-05, max memory: 33.04 GB
07/14/2023 08:03:21 - INFO - __main__ -   ep: 2, step: 1021, lr_swin: 1.82e-05, lr_bert: 1.82e-05, max memory: 33.04 GB
07/14/2023 08:03:36 - INFO - __main__ -   ep: 2, step: 1041, lr_swin: 1.81e-05, lr_bert: 1.81e-05, max memory: 33.04 GB
07/14/2023 08:03:52 - INFO - __main__ -   ep: 2, step: 1061, lr_swin: 1.81e-05, lr_bert: 1.81e-05, max memory: 33.04 GB
07/14/2023 08:04:07 - INFO - __main__ -   ep: 2, step: 1081, lr_swin: 1.81e-05, lr_bert: 1.81e-05, max memory: 33.04 GB
07/14/2023 08:04:22 - INFO - __main__ -   ep: 2, step: 1101, lr_swin: 1.80e-05, lr_bert: 1.80e-05, max memory: 33.04 GB
07/14/2023 08:04:38 - INFO - __main__ -   ep: 2, step: 1121, lr_swin: 1.80e-05, lr_bert: 1.80e-05, max memory: 33.04 GB
07/14/2023 08:04:53 - INFO - __main__ -   ep: 2, step: 1141, lr_swin: 1.80e-05, lr_bert: 1.80e-05, max memory: 33.04 GB
07/14/2023 08:05:08 - INFO - __main__ -   ep: 2, step: 1161, lr_swin: 1.79e-05, lr_bert: 1.79e-05, max memory: 33.04 GB
07/14/2023 08:05:24 - INFO - __main__ -   ep: 2, step: 1181, lr_swin: 1.79e-05, lr_bert: 1.79e-05, max memory: 33.04 GB
07/14/2023 08:05:39 - INFO - __main__ -   ep: 2, step: 1201, lr_swin: 1.79e-05, lr_bert: 1.79e-05, max memory: 33.04 GB
07/14/2023 08:05:54 - INFO - __main__ -   ep: 2, step: 1221, lr_swin: 1.78e-05, lr_bert: 1.78e-05, max memory: 33.04 GB
07/14/2023 08:06:10 - INFO - __main__ -   ep: 2, step: 1241, lr_swin: 1.78e-05, lr_bert: 1.78e-05, max memory: 33.04 GB
07/14/2023 08:06:14 - INFO - __main__ -   ep: 2, step: 1246, lr_swin: 1.78e-05, lr_bert: 1.78e-05, max memory: 33.04 GB
07/14/2023 08:06:14 - INFO - __main__ -   Ep 1, Loss (train): 1.3540e+02
07/14/2023 08:07:59 - INFO - __main__ -   Ep 1, Acc (val): 51.04, 70.96
07/14/2023 08:11:30 - INFO - __main__ -   Ep 1, Acc (test): 51.12, 73.55
07/14/2023 08:11:34 - INFO - __main__ -   ep: 3, step: 1, lr_swin: 1.78e-05, lr_bert: 1.78e-05, max memory: 33.04 GB
07/14/2023 08:11:50 - INFO - __main__ -   ep: 3, step: 21, lr_swin: 1.77e-05, lr_bert: 1.77e-05, max memory: 33.04 GB
07/14/2023 08:12:05 - INFO - __main__ -   ep: 3, step: 41, lr_swin: 1.77e-05, lr_bert: 1.77e-05, max memory: 33.04 GB
07/14/2023 08:12:20 - INFO - __main__ -   ep: 3, step: 61, lr_swin: 1.77e-05, lr_bert: 1.77e-05, max memory: 33.04 GB
07/14/2023 08:12:36 - INFO - __main__ -   ep: 3, step: 81, lr_swin: 1.76e-05, lr_bert: 1.76e-05, max memory: 33.04 GB
07/14/2023 08:12:51 - INFO - __main__ -   ep: 3, step: 101, lr_swin: 1.76e-05, lr_bert: 1.76e-05, max memory: 33.04 GB
07/14/2023 08:13:06 - INFO - __main__ -   ep: 3, step: 121, lr_swin: 1.76e-05, lr_bert: 1.76e-05, max memory: 33.04 GB
07/14/2023 08:13:22 - INFO - __main__ -   ep: 3, step: 141, lr_swin: 1.75e-05, lr_bert: 1.75e-05, max memory: 33.04 GB
07/14/2023 08:13:37 - INFO - __main__ -   ep: 3, step: 161, lr_swin: 1.75e-05, lr_bert: 1.75e-05, max memory: 33.04 GB
07/14/2023 08:13:52 - INFO - __main__ -   ep: 3, step: 181, lr_swin: 1.75e-05, lr_bert: 1.75e-05, max memory: 33.04 GB
07/14/2023 08:14:07 - INFO - __main__ -   ep: 3, step: 201, lr_swin: 1.74e-05, lr_bert: 1.74e-05, max memory: 33.04 GB
07/14/2023 08:14:23 - INFO - __main__ -   ep: 3, step: 221, lr_swin: 1.74e-05, lr_bert: 1.74e-05, max memory: 33.04 GB
07/14/2023 08:14:38 - INFO - __main__ -   ep: 3, step: 241, lr_swin: 1.73e-05, lr_bert: 1.73e-05, max memory: 33.04 GB
07/14/2023 08:14:53 - INFO - __main__ -   ep: 3, step: 261, lr_swin: 1.73e-05, lr_bert: 1.73e-05, max memory: 33.04 GB
07/14/2023 08:15:09 - INFO - __main__ -   ep: 3, step: 281, lr_swin: 1.73e-05, lr_bert: 1.73e-05, max memory: 33.04 GB
07/14/2023 08:15:24 - INFO - __main__ -   ep: 3, step: 301, lr_swin: 1.72e-05, lr_bert: 1.72e-05, max memory: 33.04 GB
07/14/2023 08:15:39 - INFO - __main__ -   ep: 3, step: 321, lr_swin: 1.72e-05, lr_bert: 1.72e-05, max memory: 33.04 GB
07/14/2023 08:15:54 - INFO - __main__ -   ep: 3, step: 341, lr_swin: 1.72e-05, lr_bert: 1.72e-05, max memory: 33.04 GB
07/14/2023 08:16:10 - INFO - __main__ -   ep: 3, step: 361, lr_swin: 1.71e-05, lr_bert: 1.71e-05, max memory: 33.04 GB
07/14/2023 08:16:25 - INFO - __main__ -   ep: 3, step: 381, lr_swin: 1.71e-05, lr_bert: 1.71e-05, max memory: 33.04 GB
07/14/2023 08:16:40 - INFO - __main__ -   ep: 3, step: 401, lr_swin: 1.71e-05, lr_bert: 1.71e-05, max memory: 33.04 GB
07/14/2023 08:16:56 - INFO - __main__ -   ep: 3, step: 421, lr_swin: 1.70e-05, lr_bert: 1.70e-05, max memory: 33.04 GB
07/14/2023 08:17:11 - INFO - __main__ -   ep: 3, step: 441, lr_swin: 1.70e-05, lr_bert: 1.70e-05, max memory: 33.04 GB
07/14/2023 08:17:26 - INFO - __main__ -   ep: 3, step: 461, lr_swin: 1.70e-05, lr_bert: 1.70e-05, max memory: 33.04 GB
07/14/2023 08:17:42 - INFO - __main__ -   ep: 3, step: 481, lr_swin: 1.69e-05, lr_bert: 1.69e-05, max memory: 33.04 GB
07/14/2023 08:17:57 - INFO - __main__ -   ep: 3, step: 501, lr_swin: 1.69e-05, lr_bert: 1.69e-05, max memory: 33.04 GB
07/14/2023 08:18:12 - INFO - __main__ -   ep: 3, step: 521, lr_swin: 1.69e-05, lr_bert: 1.69e-05, max memory: 33.04 GB
07/14/2023 08:18:27 - INFO - __main__ -   ep: 3, step: 541, lr_swin: 1.68e-05, lr_bert: 1.68e-05, max memory: 33.04 GB
07/14/2023 08:18:43 - INFO - __main__ -   ep: 3, step: 561, lr_swin: 1.68e-05, lr_bert: 1.68e-05, max memory: 33.04 GB
07/14/2023 08:18:58 - INFO - __main__ -   ep: 3, step: 581, lr_swin: 1.67e-05, lr_bert: 1.67e-05, max memory: 33.04 GB
07/14/2023 08:19:13 - INFO - __main__ -   ep: 3, step: 601, lr_swin: 1.67e-05, lr_bert: 1.67e-05, max memory: 33.04 GB
07/14/2023 08:19:28 - INFO - __main__ -   ep: 3, step: 621, lr_swin: 1.67e-05, lr_bert: 1.67e-05, max memory: 33.04 GB
07/14/2023 08:19:44 - INFO - __main__ -   ep: 3, step: 641, lr_swin: 1.66e-05, lr_bert: 1.66e-05, max memory: 33.04 GB
07/14/2023 08:19:59 - INFO - __main__ -   ep: 3, step: 661, lr_swin: 1.66e-05, lr_bert: 1.66e-05, max memory: 33.04 GB
07/14/2023 08:20:14 - INFO - __main__ -   ep: 3, step: 681, lr_swin: 1.66e-05, lr_bert: 1.66e-05, max memory: 33.04 GB
07/14/2023 08:20:30 - INFO - __main__ -   ep: 3, step: 701, lr_swin: 1.65e-05, lr_bert: 1.65e-05, max memory: 33.04 GB
07/14/2023 08:20:45 - INFO - __main__ -   ep: 3, step: 721, lr_swin: 1.65e-05, lr_bert: 1.65e-05, max memory: 33.04 GB
07/14/2023 08:21:00 - INFO - __main__ -   ep: 3, step: 741, lr_swin: 1.65e-05, lr_bert: 1.65e-05, max memory: 33.04 GB
07/14/2023 08:21:15 - INFO - __main__ -   ep: 3, step: 761, lr_swin: 1.64e-05, lr_bert: 1.64e-05, max memory: 33.04 GB
07/14/2023 08:21:31 - INFO - __main__ -   ep: 3, step: 781, lr_swin: 1.64e-05, lr_bert: 1.64e-05, max memory: 33.04 GB
07/14/2023 08:21:46 - INFO - __main__ -   ep: 3, step: 801, lr_swin: 1.64e-05, lr_bert: 1.64e-05, max memory: 33.04 GB
07/14/2023 08:22:01 - INFO - __main__ -   ep: 3, step: 821, lr_swin: 1.63e-05, lr_bert: 1.63e-05, max memory: 33.04 GB
07/14/2023 08:22:17 - INFO - __main__ -   ep: 3, step: 841, lr_swin: 1.63e-05, lr_bert: 1.63e-05, max memory: 33.04 GB
07/14/2023 08:22:32 - INFO - __main__ -   ep: 3, step: 861, lr_swin: 1.62e-05, lr_bert: 1.62e-05, max memory: 33.04 GB
07/14/2023 08:22:47 - INFO - __main__ -   ep: 3, step: 881, lr_swin: 1.62e-05, lr_bert: 1.62e-05, max memory: 33.04 GB
07/14/2023 08:23:02 - INFO - __main__ -   ep: 3, step: 901, lr_swin: 1.62e-05, lr_bert: 1.62e-05, max memory: 33.04 GB
07/14/2023 08:23:18 - INFO - __main__ -   ep: 3, step: 921, lr_swin: 1.61e-05, lr_bert: 1.61e-05, max memory: 33.04 GB
07/14/2023 08:23:33 - INFO - __main__ -   ep: 3, step: 941, lr_swin: 1.61e-05, lr_bert: 1.61e-05, max memory: 33.04 GB
07/14/2023 08:23:48 - INFO - __main__ -   ep: 3, step: 961, lr_swin: 1.61e-05, lr_bert: 1.61e-05, max memory: 33.04 GB
07/14/2023 08:24:04 - INFO - __main__ -   ep: 3, step: 981, lr_swin: 1.60e-05, lr_bert: 1.60e-05, max memory: 33.04 GB
07/14/2023 08:24:19 - INFO - __main__ -   ep: 3, step: 1001, lr_swin: 1.60e-05, lr_bert: 1.60e-05, max memory: 33.04 GB
07/14/2023 08:24:34 - INFO - __main__ -   ep: 3, step: 1021, lr_swin: 1.60e-05, lr_bert: 1.60e-05, max memory: 33.04 GB
07/14/2023 08:24:49 - INFO - __main__ -   ep: 3, step: 1041, lr_swin: 1.59e-05, lr_bert: 1.59e-05, max memory: 33.04 GB
07/14/2023 08:25:05 - INFO - __main__ -   ep: 3, step: 1061, lr_swin: 1.59e-05, lr_bert: 1.59e-05, max memory: 33.04 GB
07/14/2023 08:25:20 - INFO - __main__ -   ep: 3, step: 1081, lr_swin: 1.59e-05, lr_bert: 1.59e-05, max memory: 33.04 GB
07/14/2023 08:25:35 - INFO - __main__ -   ep: 3, step: 1101, lr_swin: 1.58e-05, lr_bert: 1.58e-05, max memory: 33.04 GB
07/14/2023 08:25:51 - INFO - __main__ -   ep: 3, step: 1121, lr_swin: 1.58e-05, lr_bert: 1.58e-05, max memory: 33.04 GB
07/14/2023 08:26:06 - INFO - __main__ -   ep: 3, step: 1141, lr_swin: 1.57e-05, lr_bert: 1.57e-05, max memory: 33.04 GB
07/14/2023 08:26:21 - INFO - __main__ -   ep: 3, step: 1161, lr_swin: 1.57e-05, lr_bert: 1.57e-05, max memory: 33.04 GB
07/14/2023 08:26:37 - INFO - __main__ -   ep: 3, step: 1181, lr_swin: 1.57e-05, lr_bert: 1.57e-05, max memory: 33.04 GB
07/14/2023 08:26:52 - INFO - __main__ -   ep: 3, step: 1201, lr_swin: 1.56e-05, lr_bert: 1.56e-05, max memory: 33.04 GB
07/14/2023 08:27:07 - INFO - __main__ -   ep: 3, step: 1221, lr_swin: 1.56e-05, lr_bert: 1.56e-05, max memory: 33.04 GB
07/14/2023 08:27:23 - INFO - __main__ -   ep: 3, step: 1241, lr_swin: 1.56e-05, lr_bert: 1.56e-05, max memory: 33.04 GB
07/14/2023 08:27:27 - INFO - __main__ -   ep: 3, step: 1246, lr_swin: 1.56e-05, lr_bert: 1.56e-05, max memory: 33.04 GB
07/14/2023 08:27:27 - INFO - __main__ -   Ep 2, Loss (train): 1.0509e+02
07/14/2023 08:29:13 - INFO - __main__ -   Ep 2, Acc (val): 50.26, 70.79
07/14/2023 08:32:43 - INFO - __main__ -   Ep 2, Acc (test): 52.50, 73.91
07/14/2023 08:32:46 - INFO - __main__ -   ep: 4, step: 1, lr_swin: 1.56e-05, lr_bert: 1.56e-05, max memory: 33.04 GB
07/14/2023 08:33:02 - INFO - __main__ -   ep: 4, step: 21, lr_swin: 1.55e-05, lr_bert: 1.55e-05, max memory: 33.04 GB
07/14/2023 08:33:17 - INFO - __main__ -   ep: 4, step: 41, lr_swin: 1.55e-05, lr_bert: 1.55e-05, max memory: 33.04 GB
07/14/2023 08:33:32 - INFO - __main__ -   ep: 4, step: 61, lr_swin: 1.54e-05, lr_bert: 1.54e-05, max memory: 33.04 GB
07/14/2023 08:33:48 - INFO - __main__ -   ep: 4, step: 81, lr_swin: 1.54e-05, lr_bert: 1.54e-05, max memory: 33.04 GB
07/14/2023 08:34:03 - INFO - __main__ -   ep: 4, step: 101, lr_swin: 1.54e-05, lr_bert: 1.54e-05, max memory: 33.04 GB
07/14/2023 08:34:18 - INFO - __main__ -   ep: 4, step: 121, lr_swin: 1.53e-05, lr_bert: 1.53e-05, max memory: 33.04 GB
07/14/2023 08:34:34 - INFO - __main__ -   ep: 4, step: 141, lr_swin: 1.53e-05, lr_bert: 1.53e-05, max memory: 33.04 GB
07/14/2023 08:34:49 - INFO - __main__ -   ep: 4, step: 161, lr_swin: 1.53e-05, lr_bert: 1.53e-05, max memory: 33.04 GB
07/14/2023 08:35:04 - INFO - __main__ -   ep: 4, step: 181, lr_swin: 1.52e-05, lr_bert: 1.52e-05, max memory: 33.04 GB
07/14/2023 08:35:19 - INFO - __main__ -   ep: 4, step: 201, lr_swin: 1.52e-05, lr_bert: 1.52e-05, max memory: 33.04 GB
07/14/2023 08:35:35 - INFO - __main__ -   ep: 4, step: 221, lr_swin: 1.52e-05, lr_bert: 1.52e-05, max memory: 33.04 GB
07/14/2023 08:35:50 - INFO - __main__ -   ep: 4, step: 241, lr_swin: 1.51e-05, lr_bert: 1.51e-05, max memory: 33.04 GB
07/14/2023 08:36:05 - INFO - __main__ -   ep: 4, step: 261, lr_swin: 1.51e-05, lr_bert: 1.51e-05, max memory: 33.04 GB
07/14/2023 08:36:21 - INFO - __main__ -   ep: 4, step: 281, lr_swin: 1.51e-05, lr_bert: 1.51e-05, max memory: 33.04 GB
07/14/2023 08:36:36 - INFO - __main__ -   ep: 4, step: 301, lr_swin: 1.50e-05, lr_bert: 1.50e-05, max memory: 33.04 GB
07/14/2023 08:36:51 - INFO - __main__ -   ep: 4, step: 321, lr_swin: 1.50e-05, lr_bert: 1.50e-05, max memory: 33.04 GB
07/14/2023 08:37:07 - INFO - __main__ -   ep: 4, step: 341, lr_swin: 1.49e-05, lr_bert: 1.49e-05, max memory: 33.04 GB
07/14/2023 08:37:22 - INFO - __main__ -   ep: 4, step: 361, lr_swin: 1.49e-05, lr_bert: 1.49e-05, max memory: 33.04 GB
07/14/2023 08:37:37 - INFO - __main__ -   ep: 4, step: 381, lr_swin: 1.49e-05, lr_bert: 1.49e-05, max memory: 33.04 GB
07/14/2023 08:37:52 - INFO - __main__ -   ep: 4, step: 401, lr_swin: 1.48e-05, lr_bert: 1.48e-05, max memory: 33.04 GB
07/14/2023 08:38:08 - INFO - __main__ -   ep: 4, step: 421, lr_swin: 1.48e-05, lr_bert: 1.48e-05, max memory: 33.04 GB
07/14/2023 08:38:23 - INFO - __main__ -   ep: 4, step: 441, lr_swin: 1.48e-05, lr_bert: 1.48e-05, max memory: 33.04 GB
07/14/2023 08:38:38 - INFO - __main__ -   ep: 4, step: 461, lr_swin: 1.47e-05, lr_bert: 1.47e-05, max memory: 33.04 GB
07/14/2023 08:38:54 - INFO - __main__ -   ep: 4, step: 481, lr_swin: 1.47e-05, lr_bert: 1.47e-05, max memory: 33.04 GB
07/14/2023 08:39:09 - INFO - __main__ -   ep: 4, step: 501, lr_swin: 1.47e-05, lr_bert: 1.47e-05, max memory: 33.04 GB
07/14/2023 08:39:24 - INFO - __main__ -   ep: 4, step: 521, lr_swin: 1.46e-05, lr_bert: 1.46e-05, max memory: 33.04 GB
07/14/2023 08:39:39 - INFO - __main__ -   ep: 4, step: 541, lr_swin: 1.46e-05, lr_bert: 1.46e-05, max memory: 33.04 GB
07/14/2023 08:39:55 - INFO - __main__ -   ep: 4, step: 561, lr_swin: 1.46e-05, lr_bert: 1.46e-05, max memory: 33.04 GB
07/14/2023 08:40:10 - INFO - __main__ -   ep: 4, step: 581, lr_swin: 1.45e-05, lr_bert: 1.45e-05, max memory: 33.04 GB
07/14/2023 08:40:25 - INFO - __main__ -   ep: 4, step: 601, lr_swin: 1.45e-05, lr_bert: 1.45e-05, max memory: 33.04 GB
07/14/2023 08:40:41 - INFO - __main__ -   ep: 4, step: 621, lr_swin: 1.44e-05, lr_bert: 1.44e-05, max memory: 33.04 GB
07/14/2023 08:40:56 - INFO - __main__ -   ep: 4, step: 641, lr_swin: 1.44e-05, lr_bert: 1.44e-05, max memory: 33.04 GB
07/14/2023 08:41:11 - INFO - __main__ -   ep: 4, step: 661, lr_swin: 1.44e-05, lr_bert: 1.44e-05, max memory: 33.04 GB
07/14/2023 08:41:27 - INFO - __main__ -   ep: 4, step: 681, lr_swin: 1.43e-05, lr_bert: 1.43e-05, max memory: 33.04 GB
07/14/2023 08:41:42 - INFO - __main__ -   ep: 4, step: 701, lr_swin: 1.43e-05, lr_bert: 1.43e-05, max memory: 33.04 GB
07/14/2023 08:41:57 - INFO - __main__ -   ep: 4, step: 721, lr_swin: 1.43e-05, lr_bert: 1.43e-05, max memory: 33.04 GB
07/14/2023 08:42:12 - INFO - __main__ -   ep: 4, step: 741, lr_swin: 1.42e-05, lr_bert: 1.42e-05, max memory: 33.04 GB
07/14/2023 08:42:28 - INFO - __main__ -   ep: 4, step: 761, lr_swin: 1.42e-05, lr_bert: 1.42e-05, max memory: 33.04 GB
07/14/2023 08:42:43 - INFO - __main__ -   ep: 4, step: 781, lr_swin: 1.42e-05, lr_bert: 1.42e-05, max memory: 33.04 GB
07/14/2023 08:42:58 - INFO - __main__ -   ep: 4, step: 801, lr_swin: 1.41e-05, lr_bert: 1.41e-05, max memory: 33.04 GB
07/14/2023 08:43:14 - INFO - __main__ -   ep: 4, step: 821, lr_swin: 1.41e-05, lr_bert: 1.41e-05, max memory: 33.04 GB
07/14/2023 08:43:29 - INFO - __main__ -   ep: 4, step: 841, lr_swin: 1.41e-05, lr_bert: 1.41e-05, max memory: 33.04 GB
07/14/2023 08:43:44 - INFO - __main__ -   ep: 4, step: 861, lr_swin: 1.40e-05, lr_bert: 1.40e-05, max memory: 33.04 GB
07/14/2023 08:43:59 - INFO - __main__ -   ep: 4, step: 881, lr_swin: 1.40e-05, lr_bert: 1.40e-05, max memory: 33.04 GB
07/14/2023 08:44:15 - INFO - __main__ -   ep: 4, step: 901, lr_swin: 1.40e-05, lr_bert: 1.40e-05, max memory: 33.04 GB
07/14/2023 08:44:30 - INFO - __main__ -   ep: 4, step: 921, lr_swin: 1.39e-05, lr_bert: 1.39e-05, max memory: 33.04 GB
07/14/2023 08:44:45 - INFO - __main__ -   ep: 4, step: 941, lr_swin: 1.39e-05, lr_bert: 1.39e-05, max memory: 33.04 GB
07/14/2023 08:45:01 - INFO - __main__ -   ep: 4, step: 961, lr_swin: 1.38e-05, lr_bert: 1.38e-05, max memory: 33.04 GB
07/14/2023 08:45:16 - INFO - __main__ -   ep: 4, step: 981, lr_swin: 1.38e-05, lr_bert: 1.38e-05, max memory: 33.04 GB
07/14/2023 08:45:31 - INFO - __main__ -   ep: 4, step: 1001, lr_swin: 1.38e-05, lr_bert: 1.38e-05, max memory: 33.04 GB
07/14/2023 08:45:47 - INFO - __main__ -   ep: 4, step: 1021, lr_swin: 1.37e-05, lr_bert: 1.37e-05, max memory: 33.04 GB
07/14/2023 08:46:02 - INFO - __main__ -   ep: 4, step: 1041, lr_swin: 1.37e-05, lr_bert: 1.37e-05, max memory: 33.04 GB
07/14/2023 08:46:17 - INFO - __main__ -   ep: 4, step: 1061, lr_swin: 1.37e-05, lr_bert: 1.37e-05, max memory: 33.04 GB
07/14/2023 08:46:32 - INFO - __main__ -   ep: 4, step: 1081, lr_swin: 1.36e-05, lr_bert: 1.36e-05, max memory: 33.04 GB
07/14/2023 08:46:48 - INFO - __main__ -   ep: 4, step: 1101, lr_swin: 1.36e-05, lr_bert: 1.36e-05, max memory: 33.04 GB
07/14/2023 08:47:03 - INFO - __main__ -   ep: 4, step: 1121, lr_swin: 1.36e-05, lr_bert: 1.36e-05, max memory: 33.04 GB
07/14/2023 08:47:18 - INFO - __main__ -   ep: 4, step: 1141, lr_swin: 1.35e-05, lr_bert: 1.35e-05, max memory: 33.04 GB
07/14/2023 08:47:34 - INFO - __main__ -   ep: 4, step: 1161, lr_swin: 1.35e-05, lr_bert: 1.35e-05, max memory: 33.04 GB
07/14/2023 08:47:49 - INFO - __main__ -   ep: 4, step: 1181, lr_swin: 1.35e-05, lr_bert: 1.35e-05, max memory: 33.04 GB
07/14/2023 08:48:04 - INFO - __main__ -   ep: 4, step: 1201, lr_swin: 1.34e-05, lr_bert: 1.34e-05, max memory: 33.04 GB
07/14/2023 08:48:20 - INFO - __main__ -   ep: 4, step: 1221, lr_swin: 1.34e-05, lr_bert: 1.34e-05, max memory: 33.04 GB
07/14/2023 08:48:35 - INFO - __main__ -   ep: 4, step: 1241, lr_swin: 1.33e-05, lr_bert: 1.33e-05, max memory: 33.04 GB
07/14/2023 08:48:39 - INFO - __main__ -   ep: 4, step: 1246, lr_swin: 1.33e-05, lr_bert: 1.33e-05, max memory: 33.04 GB
07/14/2023 08:48:39 - INFO - __main__ -   Ep 3, Loss (train): 8.6943e+01
07/14/2023 08:50:25 - INFO - __main__ -   Ep 3, Acc (val): 50.71, 72.00
07/14/2023 08:53:52 - INFO - __main__ -   Ep 3, Acc (test): 51.77, 73.77
07/14/2023 08:53:55 - INFO - __main__ -   ep: 5, step: 1, lr_swin: 1.33e-05, lr_bert: 1.33e-05, max memory: 33.04 GB
07/14/2023 08:54:11 - INFO - __main__ -   ep: 5, step: 21, lr_swin: 1.33e-05, lr_bert: 1.33e-05, max memory: 33.04 GB
07/14/2023 08:54:26 - INFO - __main__ -   ep: 5, step: 41, lr_swin: 1.33e-05, lr_bert: 1.33e-05, max memory: 33.04 GB
07/14/2023 08:54:42 - INFO - __main__ -   ep: 5, step: 61, lr_swin: 1.32e-05, lr_bert: 1.32e-05, max memory: 33.04 GB
07/14/2023 08:54:57 - INFO - __main__ -   ep: 5, step: 81, lr_swin: 1.32e-05, lr_bert: 1.32e-05, max memory: 33.04 GB
07/14/2023 08:55:12 - INFO - __main__ -   ep: 5, step: 101, lr_swin: 1.32e-05, lr_bert: 1.32e-05, max memory: 33.04 GB
07/14/2023 08:55:27 - INFO - __main__ -   ep: 5, step: 121, lr_swin: 1.31e-05, lr_bert: 1.31e-05, max memory: 33.04 GB
07/14/2023 08:55:43 - INFO - __main__ -   ep: 5, step: 141, lr_swin: 1.31e-05, lr_bert: 1.31e-05, max memory: 33.04 GB
07/14/2023 08:55:58 - INFO - __main__ -   ep: 5, step: 161, lr_swin: 1.30e-05, lr_bert: 1.30e-05, max memory: 33.04 GB
07/14/2023 08:56:13 - INFO - __main__ -   ep: 5, step: 181, lr_swin: 1.30e-05, lr_bert: 1.30e-05, max memory: 33.04 GB
07/14/2023 08:56:29 - INFO - __main__ -   ep: 5, step: 201, lr_swin: 1.30e-05, lr_bert: 1.30e-05, max memory: 33.04 GB
07/14/2023 08:56:44 - INFO - __main__ -   ep: 5, step: 221, lr_swin: 1.29e-05, lr_bert: 1.29e-05, max memory: 33.04 GB
07/14/2023 08:56:59 - INFO - __main__ -   ep: 5, step: 241, lr_swin: 1.29e-05, lr_bert: 1.29e-05, max memory: 33.04 GB
07/14/2023 08:57:15 - INFO - __main__ -   ep: 5, step: 261, lr_swin: 1.29e-05, lr_bert: 1.29e-05, max memory: 33.04 GB
07/14/2023 08:57:30 - INFO - __main__ -   ep: 5, step: 281, lr_swin: 1.28e-05, lr_bert: 1.28e-05, max memory: 33.04 GB
07/14/2023 08:57:45 - INFO - __main__ -   ep: 5, step: 301, lr_swin: 1.28e-05, lr_bert: 1.28e-05, max memory: 33.04 GB
07/14/2023 08:58:01 - INFO - __main__ -   ep: 5, step: 321, lr_swin: 1.28e-05, lr_bert: 1.28e-05, max memory: 33.04 GB
07/14/2023 08:58:16 - INFO - __main__ -   ep: 5, step: 341, lr_swin: 1.27e-05, lr_bert: 1.27e-05, max memory: 33.04 GB
07/14/2023 08:58:31 - INFO - __main__ -   ep: 5, step: 361, lr_swin: 1.27e-05, lr_bert: 1.27e-05, max memory: 33.04 GB
07/14/2023 08:58:47 - INFO - __main__ -   ep: 5, step: 381, lr_swin: 1.27e-05, lr_bert: 1.27e-05, max memory: 33.04 GB
07/14/2023 08:59:02 - INFO - __main__ -   ep: 5, step: 401, lr_swin: 1.26e-05, lr_bert: 1.26e-05, max memory: 33.04 GB
07/14/2023 08:59:17 - INFO - __main__ -   ep: 5, step: 421, lr_swin: 1.26e-05, lr_bert: 1.26e-05, max memory: 33.04 GB
07/14/2023 08:59:32 - INFO - __main__ -   ep: 5, step: 441, lr_swin: 1.25e-05, lr_bert: 1.25e-05, max memory: 33.04 GB
07/14/2023 08:59:48 - INFO - __main__ -   ep: 5, step: 461, lr_swin: 1.25e-05, lr_bert: 1.25e-05, max memory: 33.04 GB
07/14/2023 09:00:03 - INFO - __main__ -   ep: 5, step: 481, lr_swin: 1.25e-05, lr_bert: 1.25e-05, max memory: 33.04 GB
07/14/2023 09:00:18 - INFO - __main__ -   ep: 5, step: 501, lr_swin: 1.24e-05, lr_bert: 1.24e-05, max memory: 33.04 GB
07/14/2023 09:00:34 - INFO - __main__ -   ep: 5, step: 521, lr_swin: 1.24e-05, lr_bert: 1.24e-05, max memory: 33.04 GB
07/14/2023 09:00:49 - INFO - __main__ -   ep: 5, step: 541, lr_swin: 1.24e-05, lr_bert: 1.24e-05, max memory: 33.04 GB
07/14/2023 09:01:04 - INFO - __main__ -   ep: 5, step: 561, lr_swin: 1.23e-05, lr_bert: 1.23e-05, max memory: 33.04 GB
07/14/2023 09:01:20 - INFO - __main__ -   ep: 5, step: 581, lr_swin: 1.23e-05, lr_bert: 1.23e-05, max memory: 33.04 GB
07/14/2023 09:01:35 - INFO - __main__ -   ep: 5, step: 601, lr_swin: 1.23e-05, lr_bert: 1.23e-05, max memory: 33.04 GB
07/14/2023 09:01:50 - INFO - __main__ -   ep: 5, step: 621, lr_swin: 1.22e-05, lr_bert: 1.22e-05, max memory: 33.04 GB
07/14/2023 09:02:05 - INFO - __main__ -   ep: 5, step: 641, lr_swin: 1.22e-05, lr_bert: 1.22e-05, max memory: 33.04 GB
07/14/2023 09:02:21 - INFO - __main__ -   ep: 5, step: 661, lr_swin: 1.22e-05, lr_bert: 1.22e-05, max memory: 33.04 GB
07/14/2023 09:02:36 - INFO - __main__ -   ep: 5, step: 681, lr_swin: 1.21e-05, lr_bert: 1.21e-05, max memory: 33.04 GB
07/14/2023 09:02:51 - INFO - __main__ -   ep: 5, step: 701, lr_swin: 1.21e-05, lr_bert: 1.21e-05, max memory: 33.04 GB
07/14/2023 09:03:07 - INFO - __main__ -   ep: 5, step: 721, lr_swin: 1.20e-05, lr_bert: 1.20e-05, max memory: 33.04 GB
07/14/2023 09:03:22 - INFO - __main__ -   ep: 5, step: 741, lr_swin: 1.20e-05, lr_bert: 1.20e-05, max memory: 33.04 GB
07/14/2023 09:03:37 - INFO - __main__ -   ep: 5, step: 761, lr_swin: 1.20e-05, lr_bert: 1.20e-05, max memory: 33.04 GB
07/14/2023 09:03:53 - INFO - __main__ -   ep: 5, step: 781, lr_swin: 1.19e-05, lr_bert: 1.19e-05, max memory: 33.04 GB
07/14/2023 09:04:08 - INFO - __main__ -   ep: 5, step: 801, lr_swin: 1.19e-05, lr_bert: 1.19e-05, max memory: 33.04 GB
07/14/2023 09:04:23 - INFO - __main__ -   ep: 5, step: 821, lr_swin: 1.19e-05, lr_bert: 1.19e-05, max memory: 33.04 GB
07/14/2023 09:04:38 - INFO - __main__ -   ep: 5, step: 841, lr_swin: 1.18e-05, lr_bert: 1.18e-05, max memory: 33.04 GB
07/14/2023 09:04:54 - INFO - __main__ -   ep: 5, step: 861, lr_swin: 1.18e-05, lr_bert: 1.18e-05, max memory: 33.04 GB
07/14/2023 09:05:09 - INFO - __main__ -   ep: 5, step: 881, lr_swin: 1.18e-05, lr_bert: 1.18e-05, max memory: 33.04 GB
07/14/2023 09:05:24 - INFO - __main__ -   ep: 5, step: 901, lr_swin: 1.17e-05, lr_bert: 1.17e-05, max memory: 33.04 GB
07/14/2023 09:05:40 - INFO - __main__ -   ep: 5, step: 921, lr_swin: 1.17e-05, lr_bert: 1.17e-05, max memory: 33.04 GB
07/14/2023 09:05:55 - INFO - __main__ -   ep: 5, step: 941, lr_swin: 1.17e-05, lr_bert: 1.17e-05, max memory: 33.04 GB
07/14/2023 09:06:10 - INFO - __main__ -   ep: 5, step: 961, lr_swin: 1.16e-05, lr_bert: 1.16e-05, max memory: 33.04 GB
07/14/2023 09:06:26 - INFO - __main__ -   ep: 5, step: 981, lr_swin: 1.16e-05, lr_bert: 1.16e-05, max memory: 33.04 GB
07/14/2023 09:06:41 - INFO - __main__ -   ep: 5, step: 1001, lr_swin: 1.15e-05, lr_bert: 1.15e-05, max memory: 33.04 GB
07/14/2023 09:06:56 - INFO - __main__ -   ep: 5, step: 1021, lr_swin: 1.15e-05, lr_bert: 1.15e-05, max memory: 33.04 GB
07/14/2023 09:07:11 - INFO - __main__ -   ep: 5, step: 1041, lr_swin: 1.15e-05, lr_bert: 1.15e-05, max memory: 33.04 GB
07/14/2023 09:07:27 - INFO - __main__ -   ep: 5, step: 1061, lr_swin: 1.14e-05, lr_bert: 1.14e-05, max memory: 33.04 GB
07/14/2023 09:07:42 - INFO - __main__ -   ep: 5, step: 1081, lr_swin: 1.14e-05, lr_bert: 1.14e-05, max memory: 33.04 GB
07/14/2023 09:07:57 - INFO - __main__ -   ep: 5, step: 1101, lr_swin: 1.14e-05, lr_bert: 1.14e-05, max memory: 33.04 GB
07/14/2023 09:08:13 - INFO - __main__ -   ep: 5, step: 1121, lr_swin: 1.13e-05, lr_bert: 1.13e-05, max memory: 33.04 GB
07/14/2023 09:08:28 - INFO - __main__ -   ep: 5, step: 1141, lr_swin: 1.13e-05, lr_bert: 1.13e-05, max memory: 33.04 GB
07/14/2023 09:08:43 - INFO - __main__ -   ep: 5, step: 1161, lr_swin: 1.13e-05, lr_bert: 1.13e-05, max memory: 33.04 GB
07/14/2023 09:08:59 - INFO - __main__ -   ep: 5, step: 1181, lr_swin: 1.12e-05, lr_bert: 1.12e-05, max memory: 33.04 GB
07/14/2023 09:09:14 - INFO - __main__ -   ep: 5, step: 1201, lr_swin: 1.12e-05, lr_bert: 1.12e-05, max memory: 33.04 GB
07/14/2023 09:09:29 - INFO - __main__ -   ep: 5, step: 1221, lr_swin: 1.12e-05, lr_bert: 1.12e-05, max memory: 33.04 GB
07/14/2023 09:09:44 - INFO - __main__ -   ep: 5, step: 1241, lr_swin: 1.11e-05, lr_bert: 1.11e-05, max memory: 33.04 GB
07/14/2023 09:09:48 - INFO - __main__ -   ep: 5, step: 1246, lr_swin: 1.11e-05, lr_bert: 1.11e-05, max memory: 33.04 GB
07/14/2023 09:09:48 - INFO - __main__ -   Ep 4, Loss (train): 7.3122e+01
07/14/2023 09:11:35 - INFO - __main__ -   Ep 4, Acc (val): 50.09, 70.96
07/14/2023 09:15:04 - INFO - __main__ -   Ep 4, Acc (test): 51.25, 73.56
07/14/2023 09:15:07 - INFO - __main__ -   ep: 6, step: 1, lr_swin: 1.11e-05, lr_bert: 1.11e-05, max memory: 33.04 GB
07/14/2023 09:15:23 - INFO - __main__ -   ep: 6, step: 21, lr_swin: 1.11e-05, lr_bert: 1.11e-05, max memory: 33.04 GB
07/14/2023 09:15:38 - INFO - __main__ -   ep: 6, step: 41, lr_swin: 1.10e-05, lr_bert: 1.10e-05, max memory: 33.04 GB
07/14/2023 09:15:53 - INFO - __main__ -   ep: 6, step: 61, lr_swin: 1.10e-05, lr_bert: 1.10e-05, max memory: 33.04 GB
07/14/2023 09:16:09 - INFO - __main__ -   ep: 6, step: 81, lr_swin: 1.10e-05, lr_bert: 1.10e-05, max memory: 33.04 GB
07/14/2023 09:16:24 - INFO - __main__ -   ep: 6, step: 101, lr_swin: 1.09e-05, lr_bert: 1.09e-05, max memory: 33.04 GB
07/14/2023 09:16:39 - INFO - __main__ -   ep: 6, step: 121, lr_swin: 1.09e-05, lr_bert: 1.09e-05, max memory: 33.04 GB
07/14/2023 09:16:55 - INFO - __main__ -   ep: 6, step: 141, lr_swin: 1.09e-05, lr_bert: 1.09e-05, max memory: 33.04 GB
07/14/2023 09:17:10 - INFO - __main__ -   ep: 6, step: 161, lr_swin: 1.08e-05, lr_bert: 1.08e-05, max memory: 33.04 GB
07/14/2023 09:17:25 - INFO - __main__ -   ep: 6, step: 181, lr_swin: 1.08e-05, lr_bert: 1.08e-05, max memory: 33.04 GB
07/14/2023 09:17:40 - INFO - __main__ -   ep: 6, step: 201, lr_swin: 1.08e-05, lr_bert: 1.08e-05, max memory: 33.04 GB
07/14/2023 09:17:56 - INFO - __main__ -   ep: 6, step: 221, lr_swin: 1.07e-05, lr_bert: 1.07e-05, max memory: 33.04 GB
07/14/2023 09:18:11 - INFO - __main__ -   ep: 6, step: 241, lr_swin: 1.07e-05, lr_bert: 1.07e-05, max memory: 33.04 GB
07/14/2023 09:18:26 - INFO - __main__ -   ep: 6, step: 261, lr_swin: 1.06e-05, lr_bert: 1.06e-05, max memory: 33.04 GB
07/14/2023 09:18:42 - INFO - __main__ -   ep: 6, step: 281, lr_swin: 1.06e-05, lr_bert: 1.06e-05, max memory: 33.04 GB
07/14/2023 09:18:57 - INFO - __main__ -   ep: 6, step: 301, lr_swin: 1.06e-05, lr_bert: 1.06e-05, max memory: 33.04 GB
07/14/2023 09:19:12 - INFO - __main__ -   ep: 6, step: 321, lr_swin: 1.05e-05, lr_bert: 1.05e-05, max memory: 33.04 GB
07/14/2023 09:19:28 - INFO - __main__ -   ep: 6, step: 341, lr_swin: 1.05e-05, lr_bert: 1.05e-05, max memory: 33.04 GB
07/14/2023 09:19:43 - INFO - __main__ -   ep: 6, step: 361, lr_swin: 1.05e-05, lr_bert: 1.05e-05, max memory: 33.04 GB
07/14/2023 09:19:58 - INFO - __main__ -   ep: 6, step: 381, lr_swin: 1.04e-05, lr_bert: 1.04e-05, max memory: 33.04 GB
07/14/2023 09:20:13 - INFO - __main__ -   ep: 6, step: 401, lr_swin: 1.04e-05, lr_bert: 1.04e-05, max memory: 33.04 GB
07/14/2023 09:20:29 - INFO - __main__ -   ep: 6, step: 421, lr_swin: 1.04e-05, lr_bert: 1.04e-05, max memory: 33.04 GB
07/14/2023 09:20:44 - INFO - __main__ -   ep: 6, step: 441, lr_swin: 1.03e-05, lr_bert: 1.03e-05, max memory: 33.04 GB
07/14/2023 09:20:59 - INFO - __main__ -   ep: 6, step: 461, lr_swin: 1.03e-05, lr_bert: 1.03e-05, max memory: 33.04 GB
07/14/2023 09:21:15 - INFO - __main__ -   ep: 6, step: 481, lr_swin: 1.03e-05, lr_bert: 1.03e-05, max memory: 33.04 GB
07/14/2023 09:21:30 - INFO - __main__ -   ep: 6, step: 501, lr_swin: 1.02e-05, lr_bert: 1.02e-05, max memory: 33.04 GB
07/14/2023 09:21:45 - INFO - __main__ -   ep: 6, step: 521, lr_swin: 1.02e-05, lr_bert: 1.02e-05, max memory: 33.04 GB
07/14/2023 09:22:01 - INFO - __main__ -   ep: 6, step: 541, lr_swin: 1.01e-05, lr_bert: 1.01e-05, max memory: 33.04 GB
07/14/2023 09:22:16 - INFO - __main__ -   ep: 6, step: 561, lr_swin: 1.01e-05, lr_bert: 1.01e-05, max memory: 33.04 GB
07/14/2023 09:22:31 - INFO - __main__ -   ep: 6, step: 581, lr_swin: 1.01e-05, lr_bert: 1.01e-05, max memory: 33.04 GB
07/14/2023 09:22:46 - INFO - __main__ -   ep: 6, step: 601, lr_swin: 1.00e-05, lr_bert: 1.00e-05, max memory: 33.04 GB
07/14/2023 09:23:02 - INFO - __main__ -   ep: 6, step: 621, lr_swin: 1.00e-05, lr_bert: 1.00e-05, max memory: 33.04 GB
07/14/2023 09:23:17 - INFO - __main__ -   ep: 6, step: 641, lr_swin: 9.97e-06, lr_bert: 9.97e-06, max memory: 33.04 GB
07/14/2023 09:23:32 - INFO - __main__ -   ep: 6, step: 661, lr_swin: 9.93e-06, lr_bert: 9.93e-06, max memory: 33.04 GB
07/14/2023 09:23:48 - INFO - __main__ -   ep: 6, step: 681, lr_swin: 9.90e-06, lr_bert: 9.90e-06, max memory: 33.04 GB
07/14/2023 09:24:03 - INFO - __main__ -   ep: 6, step: 701, lr_swin: 9.86e-06, lr_bert: 9.86e-06, max memory: 33.04 GB
07/14/2023 09:24:18 - INFO - __main__ -   ep: 6, step: 721, lr_swin: 9.83e-06, lr_bert: 9.83e-06, max memory: 33.04 GB
07/14/2023 09:24:33 - INFO - __main__ -   ep: 6, step: 741, lr_swin: 9.79e-06, lr_bert: 9.79e-06, max memory: 33.04 GB
07/14/2023 09:24:49 - INFO - __main__ -   ep: 6, step: 761, lr_swin: 9.76e-06, lr_bert: 9.76e-06, max memory: 33.04 GB
07/14/2023 09:25:04 - INFO - __main__ -   ep: 6, step: 781, lr_swin: 9.72e-06, lr_bert: 9.72e-06, max memory: 33.04 GB
07/14/2023 09:25:19 - INFO - __main__ -   ep: 6, step: 801, lr_swin: 9.68e-06, lr_bert: 9.68e-06, max memory: 33.04 GB
07/14/2023 09:25:35 - INFO - __main__ -   ep: 6, step: 821, lr_swin: 9.65e-06, lr_bert: 9.65e-06, max memory: 33.04 GB
07/14/2023 09:25:50 - INFO - __main__ -   ep: 6, step: 841, lr_swin: 9.61e-06, lr_bert: 9.61e-06, max memory: 33.04 GB
07/14/2023 09:26:05 - INFO - __main__ -   ep: 6, step: 861, lr_swin: 9.58e-06, lr_bert: 9.58e-06, max memory: 33.04 GB
07/14/2023 09:26:21 - INFO - __main__ -   ep: 6, step: 881, lr_swin: 9.54e-06, lr_bert: 9.54e-06, max memory: 33.04 GB
07/14/2023 09:26:36 - INFO - __main__ -   ep: 6, step: 901, lr_swin: 9.51e-06, lr_bert: 9.51e-06, max memory: 33.04 GB
07/14/2023 09:26:51 - INFO - __main__ -   ep: 6, step: 921, lr_swin: 9.47e-06, lr_bert: 9.47e-06, max memory: 33.04 GB
07/14/2023 09:27:07 - INFO - __main__ -   ep: 6, step: 941, lr_swin: 9.43e-06, lr_bert: 9.43e-06, max memory: 33.04 GB
07/14/2023 09:27:22 - INFO - __main__ -   ep: 6, step: 961, lr_swin: 9.40e-06, lr_bert: 9.40e-06, max memory: 33.04 GB
07/14/2023 09:27:37 - INFO - __main__ -   ep: 6, step: 981, lr_swin: 9.36e-06, lr_bert: 9.36e-06, max memory: 33.04 GB
07/14/2023 09:27:52 - INFO - __main__ -   ep: 6, step: 1001, lr_swin: 9.33e-06, lr_bert: 9.33e-06, max memory: 33.04 GB
07/14/2023 09:28:08 - INFO - __main__ -   ep: 6, step: 1021, lr_swin: 9.29e-06, lr_bert: 9.29e-06, max memory: 33.04 GB
07/14/2023 09:28:23 - INFO - __main__ -   ep: 6, step: 1041, lr_swin: 9.26e-06, lr_bert: 9.26e-06, max memory: 33.04 GB
07/14/2023 09:28:38 - INFO - __main__ -   ep: 6, step: 1061, lr_swin: 9.22e-06, lr_bert: 9.22e-06, max memory: 33.04 GB
07/14/2023 09:28:54 - INFO - __main__ -   ep: 6, step: 1081, lr_swin: 9.18e-06, lr_bert: 9.18e-06, max memory: 33.04 GB
07/14/2023 09:29:09 - INFO - __main__ -   ep: 6, step: 1101, lr_swin: 9.15e-06, lr_bert: 9.15e-06, max memory: 33.04 GB
07/14/2023 09:29:24 - INFO - __main__ -   ep: 6, step: 1121, lr_swin: 9.11e-06, lr_bert: 9.11e-06, max memory: 33.04 GB
07/14/2023 09:29:40 - INFO - __main__ -   ep: 6, step: 1141, lr_swin: 9.08e-06, lr_bert: 9.08e-06, max memory: 33.04 GB
07/14/2023 09:29:55 - INFO - __main__ -   ep: 6, step: 1161, lr_swin: 9.04e-06, lr_bert: 9.04e-06, max memory: 33.04 GB
07/14/2023 09:30:10 - INFO - __main__ -   ep: 6, step: 1181, lr_swin: 9.01e-06, lr_bert: 9.01e-06, max memory: 33.04 GB
07/14/2023 09:30:25 - INFO - __main__ -   ep: 6, step: 1201, lr_swin: 8.97e-06, lr_bert: 8.97e-06, max memory: 33.04 GB
07/14/2023 09:30:41 - INFO - __main__ -   ep: 6, step: 1221, lr_swin: 8.94e-06, lr_bert: 8.94e-06, max memory: 33.04 GB
07/14/2023 09:30:56 - INFO - __main__ -   ep: 6, step: 1241, lr_swin: 8.90e-06, lr_bert: 8.90e-06, max memory: 33.04 GB
07/14/2023 09:31:00 - INFO - __main__ -   ep: 6, step: 1246, lr_swin: 8.89e-06, lr_bert: 8.89e-06, max memory: 33.04 GB
07/14/2023 09:31:00 - INFO - __main__ -   Ep 5, Loss (train): 6.1566e+01
07/14/2023 09:32:46 - INFO - __main__ -   Ep 5, Acc (val): 50.43, 71.58
07/14/2023 09:36:15 - INFO - __main__ -   Ep 5, Acc (test): 51.33, 74.17
07/14/2023 09:36:19 - INFO - __main__ -   ep: 7, step: 1, lr_swin: 8.89e-06, lr_bert: 8.89e-06, max memory: 33.04 GB
07/14/2023 09:36:34 - INFO - __main__ -   ep: 7, step: 21, lr_swin: 8.85e-06, lr_bert: 8.85e-06, max memory: 33.04 GB
07/14/2023 09:36:50 - INFO - __main__ -   ep: 7, step: 41, lr_swin: 8.82e-06, lr_bert: 8.82e-06, max memory: 33.04 GB
07/14/2023 09:37:05 - INFO - __main__ -   ep: 7, step: 61, lr_swin: 8.78e-06, lr_bert: 8.78e-06, max memory: 33.04 GB
07/14/2023 09:37:20 - INFO - __main__ -   ep: 7, step: 81, lr_swin: 8.75e-06, lr_bert: 8.75e-06, max memory: 33.04 GB
07/14/2023 09:37:36 - INFO - __main__ -   ep: 7, step: 101, lr_swin: 8.71e-06, lr_bert: 8.71e-06, max memory: 33.04 GB
07/14/2023 09:37:51 - INFO - __main__ -   ep: 7, step: 121, lr_swin: 8.67e-06, lr_bert: 8.67e-06, max memory: 33.04 GB
07/14/2023 09:38:06 - INFO - __main__ -   ep: 7, step: 141, lr_swin: 8.64e-06, lr_bert: 8.64e-06, max memory: 33.04 GB
07/14/2023 09:38:22 - INFO - __main__ -   ep: 7, step: 161, lr_swin: 8.60e-06, lr_bert: 8.60e-06, max memory: 33.04 GB
07/14/2023 09:38:37 - INFO - __main__ -   ep: 7, step: 181, lr_swin: 8.57e-06, lr_bert: 8.57e-06, max memory: 33.04 GB
07/14/2023 09:38:52 - INFO - __main__ -   ep: 7, step: 201, lr_swin: 8.53e-06, lr_bert: 8.53e-06, max memory: 33.04 GB
07/14/2023 09:39:08 - INFO - __main__ -   ep: 7, step: 221, lr_swin: 8.50e-06, lr_bert: 8.50e-06, max memory: 33.04 GB
07/14/2023 09:39:23 - INFO - __main__ -   ep: 7, step: 241, lr_swin: 8.46e-06, lr_bert: 8.46e-06, max memory: 33.04 GB
07/14/2023 09:39:38 - INFO - __main__ -   ep: 7, step: 261, lr_swin: 8.43e-06, lr_bert: 8.43e-06, max memory: 33.04 GB
07/14/2023 09:39:53 - INFO - __main__ -   ep: 7, step: 281, lr_swin: 8.39e-06, lr_bert: 8.39e-06, max memory: 33.04 GB
07/14/2023 09:40:09 - INFO - __main__ -   ep: 7, step: 301, lr_swin: 8.35e-06, lr_bert: 8.35e-06, max memory: 33.04 GB
07/14/2023 09:40:24 - INFO - __main__ -   ep: 7, step: 321, lr_swin: 8.32e-06, lr_bert: 8.32e-06, max memory: 33.04 GB
07/14/2023 09:40:39 - INFO - __main__ -   ep: 7, step: 341, lr_swin: 8.28e-06, lr_bert: 8.28e-06, max memory: 33.04 GB
07/14/2023 09:40:55 - INFO - __main__ -   ep: 7, step: 361, lr_swin: 8.25e-06, lr_bert: 8.25e-06, max memory: 33.04 GB
07/14/2023 09:41:10 - INFO - __main__ -   ep: 7, step: 381, lr_swin: 8.21e-06, lr_bert: 8.21e-06, max memory: 33.04 GB
07/14/2023 09:41:25 - INFO - __main__ -   ep: 7, step: 401, lr_swin: 8.18e-06, lr_bert: 8.18e-06, max memory: 33.04 GB
07/14/2023 09:41:41 - INFO - __main__ -   ep: 7, step: 421, lr_swin: 8.14e-06, lr_bert: 8.14e-06, max memory: 33.04 GB
07/14/2023 09:41:56 - INFO - __main__ -   ep: 7, step: 441, lr_swin: 8.10e-06, lr_bert: 8.10e-06, max memory: 33.04 GB
07/14/2023 09:42:11 - INFO - __main__ -   ep: 7, step: 461, lr_swin: 8.07e-06, lr_bert: 8.07e-06, max memory: 33.04 GB
07/14/2023 09:42:27 - INFO - __main__ -   ep: 7, step: 481, lr_swin: 8.03e-06, lr_bert: 8.03e-06, max memory: 33.04 GB
07/14/2023 09:42:42 - INFO - __main__ -   ep: 7, step: 501, lr_swin: 8.00e-06, lr_bert: 8.00e-06, max memory: 33.04 GB
07/14/2023 09:42:57 - INFO - __main__ -   ep: 7, step: 521, lr_swin: 7.96e-06, lr_bert: 7.96e-06, max memory: 33.04 GB
07/14/2023 09:43:12 - INFO - __main__ -   ep: 7, step: 541, lr_swin: 7.93e-06, lr_bert: 7.93e-06, max memory: 33.04 GB
07/14/2023 09:43:28 - INFO - __main__ -   ep: 7, step: 561, lr_swin: 7.89e-06, lr_bert: 7.89e-06, max memory: 33.04 GB
07/14/2023 09:43:43 - INFO - __main__ -   ep: 7, step: 581, lr_swin: 7.85e-06, lr_bert: 7.85e-06, max memory: 33.04 GB
07/14/2023 09:43:58 - INFO - __main__ -   ep: 7, step: 601, lr_swin: 7.82e-06, lr_bert: 7.82e-06, max memory: 33.04 GB
07/14/2023 09:44:14 - INFO - __main__ -   ep: 7, step: 621, lr_swin: 7.78e-06, lr_bert: 7.78e-06, max memory: 33.04 GB
07/14/2023 09:44:29 - INFO - __main__ -   ep: 7, step: 641, lr_swin: 7.75e-06, lr_bert: 7.75e-06, max memory: 33.04 GB
07/14/2023 09:44:44 - INFO - __main__ -   ep: 7, step: 661, lr_swin: 7.71e-06, lr_bert: 7.71e-06, max memory: 33.04 GB
07/14/2023 09:44:59 - INFO - __main__ -   ep: 7, step: 681, lr_swin: 7.68e-06, lr_bert: 7.68e-06, max memory: 33.04 GB
07/14/2023 09:45:15 - INFO - __main__ -   ep: 7, step: 701, lr_swin: 7.64e-06, lr_bert: 7.64e-06, max memory: 33.04 GB
07/14/2023 09:45:30 - INFO - __main__ -   ep: 7, step: 721, lr_swin: 7.60e-06, lr_bert: 7.60e-06, max memory: 33.04 GB
07/14/2023 09:45:45 - INFO - __main__ -   ep: 7, step: 741, lr_swin: 7.57e-06, lr_bert: 7.57e-06, max memory: 33.04 GB
07/14/2023 09:46:01 - INFO - __main__ -   ep: 7, step: 761, lr_swin: 7.53e-06, lr_bert: 7.53e-06, max memory: 33.04 GB
07/14/2023 09:46:16 - INFO - __main__ -   ep: 7, step: 781, lr_swin: 7.50e-06, lr_bert: 7.50e-06, max memory: 33.04 GB
07/14/2023 09:46:31 - INFO - __main__ -   ep: 7, step: 801, lr_swin: 7.46e-06, lr_bert: 7.46e-06, max memory: 33.04 GB
07/14/2023 09:46:47 - INFO - __main__ -   ep: 7, step: 821, lr_swin: 7.43e-06, lr_bert: 7.43e-06, max memory: 33.04 GB
07/14/2023 09:47:02 - INFO - __main__ -   ep: 7, step: 841, lr_swin: 7.39e-06, lr_bert: 7.39e-06, max memory: 33.04 GB
07/14/2023 09:47:17 - INFO - __main__ -   ep: 7, step: 861, lr_swin: 7.36e-06, lr_bert: 7.36e-06, max memory: 33.04 GB
07/14/2023 09:47:32 - INFO - __main__ -   ep: 7, step: 881, lr_swin: 7.32e-06, lr_bert: 7.32e-06, max memory: 33.04 GB
07/14/2023 09:47:48 - INFO - __main__ -   ep: 7, step: 901, lr_swin: 7.28e-06, lr_bert: 7.28e-06, max memory: 33.04 GB
07/14/2023 09:48:03 - INFO - __main__ -   ep: 7, step: 921, lr_swin: 7.25e-06, lr_bert: 7.25e-06, max memory: 33.04 GB
07/14/2023 09:48:18 - INFO - __main__ -   ep: 7, step: 941, lr_swin: 7.21e-06, lr_bert: 7.21e-06, max memory: 33.04 GB
07/14/2023 09:48:34 - INFO - __main__ -   ep: 7, step: 961, lr_swin: 7.18e-06, lr_bert: 7.18e-06, max memory: 33.04 GB
07/14/2023 09:48:49 - INFO - __main__ -   ep: 7, step: 981, lr_swin: 7.14e-06, lr_bert: 7.14e-06, max memory: 33.04 GB
07/14/2023 09:49:04 - INFO - __main__ -   ep: 7, step: 1001, lr_swin: 7.11e-06, lr_bert: 7.11e-06, max memory: 33.04 GB
07/14/2023 09:49:20 - INFO - __main__ -   ep: 7, step: 1021, lr_swin: 7.07e-06, lr_bert: 7.07e-06, max memory: 33.04 GB
07/14/2023 09:49:35 - INFO - __main__ -   ep: 7, step: 1041, lr_swin: 7.03e-06, lr_bert: 7.03e-06, max memory: 33.04 GB
07/14/2023 09:49:50 - INFO - __main__ -   ep: 7, step: 1061, lr_swin: 7.00e-06, lr_bert: 7.00e-06, max memory: 33.04 GB
07/14/2023 09:50:05 - INFO - __main__ -   ep: 7, step: 1081, lr_swin: 6.96e-06, lr_bert: 6.96e-06, max memory: 33.04 GB
07/14/2023 09:50:21 - INFO - __main__ -   ep: 7, step: 1101, lr_swin: 6.93e-06, lr_bert: 6.93e-06, max memory: 33.04 GB
07/14/2023 09:50:36 - INFO - __main__ -   ep: 7, step: 1121, lr_swin: 6.89e-06, lr_bert: 6.89e-06, max memory: 33.04 GB
07/14/2023 09:50:51 - INFO - __main__ -   ep: 7, step: 1141, lr_swin: 6.86e-06, lr_bert: 6.86e-06, max memory: 33.04 GB
07/14/2023 09:51:07 - INFO - __main__ -   ep: 7, step: 1161, lr_swin: 6.82e-06, lr_bert: 6.82e-06, max memory: 33.04 GB
07/14/2023 09:51:22 - INFO - __main__ -   ep: 7, step: 1181, lr_swin: 6.78e-06, lr_bert: 6.78e-06, max memory: 33.04 GB
07/14/2023 09:51:37 - INFO - __main__ -   ep: 7, step: 1201, lr_swin: 6.75e-06, lr_bert: 6.75e-06, max memory: 33.04 GB
07/14/2023 09:51:52 - INFO - __main__ -   ep: 7, step: 1221, lr_swin: 6.71e-06, lr_bert: 6.71e-06, max memory: 33.04 GB
07/14/2023 09:52:08 - INFO - __main__ -   ep: 7, step: 1241, lr_swin: 6.68e-06, lr_bert: 6.68e-06, max memory: 33.04 GB
07/14/2023 09:52:12 - INFO - __main__ -   ep: 7, step: 1246, lr_swin: 6.67e-06, lr_bert: 6.67e-06, max memory: 33.04 GB
07/14/2023 09:52:12 - INFO - __main__ -   Ep 6, Loss (train): 5.1949e+01
07/14/2023 09:53:59 - INFO - __main__ -   Ep 6, Acc (val): 49.62, 71.21
07/14/2023 09:57:30 - INFO - __main__ -   Ep 6, Acc (test): 50.70, 73.87
07/14/2023 09:57:34 - INFO - __main__ -   ep: 8, step: 1, lr_swin: 6.67e-06, lr_bert: 6.67e-06, max memory: 33.04 GB
07/14/2023 09:57:49 - INFO - __main__ -   ep: 8, step: 21, lr_swin: 6.63e-06, lr_bert: 6.63e-06, max memory: 33.04 GB
07/14/2023 09:58:05 - INFO - __main__ -   ep: 8, step: 41, lr_swin: 6.60e-06, lr_bert: 6.60e-06, max memory: 33.04 GB
07/14/2023 09:58:20 - INFO - __main__ -   ep: 8, step: 61, lr_swin: 6.56e-06, lr_bert: 6.56e-06, max memory: 33.04 GB
07/14/2023 09:58:35 - INFO - __main__ -   ep: 8, step: 81, lr_swin: 6.52e-06, lr_bert: 6.52e-06, max memory: 33.04 GB
07/14/2023 09:58:51 - INFO - __main__ -   ep: 8, step: 101, lr_swin: 6.49e-06, lr_bert: 6.49e-06, max memory: 33.04 GB
07/14/2023 09:59:06 - INFO - __main__ -   ep: 8, step: 121, lr_swin: 6.45e-06, lr_bert: 6.45e-06, max memory: 33.04 GB
07/14/2023 09:59:21 - INFO - __main__ -   ep: 8, step: 141, lr_swin: 6.42e-06, lr_bert: 6.42e-06, max memory: 33.04 GB
07/14/2023 09:59:36 - INFO - __main__ -   ep: 8, step: 161, lr_swin: 6.38e-06, lr_bert: 6.38e-06, max memory: 33.04 GB
07/14/2023 09:59:52 - INFO - __main__ -   ep: 8, step: 181, lr_swin: 6.35e-06, lr_bert: 6.35e-06, max memory: 33.04 GB
07/14/2023 10:00:07 - INFO - __main__ -   ep: 8, step: 201, lr_swin: 6.31e-06, lr_bert: 6.31e-06, max memory: 33.04 GB
07/14/2023 10:00:22 - INFO - __main__ -   ep: 8, step: 221, lr_swin: 6.27e-06, lr_bert: 6.27e-06, max memory: 33.04 GB
07/14/2023 10:00:38 - INFO - __main__ -   ep: 8, step: 241, lr_swin: 6.24e-06, lr_bert: 6.24e-06, max memory: 33.04 GB
07/14/2023 10:00:53 - INFO - __main__ -   ep: 8, step: 261, lr_swin: 6.20e-06, lr_bert: 6.20e-06, max memory: 33.04 GB
07/14/2023 10:01:08 - INFO - __main__ -   ep: 8, step: 281, lr_swin: 6.17e-06, lr_bert: 6.17e-06, max memory: 33.04 GB
07/14/2023 10:01:23 - INFO - __main__ -   ep: 8, step: 301, lr_swin: 6.13e-06, lr_bert: 6.13e-06, max memory: 33.04 GB
07/14/2023 10:01:39 - INFO - __main__ -   ep: 8, step: 321, lr_swin: 6.10e-06, lr_bert: 6.10e-06, max memory: 33.04 GB
07/14/2023 10:01:54 - INFO - __main__ -   ep: 8, step: 341, lr_swin: 6.06e-06, lr_bert: 6.06e-06, max memory: 33.04 GB
07/14/2023 10:02:09 - INFO - __main__ -   ep: 8, step: 361, lr_swin: 6.02e-06, lr_bert: 6.02e-06, max memory: 33.04 GB
07/14/2023 10:02:25 - INFO - __main__ -   ep: 8, step: 381, lr_swin: 5.99e-06, lr_bert: 5.99e-06, max memory: 33.04 GB
07/14/2023 10:02:40 - INFO - __main__ -   ep: 8, step: 401, lr_swin: 5.95e-06, lr_bert: 5.95e-06, max memory: 33.04 GB
07/14/2023 10:02:55 - INFO - __main__ -   ep: 8, step: 421, lr_swin: 5.92e-06, lr_bert: 5.92e-06, max memory: 33.04 GB
07/14/2023 10:03:10 - INFO - __main__ -   ep: 8, step: 441, lr_swin: 5.88e-06, lr_bert: 5.88e-06, max memory: 33.04 GB
07/14/2023 10:03:26 - INFO - __main__ -   ep: 8, step: 461, lr_swin: 5.85e-06, lr_bert: 5.85e-06, max memory: 33.04 GB
07/14/2023 10:03:41 - INFO - __main__ -   ep: 8, step: 481, lr_swin: 5.81e-06, lr_bert: 5.81e-06, max memory: 33.04 GB
07/14/2023 10:03:56 - INFO - __main__ -   ep: 8, step: 501, lr_swin: 5.77e-06, lr_bert: 5.77e-06, max memory: 33.04 GB
07/14/2023 10:04:12 - INFO - __main__ -   ep: 8, step: 521, lr_swin: 5.74e-06, lr_bert: 5.74e-06, max memory: 33.04 GB
07/14/2023 10:04:27 - INFO - __main__ -   ep: 8, step: 541, lr_swin: 5.70e-06, lr_bert: 5.70e-06, max memory: 33.04 GB
07/14/2023 10:04:42 - INFO - __main__ -   ep: 8, step: 561, lr_swin: 5.67e-06, lr_bert: 5.67e-06, max memory: 33.04 GB
07/14/2023 10:04:57 - INFO - __main__ -   ep: 8, step: 581, lr_swin: 5.63e-06, lr_bert: 5.63e-06, max memory: 33.04 GB
07/14/2023 10:05:13 - INFO - __main__ -   ep: 8, step: 601, lr_swin: 5.60e-06, lr_bert: 5.60e-06, max memory: 33.04 GB
07/14/2023 10:05:28 - INFO - __main__ -   ep: 8, step: 621, lr_swin: 5.56e-06, lr_bert: 5.56e-06, max memory: 33.04 GB
07/14/2023 10:05:43 - INFO - __main__ -   ep: 8, step: 641, lr_swin: 5.53e-06, lr_bert: 5.53e-06, max memory: 33.04 GB
07/14/2023 10:05:59 - INFO - __main__ -   ep: 8, step: 661, lr_swin: 5.49e-06, lr_bert: 5.49e-06, max memory: 33.04 GB
07/14/2023 10:06:14 - INFO - __main__ -   ep: 8, step: 681, lr_swin: 5.45e-06, lr_bert: 5.45e-06, max memory: 33.04 GB
07/14/2023 10:06:29 - INFO - __main__ -   ep: 8, step: 701, lr_swin: 5.42e-06, lr_bert: 5.42e-06, max memory: 33.04 GB
07/14/2023 10:06:44 - INFO - __main__ -   ep: 8, step: 721, lr_swin: 5.38e-06, lr_bert: 5.38e-06, max memory: 33.04 GB
07/14/2023 10:07:00 - INFO - __main__ -   ep: 8, step: 741, lr_swin: 5.35e-06, lr_bert: 5.35e-06, max memory: 33.04 GB
07/14/2023 10:07:15 - INFO - __main__ -   ep: 8, step: 761, lr_swin: 5.31e-06, lr_bert: 5.31e-06, max memory: 33.04 GB
07/14/2023 10:07:30 - INFO - __main__ -   ep: 8, step: 781, lr_swin: 5.28e-06, lr_bert: 5.28e-06, max memory: 33.04 GB
07/14/2023 10:07:46 - INFO - __main__ -   ep: 8, step: 801, lr_swin: 5.24e-06, lr_bert: 5.24e-06, max memory: 33.04 GB
07/14/2023 10:08:01 - INFO - __main__ -   ep: 8, step: 821, lr_swin: 5.20e-06, lr_bert: 5.20e-06, max memory: 33.04 GB
07/14/2023 10:08:16 - INFO - __main__ -   ep: 8, step: 841, lr_swin: 5.17e-06, lr_bert: 5.17e-06, max memory: 33.04 GB
07/14/2023 10:08:31 - INFO - __main__ -   ep: 8, step: 861, lr_swin: 5.13e-06, lr_bert: 5.13e-06, max memory: 33.04 GB
07/14/2023 10:08:47 - INFO - __main__ -   ep: 8, step: 881, lr_swin: 5.10e-06, lr_bert: 5.10e-06, max memory: 33.04 GB
07/14/2023 10:09:02 - INFO - __main__ -   ep: 8, step: 901, lr_swin: 5.06e-06, lr_bert: 5.06e-06, max memory: 33.04 GB
07/14/2023 10:09:17 - INFO - __main__ -   ep: 8, step: 921, lr_swin: 5.03e-06, lr_bert: 5.03e-06, max memory: 33.04 GB
07/14/2023 10:09:33 - INFO - __main__ -   ep: 8, step: 941, lr_swin: 4.99e-06, lr_bert: 4.99e-06, max memory: 33.04 GB
07/14/2023 10:09:48 - INFO - __main__ -   ep: 8, step: 961, lr_swin: 4.95e-06, lr_bert: 4.95e-06, max memory: 33.04 GB
07/14/2023 10:10:03 - INFO - __main__ -   ep: 8, step: 981, lr_swin: 4.92e-06, lr_bert: 4.92e-06, max memory: 33.04 GB
07/14/2023 10:10:18 - INFO - __main__ -   ep: 8, step: 1001, lr_swin: 4.88e-06, lr_bert: 4.88e-06, max memory: 33.04 GB
07/14/2023 10:10:34 - INFO - __main__ -   ep: 8, step: 1021, lr_swin: 4.85e-06, lr_bert: 4.85e-06, max memory: 33.04 GB
07/14/2023 10:10:49 - INFO - __main__ -   ep: 8, step: 1041, lr_swin: 4.81e-06, lr_bert: 4.81e-06, max memory: 33.04 GB
07/14/2023 10:11:04 - INFO - __main__ -   ep: 8, step: 1061, lr_swin: 4.78e-06, lr_bert: 4.78e-06, max memory: 33.04 GB
07/14/2023 10:11:19 - INFO - __main__ -   ep: 8, step: 1081, lr_swin: 4.74e-06, lr_bert: 4.74e-06, max memory: 33.04 GB
07/14/2023 10:11:35 - INFO - __main__ -   ep: 8, step: 1101, lr_swin: 4.70e-06, lr_bert: 4.70e-06, max memory: 33.04 GB
07/14/2023 10:11:50 - INFO - __main__ -   ep: 8, step: 1121, lr_swin: 4.67e-06, lr_bert: 4.67e-06, max memory: 33.04 GB
07/14/2023 10:12:05 - INFO - __main__ -   ep: 8, step: 1141, lr_swin: 4.63e-06, lr_bert: 4.63e-06, max memory: 33.04 GB
07/14/2023 10:12:21 - INFO - __main__ -   ep: 8, step: 1161, lr_swin: 4.60e-06, lr_bert: 4.60e-06, max memory: 33.04 GB
07/14/2023 10:12:36 - INFO - __main__ -   ep: 8, step: 1181, lr_swin: 4.56e-06, lr_bert: 4.56e-06, max memory: 33.04 GB
07/14/2023 10:12:51 - INFO - __main__ -   ep: 8, step: 1201, lr_swin: 4.53e-06, lr_bert: 4.53e-06, max memory: 33.04 GB
07/14/2023 10:13:06 - INFO - __main__ -   ep: 8, step: 1221, lr_swin: 4.49e-06, lr_bert: 4.49e-06, max memory: 33.04 GB
07/14/2023 10:13:22 - INFO - __main__ -   ep: 8, step: 1241, lr_swin: 4.46e-06, lr_bert: 4.46e-06, max memory: 33.04 GB
07/14/2023 10:13:26 - INFO - __main__ -   ep: 8, step: 1246, lr_swin: 4.44e-06, lr_bert: 4.44e-06, max memory: 33.04 GB
07/14/2023 10:13:26 - INFO - __main__ -   Ep 7, Loss (train): 4.4182e+01
07/14/2023 10:15:13 - INFO - __main__ -   Ep 7, Acc (val): 50.40, 70.96
07/14/2023 10:18:43 - INFO - __main__ -   Ep 7, Acc (test): 51.94, 73.89
07/14/2023 10:18:47 - INFO - __main__ -   ep: 9, step: 1, lr_swin: 4.44e-06, lr_bert: 4.44e-06, max memory: 33.04 GB
07/14/2023 10:19:02 - INFO - __main__ -   ep: 9, step: 21, lr_swin: 4.41e-06, lr_bert: 4.41e-06, max memory: 33.04 GB
07/14/2023 10:19:18 - INFO - __main__ -   ep: 9, step: 41, lr_swin: 4.37e-06, lr_bert: 4.37e-06, max memory: 33.04 GB
07/14/2023 10:19:33 - INFO - __main__ -   ep: 9, step: 61, lr_swin: 4.34e-06, lr_bert: 4.34e-06, max memory: 33.04 GB
07/14/2023 10:19:48 - INFO - __main__ -   ep: 9, step: 81, lr_swin: 4.30e-06, lr_bert: 4.30e-06, max memory: 33.04 GB
07/14/2023 10:20:04 - INFO - __main__ -   ep: 9, step: 101, lr_swin: 4.27e-06, lr_bert: 4.27e-06, max memory: 33.04 GB
07/14/2023 10:20:19 - INFO - __main__ -   ep: 9, step: 121, lr_swin: 4.23e-06, lr_bert: 4.23e-06, max memory: 33.04 GB
07/14/2023 10:20:34 - INFO - __main__ -   ep: 9, step: 141, lr_swin: 4.19e-06, lr_bert: 4.19e-06, max memory: 33.04 GB
07/14/2023 10:20:49 - INFO - __main__ -   ep: 9, step: 161, lr_swin: 4.16e-06, lr_bert: 4.16e-06, max memory: 33.04 GB
07/14/2023 10:21:05 - INFO - __main__ -   ep: 9, step: 181, lr_swin: 4.12e-06, lr_bert: 4.12e-06, max memory: 33.04 GB
07/14/2023 10:21:20 - INFO - __main__ -   ep: 9, step: 201, lr_swin: 4.09e-06, lr_bert: 4.09e-06, max memory: 33.04 GB
07/14/2023 10:21:35 - INFO - __main__ -   ep: 9, step: 221, lr_swin: 4.05e-06, lr_bert: 4.05e-06, max memory: 33.04 GB
07/14/2023 10:21:51 - INFO - __main__ -   ep: 9, step: 241, lr_swin: 4.02e-06, lr_bert: 4.02e-06, max memory: 33.04 GB
07/14/2023 10:22:06 - INFO - __main__ -   ep: 9, step: 261, lr_swin: 3.98e-06, lr_bert: 3.98e-06, max memory: 33.04 GB
07/14/2023 10:22:21 - INFO - __main__ -   ep: 9, step: 281, lr_swin: 3.95e-06, lr_bert: 3.95e-06, max memory: 33.04 GB
07/14/2023 10:22:37 - INFO - __main__ -   ep: 9, step: 301, lr_swin: 3.91e-06, lr_bert: 3.91e-06, max memory: 33.04 GB
07/14/2023 10:22:52 - INFO - __main__ -   ep: 9, step: 321, lr_swin: 3.87e-06, lr_bert: 3.87e-06, max memory: 33.04 GB
07/14/2023 10:23:07 - INFO - __main__ -   ep: 9, step: 341, lr_swin: 3.84e-06, lr_bert: 3.84e-06, max memory: 33.04 GB
07/14/2023 10:23:22 - INFO - __main__ -   ep: 9, step: 361, lr_swin: 3.80e-06, lr_bert: 3.80e-06, max memory: 33.04 GB
07/14/2023 10:23:38 - INFO - __main__ -   ep: 9, step: 381, lr_swin: 3.77e-06, lr_bert: 3.77e-06, max memory: 33.04 GB
07/14/2023 10:23:53 - INFO - __main__ -   ep: 9, step: 401, lr_swin: 3.73e-06, lr_bert: 3.73e-06, max memory: 33.04 GB
07/14/2023 10:24:08 - INFO - __main__ -   ep: 9, step: 421, lr_swin: 3.70e-06, lr_bert: 3.70e-06, max memory: 33.04 GB
07/14/2023 10:24:24 - INFO - __main__ -   ep: 9, step: 441, lr_swin: 3.66e-06, lr_bert: 3.66e-06, max memory: 33.04 GB
07/14/2023 10:24:39 - INFO - __main__ -   ep: 9, step: 461, lr_swin: 3.62e-06, lr_bert: 3.62e-06, max memory: 33.04 GB
07/14/2023 10:24:54 - INFO - __main__ -   ep: 9, step: 481, lr_swin: 3.59e-06, lr_bert: 3.59e-06, max memory: 33.04 GB
07/14/2023 10:25:09 - INFO - __main__ -   ep: 9, step: 501, lr_swin: 3.55e-06, lr_bert: 3.55e-06, max memory: 33.04 GB
07/14/2023 10:25:25 - INFO - __main__ -   ep: 9, step: 521, lr_swin: 3.52e-06, lr_bert: 3.52e-06, max memory: 33.04 GB
07/14/2023 10:25:40 - INFO - __main__ -   ep: 9, step: 541, lr_swin: 3.48e-06, lr_bert: 3.48e-06, max memory: 33.04 GB
07/14/2023 10:25:55 - INFO - __main__ -   ep: 9, step: 561, lr_swin: 3.45e-06, lr_bert: 3.45e-06, max memory: 33.04 GB
07/14/2023 10:26:11 - INFO - __main__ -   ep: 9, step: 581, lr_swin: 3.41e-06, lr_bert: 3.41e-06, max memory: 33.04 GB
07/14/2023 10:26:26 - INFO - __main__ -   ep: 9, step: 601, lr_swin: 3.37e-06, lr_bert: 3.37e-06, max memory: 33.04 GB
07/14/2023 10:26:41 - INFO - __main__ -   ep: 9, step: 621, lr_swin: 3.34e-06, lr_bert: 3.34e-06, max memory: 33.04 GB
07/14/2023 10:26:56 - INFO - __main__ -   ep: 9, step: 641, lr_swin: 3.30e-06, lr_bert: 3.30e-06, max memory: 33.04 GB
07/14/2023 10:27:12 - INFO - __main__ -   ep: 9, step: 661, lr_swin: 3.27e-06, lr_bert: 3.27e-06, max memory: 33.04 GB
07/14/2023 10:27:27 - INFO - __main__ -   ep: 9, step: 681, lr_swin: 3.23e-06, lr_bert: 3.23e-06, max memory: 33.04 GB
07/14/2023 10:27:42 - INFO - __main__ -   ep: 9, step: 701, lr_swin: 3.20e-06, lr_bert: 3.20e-06, max memory: 33.04 GB
07/14/2023 10:27:58 - INFO - __main__ -   ep: 9, step: 721, lr_swin: 3.16e-06, lr_bert: 3.16e-06, max memory: 33.04 GB
07/14/2023 10:28:13 - INFO - __main__ -   ep: 9, step: 741, lr_swin: 3.12e-06, lr_bert: 3.12e-06, max memory: 33.04 GB
07/14/2023 10:28:28 - INFO - __main__ -   ep: 9, step: 761, lr_swin: 3.09e-06, lr_bert: 3.09e-06, max memory: 33.04 GB
07/14/2023 10:28:43 - INFO - __main__ -   ep: 9, step: 781, lr_swin: 3.05e-06, lr_bert: 3.05e-06, max memory: 33.04 GB
07/14/2023 10:28:59 - INFO - __main__ -   ep: 9, step: 801, lr_swin: 3.02e-06, lr_bert: 3.02e-06, max memory: 33.04 GB
07/14/2023 10:29:14 - INFO - __main__ -   ep: 9, step: 821, lr_swin: 2.98e-06, lr_bert: 2.98e-06, max memory: 33.04 GB
07/14/2023 10:29:29 - INFO - __main__ -   ep: 9, step: 841, lr_swin: 2.95e-06, lr_bert: 2.95e-06, max memory: 33.04 GB
07/14/2023 10:29:45 - INFO - __main__ -   ep: 9, step: 861, lr_swin: 2.91e-06, lr_bert: 2.91e-06, max memory: 33.04 GB
07/14/2023 10:30:00 - INFO - __main__ -   ep: 9, step: 881, lr_swin: 2.87e-06, lr_bert: 2.87e-06, max memory: 33.04 GB
07/14/2023 10:30:15 - INFO - __main__ -   ep: 9, step: 901, lr_swin: 2.84e-06, lr_bert: 2.84e-06, max memory: 33.04 GB
07/14/2023 10:30:30 - INFO - __main__ -   ep: 9, step: 921, lr_swin: 2.80e-06, lr_bert: 2.80e-06, max memory: 33.04 GB
07/14/2023 10:30:46 - INFO - __main__ -   ep: 9, step: 941, lr_swin: 2.77e-06, lr_bert: 2.77e-06, max memory: 33.04 GB
07/14/2023 10:31:01 - INFO - __main__ -   ep: 9, step: 961, lr_swin: 2.73e-06, lr_bert: 2.73e-06, max memory: 33.04 GB
07/14/2023 10:31:16 - INFO - __main__ -   ep: 9, step: 981, lr_swin: 2.70e-06, lr_bert: 2.70e-06, max memory: 33.04 GB
07/14/2023 10:31:32 - INFO - __main__ -   ep: 9, step: 1001, lr_swin: 2.66e-06, lr_bert: 2.66e-06, max memory: 33.04 GB
07/14/2023 10:31:47 - INFO - __main__ -   ep: 9, step: 1021, lr_swin: 2.63e-06, lr_bert: 2.63e-06, max memory: 33.04 GB
07/14/2023 10:32:02 - INFO - __main__ -   ep: 9, step: 1041, lr_swin: 2.59e-06, lr_bert: 2.59e-06, max memory: 33.04 GB
07/14/2023 10:32:17 - INFO - __main__ -   ep: 9, step: 1061, lr_swin: 2.55e-06, lr_bert: 2.55e-06, max memory: 33.04 GB
07/14/2023 10:32:33 - INFO - __main__ -   ep: 9, step: 1081, lr_swin: 2.52e-06, lr_bert: 2.52e-06, max memory: 33.04 GB
07/14/2023 10:32:48 - INFO - __main__ -   ep: 9, step: 1101, lr_swin: 2.48e-06, lr_bert: 2.48e-06, max memory: 33.04 GB
07/14/2023 10:33:03 - INFO - __main__ -   ep: 9, step: 1121, lr_swin: 2.45e-06, lr_bert: 2.45e-06, max memory: 33.04 GB
07/14/2023 10:33:19 - INFO - __main__ -   ep: 9, step: 1141, lr_swin: 2.41e-06, lr_bert: 2.41e-06, max memory: 33.04 GB
07/14/2023 10:33:34 - INFO - __main__ -   ep: 9, step: 1161, lr_swin: 2.38e-06, lr_bert: 2.38e-06, max memory: 33.04 GB
07/14/2023 10:33:49 - INFO - __main__ -   ep: 9, step: 1181, lr_swin: 2.34e-06, lr_bert: 2.34e-06, max memory: 33.04 GB
07/14/2023 10:34:04 - INFO - __main__ -   ep: 9, step: 1201, lr_swin: 2.30e-06, lr_bert: 2.30e-06, max memory: 33.04 GB
07/14/2023 10:34:20 - INFO - __main__ -   ep: 9, step: 1221, lr_swin: 2.27e-06, lr_bert: 2.27e-06, max memory: 33.04 GB
07/14/2023 10:34:35 - INFO - __main__ -   ep: 9, step: 1241, lr_swin: 2.23e-06, lr_bert: 2.23e-06, max memory: 33.04 GB
07/14/2023 10:34:39 - INFO - __main__ -   ep: 9, step: 1246, lr_swin: 2.22e-06, lr_bert: 2.22e-06, max memory: 33.04 GB
07/14/2023 10:34:39 - INFO - __main__ -   Ep 8, Loss (train): 3.8237e+01
07/14/2023 10:36:25 - INFO - __main__ -   Ep 8, Acc (val): 50.12, 70.76
07/14/2023 10:39:54 - INFO - __main__ -   Ep 8, Acc (test): 51.05, 73.46
07/14/2023 10:39:57 - INFO - __main__ -   ep: 10, step: 1, lr_swin: 2.22e-06, lr_bert: 2.22e-06, max memory: 33.04 GB
07/14/2023 10:40:13 - INFO - __main__ -   ep: 10, step: 21, lr_swin: 2.19e-06, lr_bert: 2.19e-06, max memory: 33.04 GB
07/14/2023 10:40:28 - INFO - __main__ -   ep: 10, step: 41, lr_swin: 2.15e-06, lr_bert: 2.15e-06, max memory: 33.04 GB
07/14/2023 10:40:43 - INFO - __main__ -   ep: 10, step: 61, lr_swin: 2.12e-06, lr_bert: 2.12e-06, max memory: 33.04 GB
07/14/2023 10:40:58 - INFO - __main__ -   ep: 10, step: 81, lr_swin: 2.08e-06, lr_bert: 2.08e-06, max memory: 33.04 GB
07/14/2023 10:41:14 - INFO - __main__ -   ep: 10, step: 101, lr_swin: 2.04e-06, lr_bert: 2.04e-06, max memory: 33.04 GB
07/14/2023 10:41:29 - INFO - __main__ -   ep: 10, step: 121, lr_swin: 2.01e-06, lr_bert: 2.01e-06, max memory: 33.04 GB
07/14/2023 10:41:44 - INFO - __main__ -   ep: 10, step: 141, lr_swin: 1.97e-06, lr_bert: 1.97e-06, max memory: 33.04 GB
07/14/2023 10:42:00 - INFO - __main__ -   ep: 10, step: 161, lr_swin: 1.94e-06, lr_bert: 1.94e-06, max memory: 33.04 GB
07/14/2023 10:42:15 - INFO - __main__ -   ep: 10, step: 181, lr_swin: 1.90e-06, lr_bert: 1.90e-06, max memory: 33.04 GB
07/14/2023 10:42:30 - INFO - __main__ -   ep: 10, step: 201, lr_swin: 1.87e-06, lr_bert: 1.87e-06, max memory: 33.04 GB
07/14/2023 10:42:46 - INFO - __main__ -   ep: 10, step: 221, lr_swin: 1.83e-06, lr_bert: 1.83e-06, max memory: 33.04 GB
07/14/2023 10:43:01 - INFO - __main__ -   ep: 10, step: 241, lr_swin: 1.79e-06, lr_bert: 1.79e-06, max memory: 33.04 GB
07/14/2023 10:43:16 - INFO - __main__ -   ep: 10, step: 261, lr_swin: 1.76e-06, lr_bert: 1.76e-06, max memory: 33.04 GB
07/14/2023 10:43:31 - INFO - __main__ -   ep: 10, step: 281, lr_swin: 1.72e-06, lr_bert: 1.72e-06, max memory: 33.04 GB
07/14/2023 10:43:47 - INFO - __main__ -   ep: 10, step: 301, lr_swin: 1.69e-06, lr_bert: 1.69e-06, max memory: 33.04 GB
07/14/2023 10:44:02 - INFO - __main__ -   ep: 10, step: 321, lr_swin: 1.65e-06, lr_bert: 1.65e-06, max memory: 33.04 GB
07/14/2023 10:44:17 - INFO - __main__ -   ep: 10, step: 341, lr_swin: 1.62e-06, lr_bert: 1.62e-06, max memory: 33.04 GB
07/14/2023 10:44:33 - INFO - __main__ -   ep: 10, step: 361, lr_swin: 1.58e-06, lr_bert: 1.58e-06, max memory: 33.04 GB
07/14/2023 10:44:48 - INFO - __main__ -   ep: 10, step: 381, lr_swin: 1.54e-06, lr_bert: 1.54e-06, max memory: 33.04 GB
07/14/2023 10:45:03 - INFO - __main__ -   ep: 10, step: 401, lr_swin: 1.51e-06, lr_bert: 1.51e-06, max memory: 33.04 GB
07/14/2023 10:45:18 - INFO - __main__ -   ep: 10, step: 421, lr_swin: 1.47e-06, lr_bert: 1.47e-06, max memory: 33.04 GB
07/14/2023 10:45:34 - INFO - __main__ -   ep: 10, step: 441, lr_swin: 1.44e-06, lr_bert: 1.44e-06, max memory: 33.04 GB
07/14/2023 10:45:49 - INFO - __main__ -   ep: 10, step: 461, lr_swin: 1.40e-06, lr_bert: 1.40e-06, max memory: 33.04 GB
07/14/2023 10:46:04 - INFO - __main__ -   ep: 10, step: 481, lr_swin: 1.37e-06, lr_bert: 1.37e-06, max memory: 33.04 GB
07/14/2023 10:46:20 - INFO - __main__ -   ep: 10, step: 501, lr_swin: 1.33e-06, lr_bert: 1.33e-06, max memory: 33.04 GB
07/14/2023 10:46:35 - INFO - __main__ -   ep: 10, step: 521, lr_swin: 1.29e-06, lr_bert: 1.29e-06, max memory: 33.04 GB
07/14/2023 10:46:50 - INFO - __main__ -   ep: 10, step: 541, lr_swin: 1.26e-06, lr_bert: 1.26e-06, max memory: 33.04 GB
07/14/2023 10:47:05 - INFO - __main__ -   ep: 10, step: 561, lr_swin: 1.22e-06, lr_bert: 1.22e-06, max memory: 33.04 GB
07/14/2023 10:47:21 - INFO - __main__ -   ep: 10, step: 581, lr_swin: 1.19e-06, lr_bert: 1.19e-06, max memory: 33.04 GB
07/14/2023 10:47:36 - INFO - __main__ -   ep: 10, step: 601, lr_swin: 1.15e-06, lr_bert: 1.15e-06, max memory: 33.04 GB
07/14/2023 10:47:51 - INFO - __main__ -   ep: 10, step: 621, lr_swin: 1.12e-06, lr_bert: 1.12e-06, max memory: 33.04 GB
07/14/2023 10:48:07 - INFO - __main__ -   ep: 10, step: 641, lr_swin: 1.08e-06, lr_bert: 1.08e-06, max memory: 33.04 GB
07/14/2023 10:48:22 - INFO - __main__ -   ep: 10, step: 661, lr_swin: 1.05e-06, lr_bert: 1.05e-06, max memory: 33.04 GB
07/14/2023 10:48:37 - INFO - __main__ -   ep: 10, step: 681, lr_swin: 1.01e-06, lr_bert: 1.01e-06, max memory: 33.04 GB
07/14/2023 10:48:52 - INFO - __main__ -   ep: 10, step: 701, lr_swin: 9.74e-07, lr_bert: 9.74e-07, max memory: 33.04 GB
07/14/2023 10:49:08 - INFO - __main__ -   ep: 10, step: 721, lr_swin: 9.38e-07, lr_bert: 9.38e-07, max memory: 33.04 GB
07/14/2023 10:49:23 - INFO - __main__ -   ep: 10, step: 741, lr_swin: 9.02e-07, lr_bert: 9.02e-07, max memory: 33.04 GB
07/14/2023 10:49:38 - INFO - __main__ -   ep: 10, step: 761, lr_swin: 8.67e-07, lr_bert: 8.67e-07, max memory: 33.04 GB
07/14/2023 10:49:54 - INFO - __main__ -   ep: 10, step: 781, lr_swin: 8.31e-07, lr_bert: 8.31e-07, max memory: 33.04 GB
07/14/2023 10:50:09 - INFO - __main__ -   ep: 10, step: 801, lr_swin: 7.95e-07, lr_bert: 7.95e-07, max memory: 33.04 GB
07/14/2023 10:50:24 - INFO - __main__ -   ep: 10, step: 821, lr_swin: 7.60e-07, lr_bert: 7.60e-07, max memory: 33.04 GB
07/14/2023 10:50:39 - INFO - __main__ -   ep: 10, step: 841, lr_swin: 7.24e-07, lr_bert: 7.24e-07, max memory: 33.04 GB
07/14/2023 10:50:55 - INFO - __main__ -   ep: 10, step: 861, lr_swin: 6.88e-07, lr_bert: 6.88e-07, max memory: 33.04 GB
07/14/2023 10:51:10 - INFO - __main__ -   ep: 10, step: 881, lr_swin: 6.53e-07, lr_bert: 6.53e-07, max memory: 33.04 GB
07/14/2023 10:51:25 - INFO - __main__ -   ep: 10, step: 901, lr_swin: 6.17e-07, lr_bert: 6.17e-07, max memory: 33.04 GB
07/14/2023 10:51:41 - INFO - __main__ -   ep: 10, step: 921, lr_swin: 5.81e-07, lr_bert: 5.81e-07, max memory: 33.04 GB
07/14/2023 10:51:56 - INFO - __main__ -   ep: 10, step: 941, lr_swin: 5.46e-07, lr_bert: 5.46e-07, max memory: 33.04 GB
07/14/2023 10:52:11 - INFO - __main__ -   ep: 10, step: 961, lr_swin: 5.10e-07, lr_bert: 5.10e-07, max memory: 33.04 GB
07/14/2023 10:52:26 - INFO - __main__ -   ep: 10, step: 981, lr_swin: 4.74e-07, lr_bert: 4.74e-07, max memory: 33.04 GB
07/14/2023 10:52:42 - INFO - __main__ -   ep: 10, step: 1001, lr_swin: 4.39e-07, lr_bert: 4.39e-07, max memory: 33.04 GB
07/14/2023 10:52:57 - INFO - __main__ -   ep: 10, step: 1021, lr_swin: 4.03e-07, lr_bert: 4.03e-07, max memory: 33.04 GB
07/14/2023 10:53:12 - INFO - __main__ -   ep: 10, step: 1041, lr_swin: 3.67e-07, lr_bert: 3.67e-07, max memory: 33.04 GB
07/14/2023 10:53:28 - INFO - __main__ -   ep: 10, step: 1061, lr_swin: 3.32e-07, lr_bert: 3.32e-07, max memory: 33.04 GB
07/14/2023 10:53:43 - INFO - __main__ -   ep: 10, step: 1081, lr_swin: 2.96e-07, lr_bert: 2.96e-07, max memory: 33.04 GB
07/14/2023 10:53:58 - INFO - __main__ -   ep: 10, step: 1101, lr_swin: 2.60e-07, lr_bert: 2.60e-07, max memory: 33.04 GB
07/14/2023 10:54:13 - INFO - __main__ -   ep: 10, step: 1121, lr_swin: 2.25e-07, lr_bert: 2.25e-07, max memory: 33.04 GB
07/14/2023 10:54:29 - INFO - __main__ -   ep: 10, step: 1141, lr_swin: 1.89e-07, lr_bert: 1.89e-07, max memory: 33.04 GB
07/14/2023 10:54:44 - INFO - __main__ -   ep: 10, step: 1161, lr_swin: 1.53e-07, lr_bert: 1.53e-07, max memory: 33.04 GB
07/14/2023 10:54:59 - INFO - __main__ -   ep: 10, step: 1181, lr_swin: 1.18e-07, lr_bert: 1.18e-07, max memory: 33.04 GB
07/14/2023 10:55:15 - INFO - __main__ -   ep: 10, step: 1201, lr_swin: 8.20e-08, lr_bert: 8.20e-08, max memory: 33.04 GB
07/14/2023 10:55:30 - INFO - __main__ -   ep: 10, step: 1221, lr_swin: 4.64e-08, lr_bert: 4.64e-08, max memory: 33.04 GB
07/14/2023 10:55:45 - INFO - __main__ -   ep: 10, step: 1241, lr_swin: 1.07e-08, lr_bert: 1.07e-08, max memory: 33.04 GB
07/14/2023 10:55:49 - INFO - __main__ -   ep: 10, step: 1246, lr_swin: 1.00e-08, lr_bert: 1.00e-08, max memory: 33.04 GB
07/14/2023 10:55:49 - INFO - __main__ -   Ep 9, Loss (train): 3.3044e+01
07/14/2023 10:57:34 - INFO - __main__ -   Ep 9, Acc (val): 50.34, 70.85
07/14/2023 11:01:00 - INFO - __main__ -   Ep 9, Acc (test): 51.38, 73.69
07/14/2023 11:01:01 - INFO - __main__ -   Best val @ ep 2, 51.04
07/14/2023 11:01:01 - INFO - __main__ -   Best test @ ep 3, 52.50 (adjusted)
nguyentthong commented 1 year ago

Hi @tsujuifu,

I wonder whether you've managed time to check the question?

Thank you so much. Regards, Thong

tsujuifu commented 1 year ago

I re-trained our model on MSVD-QA, and the "best test" is around 53.4 (ep 6, batch_size 20). I also tried batch_size 12, and the performance is similar to yours (52.6 at epoch 4).