Cannot reproduce CIFAR10 semi-supervised results

nlml commented 6 years ago

Hi there

I cloned the repo, pre-calced the ZCA matrix, and ran your command as follows on a single GPU using python 2.7, torch 0.3.1 and torchvision 0.2.0: python main_mixup_hidden_ssl.py --dataset cifar10 --optimizer sgd --lr 0.1 --l2 0.0005 --nesterov --epochs 1000 --batch_size 100 --mixup_sup 1 --mixup_usup 1 --mixup_sup_hidden --mixup_usup_hidden --mixup_alpha_sup 0.1 --mixup_alpha_usup 2.0 --alpha_max 1.0 --alpha_max_at_factor 0.4 --net_type WRN28_2 --schedule 500 750 875 --gammas 0.1 0.1 0.1 --exp_dir exp1 --data_dir ../data/cifar10/

However I get a final test error of around 18%, whereas in your paper you report around 10%.

Is there something I'm missing here?

Thanks in advance Liam

vikasverma1077 commented 6 years ago

hello Liam, I ran the code again and it is producing the expected results. I am not sure what is going wrong with your experiments. I am pasting my log here for your reference :

Namespace(add_name='', alpha_max=1.0, alpha_max_at_factor=0.4, batch_size=100, data_dir='/data/milatmp1/vermavik/data/cifar10/', dataset='cifar10', epochs=1000, exp_dir='exp1', gammas=[0.1, 0.1, 0.1], job_id='', l2=0.0005, lr=0.1, mixup_alpha_sup=0.1, mixup_alpha_usup=2.0, mixup_sup=1, mixup_sup_hidden=True, mixup_usup=1, mixup_usup_hidden=True, nesterov=True, net_type='WRN28_2', optimizer='sgd', schedule=[500, 750, 875]) | Epoch [ 1/1000] Iter[450/ 41] Loss: 1.4911 SupLoss: 1.4593 UsupLoss: 0.3722 NLLLoss: 1.1818 Acc@1: 58.738%

| Validation Epoch #1 Loss: 1.9541 NLLLoss: 1.9541 Acc@1: 46.38%

| Best Test Acc: Epoch #1 Loss: 2.0551 NLLLoss: 2.0551 Acc@1: 46.01%

| Best Test Acc: Acc@1: 46.01% | Epoch [ 2/1000] Iter[450/ 41] Loss: 1.0074 SupLoss: 0.9752 UsupLoss: 0.6893 NLLLoss: 0.5742 Acc@1: 83.784%

| Validation Epoch #2 Loss: 1.4883 NLLLoss: 1.4883 Acc@1: 57.12%

| Best Test Acc: Epoch #2 Loss: 1.4982 NLLLoss: 1.4982 Acc@1: 57.56%

| Best Test Acc: Acc@1: 57.56% | Epoch [ 3/1000] Iter[450/ 41] Loss: 0.8236 SupLoss: 0.7920 UsupLoss: 0.7944 NLLLoss: 0.3810 Acc@1: 90.951%

| Validation Epoch #3 Loss: 1.2254 NLLLoss: 1.2254 Acc@1: 66.02%

| Best Test Acc: Epoch #3 Loss: 1.3209 NLLLoss: 1.3209 Acc@1: 64.62%

| Best Test Acc: Acc@1: 64.62% | Epoch [ 4/1000] Iter[450/ 41] Loss: 0.7220 SupLoss: 0.6911 UsupLoss: 0.8818 NLLLoss: 0.2940 Acc@1: 93.680%

| Validation Epoch #4 Loss: 1.2399 NLLLoss: 1.2399 Acc@1: 64.30%

| Best Test Acc: Acc@1: 64.62% | Epoch [ 5/1000] Iter[450/ 41] Loss: 0.6695 SupLoss: 0.6411 UsupLoss: 0.8530 NLLLoss: 0.2403 Acc@1: 95.533%

| Validation Epoch #5 Loss: 1.1255 NLLLoss: 1.1255 Acc@1: 67.36%

| Best Test Acc: Epoch #5 Loss: 1.0883 NLLLoss: 1.0883 Acc@1: 68.86%

| Best Test Acc: Acc@1: 68.86% | Epoch [ 6/1000] Iter[450/ 41] Loss: 0.5960 SupLoss: 0.5684 UsupLoss: 0.9192 NLLLoss: 0.2071 Acc@1: 96.207%

| Validation Epoch #6 Loss: 0.9578 NLLLoss: 0.9578 Acc@1: 71.92%

| Best Test Acc: Epoch #6 Loss: 0.9852 NLLLoss: 0.9852 Acc@1: 71.69%

| Best Test Acc: Acc@1: 71.69% | Epoch [ 7/1000] Iter[450/ 41] Loss: 0.5436 SupLoss: 0.5182 UsupLoss: 0.9117 NLLLoss: 0.1726 Acc@1: 97.427%

| Validation Epoch #7 Loss: 1.0963 NLLLoss: 1.0963 Acc@1: 68.90%

| Best Test Acc: Acc@1: 71.69% | Epoch [ 8/1000] Iter[450/ 41] Loss: 0.5660 SupLoss: 0.5415 UsupLoss: 0.8750 NLLLoss: 0.1674 Acc@1: 97.518%

| Validation Epoch #8 Loss: 0.9894 NLLLoss: 0.9894 Acc@1: 70.52%

| Best Test Acc: Acc@1: 71.69% | Epoch [ 9/1000] Iter[450/ 41] Loss: 0.5556 SupLoss: 0.5324 UsupLoss: 0.8454 NLLLoss: 0.1585 Acc@1: 97.929%

| Validation Epoch #9 Loss: 0.8680 NLLLoss: 0.8680 Acc@1: 73.22%

| Best Test Acc: Epoch #9 Loss: 0.9086 NLLLoss: 0.9086 Acc@1: 72.91%

| Best Test Acc: Acc@1: 72.91% | Epoch [ 10/1000] Iter[450/ 41] Loss: 0.5590 SupLoss: 0.5361 UsupLoss: 0.8499 NLLLoss: 0.1548 Acc@1: 98.173%

| Validation Epoch #10 Loss: 0.9678 NLLLoss: 0.9678 Acc@1: 70.90%

| Best Test Acc: Acc@1: 72.91% | Epoch [ 11/1000] Iter[450/ 41] Loss: 0.4940 SupLoss: 0.4707 UsupLoss: 0.9217 NLLLoss: 0.1341 Acc@1: 98.460%

| Validation Epoch #11 Loss: 0.8906 NLLLoss: 0.8906 Acc@1: 72.86%

| Best Test Acc: Acc@1: 72.91% | Epoch [ 12/1000] Iter[450/ 41] Loss: 0.5376 SupLoss: 0.5163 UsupLoss: 0.7956 NLLLoss: 0.1418 Acc@1: 98.462%

| Validation Epoch #12 Loss: 0.8193 NLLLoss: 0.8193 Acc@1: 75.04%

| Best Test Acc: Epoch #12 Loss: 0.8514 NLLLoss: 0.8514 Acc@1: 74.49%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 13/1000] Iter[450/ 41] Loss: 0.4954 SupLoss: 0.4744 UsupLoss: 0.8296 NLLLoss: 0.1264 Acc@1: 98.762%

| Validation Epoch #13 Loss: 1.0719 NLLLoss: 1.0719 Acc@1: 69.42%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 14/1000] Iter[450/ 41] Loss: 0.4910 SupLoss: 0.4700 UsupLoss: 0.8258 NLLLoss: 0.1322 Acc@1: 98.491%

| Validation Epoch #14 Loss: 0.8676 NLLLoss: 0.8676 Acc@1: 73.34%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 15/1000] Iter[450/ 41] Loss: 0.4742 SupLoss: 0.4538 UsupLoss: 0.8447 NLLLoss: 0.1218 Acc@1: 98.820%

| Validation Epoch #15 Loss: 0.8000 NLLLoss: 0.8000 Acc@1: 74.96%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 16/1000] Iter[450/ 41] Loss: 0.5182 SupLoss: 0.4979 UsupLoss: 0.8213 NLLLoss: 0.1288 Acc@1: 98.751%

| Validation Epoch #16 Loss: 0.8239 NLLLoss: 0.8239 Acc@1: 74.58%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 17/1000] Iter[450/ 41] Loss: 0.4990 SupLoss: 0.4792 UsupLoss: 0.8050 NLLLoss: 0.1234 Acc@1: 98.933%

| Validation Epoch #17 Loss: 0.8833 NLLLoss: 0.8833 Acc@1: 73.98%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 18/1000] Iter[450/ 41] Loss: 0.4749 SupLoss: 0.4545 UsupLoss: 0.8653 NLLLoss: 0.1205 Acc@1: 98.798%

| Validation Epoch #18 Loss: 0.8367 NLLLoss: 0.8367 Acc@1: 74.22%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 19/1000] Iter[450/ 41] Loss: 0.4934 SupLoss: 0.4736 UsupLoss: 0.8228 NLLLoss: 0.1242 Acc@1: 98.796%

| Validation Epoch #19 Loss: 0.8571 NLLLoss: 0.8571 Acc@1: 74.48%

| Best Test Acc: Acc@1: 74.49% | Epoch [ 20/1000] Iter[450/ 41] Loss: 0.4818 SupLoss: 0.4624 UsupLoss: 0.8138 NLLLoss: 0.1177 Acc@1: 99.033%

| Validation Epoch #20 Loss: 0.7890 NLLLoss: 0.7890 Acc@1: 76.68%

| Best Test Acc: Epoch #20 Loss: 0.8146 NLLLoss: 0.8146 Acc@1: 76.29%

| Best Test Acc: Acc@1: 76.29% | Epoch [ 21/1000] Iter[450/ 41] Loss: 0.4698 SupLoss: 0.4501 UsupLoss: 0.7870 NLLLoss: 0.1117 Acc@1: 99.036%

| Validation Epoch #21 Loss: 0.7522 NLLLoss: 0.7522 Acc@1: 76.76%

| Best Test Acc: Epoch #21 Loss: 0.7685 NLLLoss: 0.7685 Acc@1: 76.98%

| Best Test Acc: Acc@1: 76.98% | Epoch [ 22/1000] Iter[450/ 41] Loss: 0.4848 SupLoss: 0.4655 UsupLoss: 0.7852 NLLLoss: 0.1135 Acc@1: 99.129%

| Validation Epoch #22 Loss: 0.8231 NLLLoss: 0.8231 Acc@1: 76.08%

| Best Test Acc: Acc@1: 76.98% | Epoch [ 23/1000] Iter[450/ 41] Loss: 0.4808 SupLoss: 0.4608 UsupLoss: 0.8214 NLLLoss: 0.1172 Acc@1: 98.971%

| Validation Epoch #23 Loss: 0.8268 NLLLoss: 0.8268 Acc@1: 74.58%

| Best Test Acc: Acc@1: 76.98% | Epoch [ 24/1000] Iter[450/ 41] Loss: 0.4634 SupLoss: 0.4442 UsupLoss: 0.7788 NLLLoss: 0.1119 Acc@1: 98.987%

| Validation Epoch #24 Loss: 0.7512 NLLLoss: 0.7512 Acc@1: 77.66%

| Best Test Acc: Epoch #24 Loss: 0.7908 NLLLoss: 0.7908 Acc@1: 77.21%

| Best Test Acc: Acc@1: 77.21% | Epoch [ 25/1000] Iter[450/ 41] Loss: 0.4732 SupLoss: 0.4534 UsupLoss: 0.7891 NLLLoss: 0.1110 Acc@1: 99.027%

| Validation Epoch #25 Loss: 0.8135 NLLLoss: 0.8135 Acc@1: 74.86%

| Best Test Acc: Acc@1: 77.21% | Epoch [ 26/1000] Iter[450/ 41] Loss: 0.5047 SupLoss: 0.4859 UsupLoss: 0.7210 NLLLoss: 0.1160 Acc@1: 99.116%

| Validation Epoch #26 Loss: 0.7389 NLLLoss: 0.7389 Acc@1: 76.76%

| Best Test Acc: Acc@1: 77.21% | Epoch [ 27/1000] Iter[450/ 41] Loss: 0.5018 SupLoss: 0.4825 UsupLoss: 0.7245 NLLLoss: 0.1133 Acc@1: 99.138%

| Validation Epoch #27 Loss: 0.8071 NLLLoss: 0.8071 Acc@1: 75.28%

| Best Test Acc: Acc@1: 77.21% | Epoch [ 28/1000] Iter[450/ 41] Loss: 0.4738 SupLoss: 0.4542 UsupLoss: 0.7578 NLLLoss: 0.1042 Acc@1: 99.329%

| Validation Epoch #28 Loss: 0.7604 NLLLoss: 0.7604 Acc@1: 76.24%

| Best Test Acc: Acc@1: 77.21% | Epoch [ 29/1000] Iter[450/ 41] Loss: 0.4508 SupLoss: 0.4310 UsupLoss: 0.7768 NLLLoss: 0.1076 Acc@1: 99.104%

| Validation Epoch #29 Loss: 0.7755 NLLLoss: 0.7755 Acc@1: 77.80%

| Best Test Acc: Epoch #29 Loss: 0.7847 NLLLoss: 0.7847 Acc@1: 77.81%

| Best Test Acc: Acc@1: 77.81% | Epoch [ 30/1000] Iter[450/ 41] Loss: 0.4647 SupLoss: 0.4456 UsupLoss: 0.7399 NLLLoss: 0.1051 Acc@1: 99.244%

| Validation Epoch #30 Loss: 0.7495 NLLLoss: 0.7495 Acc@1: 76.48%

| Best Test Acc: Acc@1: 77.81% | Epoch [ 31/1000] Iter[450/ 41] Loss: 0.4410 SupLoss: 0.4210 UsupLoss: 0.7672 NLLLoss: 0.1014 Acc@1: 99.242%

| Validation Epoch #31 Loss: 0.7602 NLLLoss: 0.7602 Acc@1: 76.94%

| Best Test Acc: Acc@1: 77.81% | Epoch [ 32/1000] Iter[450/ 41] Loss: 0.4553 SupLoss: 0.4354 UsupLoss: 0.7687 NLLLoss: 0.1023 Acc@1: 99.213%

| Validation Epoch #32 Loss: 0.8060 NLLLoss: 0.8060 Acc@1: 75.34%

| Best Test Acc: Acc@1: 77.81% | Epoch [ 33/1000] Iter[450/ 41] Loss: 0.4655 SupLoss: 0.4456 UsupLoss: 0.7583 NLLLoss: 0.1071 Acc@1: 99.178%

| Validation Epoch #33 Loss: 0.7731 NLLLoss: 0.7731 Acc@1: 76.06%

| Best Test Acc: Acc@1: 77.81% | Epoch [ 34/1000] Iter[450/ 41] Loss: 0.4778 SupLoss: 0.4583 UsupLoss: 0.7184 NLLLoss: 0.1063 Acc@1: 99.300%

| Validation Epoch #34 Loss: 0.7076 NLLLoss: 0.7076 Acc@1: 78.30%

| Best Test Acc: Epoch #34 Loss: 0.7484 NLLLoss: 0.7484 Acc@1: 78.33%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 35/1000] Iter[450/ 41] Loss: 0.4473 SupLoss: 0.4276 UsupLoss: 0.7156 NLLLoss: 0.0999 Acc@1: 99.253%

| Validation Epoch #35 Loss: 0.7469 NLLLoss: 0.7469 Acc@1: 77.10%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 36/1000] Iter[450/ 41] Loss: 0.4213 SupLoss: 0.4003 UsupLoss: 0.7823 NLLLoss: 0.0958 Acc@1: 99.238%

| Validation Epoch #36 Loss: 0.8028 NLLLoss: 0.8028 Acc@1: 76.36%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 37/1000] Iter[450/ 41] Loss: 0.4332 SupLoss: 0.4127 UsupLoss: 0.7435 NLLLoss: 0.0968 Acc@1: 99.264%

| Validation Epoch #37 Loss: 0.7791 NLLLoss: 0.7791 Acc@1: 75.24%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 38/1000] Iter[450/ 41] Loss: 0.4463 SupLoss: 0.4260 UsupLoss: 0.7244 NLLLoss: 0.0968 Acc@1: 99.293%

| Validation Epoch #38 Loss: 0.7456 NLLLoss: 0.7456 Acc@1: 76.44%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 39/1000] Iter[450/ 41] Loss: 0.4710 SupLoss: 0.4517 UsupLoss: 0.6552 NLLLoss: 0.0982 Acc@1: 99.473%

| Validation Epoch #39 Loss: 0.7747 NLLLoss: 0.7747 Acc@1: 76.52%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 40/1000] Iter[450/ 41] Loss: 0.4242 SupLoss: 0.4034 UsupLoss: 0.7156 NLLLoss: 0.0915 Acc@1: 99.349%

| Validation Epoch #40 Loss: 0.7880 NLLLoss: 0.7880 Acc@1: 76.08%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 41/1000] Iter[450/ 41] Loss: 0.4433 SupLoss: 0.4226 UsupLoss: 0.6830 NLLLoss: 0.0935 Acc@1: 99.273%

| Validation Epoch #41 Loss: 0.7717 NLLLoss: 0.7717 Acc@1: 76.10%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 42/1000] Iter[450/ 41] Loss: 0.4475 SupLoss: 0.4278 UsupLoss: 0.6394 NLLLoss: 0.0894 Acc@1: 99.309%

| Validation Epoch #42 Loss: 0.7523 NLLLoss: 0.7523 Acc@1: 76.62%

| Best Test Acc: Acc@1: 78.33% | Epoch [ 43/1000] Iter[450/ 41] Loss: 0.4392 SupLoss: 0.4184 UsupLoss: 0.6777 NLLLoss: 0.0863 Acc@1: 99.147%

| Validation Epoch #43 Loss: 0.7823 NLLLoss: 0.7823 Acc@1: 78.62%

| Best Test Acc: Epoch #43 Loss: 0.8233 NLLLoss: 0.8233 Acc@1: 77.31%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 44/1000] Iter[450/ 41] Loss: 0.3969 SupLoss: 0.3741 UsupLoss: 0.7612 NLLLoss: 0.0823 Acc@1: 99.147%

| Validation Epoch #44 Loss: 0.9356 NLLLoss: 0.9356 Acc@1: 72.06%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 45/1000] Iter[450/ 41] Loss: 0.4222 SupLoss: 0.3978 UsupLoss: 0.7857 NLLLoss: 0.0830 Acc@1: 99.096%

| Validation Epoch #45 Loss: 0.9148 NLLLoss: 0.9148 Acc@1: 75.36%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 46/1000] Iter[450/ 41] Loss: 0.4697 SupLoss: 0.4426 UsupLoss: 0.8858 NLLLoss: 0.0790 Acc@1: 99.027%

| Validation Epoch #46 Loss: 0.7566 NLLLoss: 0.7566 Acc@1: 76.84%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 47/1000] Iter[450/ 41] Loss: 0.4709 SupLoss: 0.4443 UsupLoss: 0.8514 NLLLoss: 0.0842 Acc@1: 98.962%

| Validation Epoch #47 Loss: 0.8278 NLLLoss: 0.8278 Acc@1: 76.60%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 48/1000] Iter[450/ 41] Loss: 0.4513 SupLoss: 0.4246 UsupLoss: 0.8385 NLLLoss: 0.0873 Acc@1: 98.929%

| Validation Epoch #48 Loss: 0.8384 NLLLoss: 0.8384 Acc@1: 76.64%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 49/1000] Iter[450/ 41] Loss: 0.4243 SupLoss: 0.3963 UsupLoss: 0.8557 NLLLoss: 0.0837 Acc@1: 98.996%

| Validation Epoch #49 Loss: 0.8817 NLLLoss: 0.8817 Acc@1: 73.54%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 50/1000] Iter[450/ 41] Loss: 0.4286 SupLoss: 0.4015 UsupLoss: 0.8237 NLLLoss: 0.0727 Acc@1: 99.213%

| Validation Epoch #50 Loss: 1.0007 NLLLoss: 1.0007 Acc@1: 72.52%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 51/1000] Iter[450/ 41] Loss: 0.4407 SupLoss: 0.4117 UsupLoss: 0.8564 NLLLoss: 0.0777 Acc@1: 99.029%

| Validation Epoch #51 Loss: 0.8220 NLLLoss: 0.8220 Acc@1: 77.16%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 52/1000] Iter[450/ 41] Loss: 0.4502 SupLoss: 0.4186 UsupLoss: 0.9295 NLLLoss: 0.0779 Acc@1: 99.007%

| Validation Epoch #52 Loss: 0.8630 NLLLoss: 0.8630 Acc@1: 76.62%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 53/1000] Iter[450/ 41] Loss: 0.4741 SupLoss: 0.4438 UsupLoss: 0.8833 NLLLoss: 0.0793 Acc@1: 99.078%

| Validation Epoch #53 Loss: 0.9462 NLLLoss: 0.9462 Acc@1: 73.00%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 54/1000] Iter[450/ 41] Loss: 0.4584 SupLoss: 0.4265 UsupLoss: 0.9395 NLLLoss: 0.0793 Acc@1: 98.929%

| Validation Epoch #54 Loss: 1.0668 NLLLoss: 1.0668 Acc@1: 71.88%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 55/1000] Iter[450/ 41] Loss: 0.4497 SupLoss: 0.4163 UsupLoss: 1.0040 NLLLoss: 0.0752 Acc@1: 99.056%

| Validation Epoch #55 Loss: 0.9203 NLLLoss: 0.9203 Acc@1: 76.18%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 56/1000] Iter[450/ 41] Loss: 0.5282 SupLoss: 0.4609 UsupLoss: 2.3719 NLLLoss: 0.0706 Acc@1: 99.062%

| Validation Epoch #56 Loss: 0.9419 NLLLoss: 0.9419 Acc@1: 71.86%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 57/1000] Iter[450/ 41] Loss: 0.4851 SupLoss: 0.4333 UsupLoss: 1.7071 NLLLoss: 0.0641 Acc@1: 99.227%

| Validation Epoch #57 Loss: 0.8715 NLLLoss: 0.8715 Acc@1: 75.80%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 58/1000] Iter[450/ 41] Loss: 0.4842 SupLoss: 0.4271 UsupLoss: 1.8514 NLLLoss: 0.0684 Acc@1: 99.049%

| Validation Epoch #58 Loss: 1.0784 NLLLoss: 1.0784 Acc@1: 72.46%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 59/1000] Iter[450/ 41] Loss: 0.5172 SupLoss: 0.4628 UsupLoss: 1.6980 NLLLoss: 0.0723 Acc@1: 98.949%

| Validation Epoch #59 Loss: 0.9352 NLLLoss: 0.9352 Acc@1: 74.90%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 60/1000] Iter[450/ 41] Loss: 0.5422 SupLoss: 0.4889 UsupLoss: 1.6197 NLLLoss: 0.0747 Acc@1: 98.953%

| Validation Epoch #60 Loss: 0.8651 NLLLoss: 0.8651 Acc@1: 76.16%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 61/1000] Iter[450/ 41] Loss: 0.4987 SupLoss: 0.4450 UsupLoss: 1.5800 NLLLoss: 0.0714 Acc@1: 99.042%

| Validation Epoch #61 Loss: 0.9057 NLLLoss: 0.9057 Acc@1: 76.04%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 62/1000] Iter[450/ 41] Loss: 0.5527 SupLoss: 0.4945 UsupLoss: 1.7118 NLLLoss: 0.0727 Acc@1: 98.949%

| Validation Epoch #62 Loss: 0.8377 NLLLoss: 0.8377 Acc@1: 72.50%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 63/1000] Iter[450/ 41] Loss: 0.5561 SupLoss: 0.4974 UsupLoss: 1.6490 NLLLoss: 0.0783 Acc@1: 98.882%

| Validation Epoch #63 Loss: 1.0211 NLLLoss: 1.0211 Acc@1: 73.50%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 64/1000] Iter[450/ 41] Loss: 0.5843 SupLoss: 0.5059 UsupLoss: 2.2933 NLLLoss: 0.0752 Acc@1: 98.516%

| Validation Epoch #64 Loss: 1.1977 NLLLoss: 1.1977 Acc@1: 70.62%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 65/1000] Iter[450/ 41] Loss: 0.5742 SupLoss: 0.5011 UsupLoss: 2.0555 NLLLoss: 0.0857 Acc@1: 98.298%

| Validation Epoch #65 Loss: 1.3280 NLLLoss: 1.3280 Acc@1: 69.84%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 66/1000] Iter[450/ 41] Loss: 0.5826 SupLoss: 0.5135 UsupLoss: 1.8755 NLLLoss: 0.0828 Acc@1: 98.356%

| Validation Epoch #66 Loss: 0.8326 NLLLoss: 0.8326 Acc@1: 73.04%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 67/1000] Iter[450/ 41] Loss: 0.5933 SupLoss: 0.5204 UsupLoss: 1.9891 NLLLoss: 0.0834 Acc@1: 98.293%

| Validation Epoch #67 Loss: 0.9388 NLLLoss: 0.9388 Acc@1: 74.12%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 68/1000] Iter[450/ 41] Loss: 0.5917 SupLoss: 0.5137 UsupLoss: 2.1219 NLLLoss: 0.0908 Acc@1: 97.909%

| Validation Epoch #68 Loss: 1.1993 NLLLoss: 1.1993 Acc@1: 73.06%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 69/1000] Iter[450/ 41] Loss: 0.6068 SupLoss: 0.5256 UsupLoss: 2.1492 NLLLoss: 0.0932 Acc@1: 97.878%

| Validation Epoch #69 Loss: 1.0800 NLLLoss: 1.0800 Acc@1: 73.24%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 70/1000] Iter[450/ 41] Loss: 0.6415 SupLoss: 0.5633 UsupLoss: 1.9934 NLLLoss: 0.1081 Acc@1: 97.598%

| Validation Epoch #70 Loss: 1.0605 NLLLoss: 1.0605 Acc@1: 73.44%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 71/1000] Iter[450/ 41] Loss: 0.6347 SupLoss: 0.5542 UsupLoss: 2.0281 NLLLoss: 0.0999 Acc@1: 97.736%

| Validation Epoch #71 Loss: 1.0324 NLLLoss: 1.0324 Acc@1: 71.38%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 72/1000] Iter[450/ 41] Loss: 0.7302 SupLoss: 0.6542 UsupLoss: 1.8550 NLLLoss: 0.1604 Acc@1: 97.344%

| Validation Epoch #72 Loss: 1.0622 NLLLoss: 1.0622 Acc@1: 73.90%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 73/1000] Iter[450/ 41] Loss: 0.7349 SupLoss: 0.6439 UsupLoss: 2.1865 NLLLoss: 0.1461 Acc@1: 96.293%

| Validation Epoch #73 Loss: 1.1869 NLLLoss: 1.1869 Acc@1: 71.76%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 74/1000] Iter[450/ 41] Loss: 0.9063 SupLoss: 0.8029 UsupLoss: 2.4446 NLLLoss: 0.2670 Acc@1: 94.636%

| Validation Epoch #74 Loss: 0.7172 NLLLoss: 0.7172 Acc@1: 77.38%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 75/1000] Iter[450/ 41] Loss: 0.4189 SupLoss: 0.3819 UsupLoss: 0.7837 NLLLoss: 0.0949 Acc@1: 99.636%

| Validation Epoch #75 Loss: 0.6937 NLLLoss: 0.6937 Acc@1: 78.06%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 76/1000] Iter[450/ 41] Loss: 0.4058 SupLoss: 0.3675 UsupLoss: 0.8074 NLLLoss: 0.0814 Acc@1: 99.629%

| Validation Epoch #76 Loss: 0.7601 NLLLoss: 0.7601 Acc@1: 77.26%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 77/1000] Iter[450/ 41] Loss: 0.4962 SupLoss: 0.4313 UsupLoss: 1.4519 NLLLoss: 0.0677 Acc@1: 99.120%

| Validation Epoch #77 Loss: 1.0494 NLLLoss: 1.0494 Acc@1: 72.32%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 78/1000] Iter[450/ 41] Loss: 0.5469 SupLoss: 0.4675 UsupLoss: 1.7804 NLLLoss: 0.0727 Acc@1: 98.769%

| Validation Epoch #78 Loss: 0.8729 NLLLoss: 0.8729 Acc@1: 75.86%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 79/1000] Iter[450/ 41] Loss: 0.5850 SupLoss: 0.5032 UsupLoss: 1.8087 NLLLoss: 0.0770 Acc@1: 98.682%

| Validation Epoch #79 Loss: 0.7896 NLLLoss: 0.7896 Acc@1: 75.40%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 80/1000] Iter[450/ 41] Loss: 0.6218 SupLoss: 0.5261 UsupLoss: 2.1018 NLLLoss: 0.0915 Acc@1: 98.113%

| Validation Epoch #80 Loss: 0.9683 NLLLoss: 0.9683 Acc@1: 75.48%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 81/1000] Iter[450/ 41] Loss: 0.7364 SupLoss: 0.6299 UsupLoss: 2.3108 NLLLoss: 0.1215 Acc@1: 97.098%

| Validation Epoch #81 Loss: 0.8454 NLLLoss: 0.8454 Acc@1: 76.54%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 82/1000] Iter[450/ 41] Loss: 0.5962 SupLoss: 0.4842 UsupLoss: 2.4079 NLLLoss: 0.0724 Acc@1: 98.496%

| Validation Epoch #82 Loss: 1.0189 NLLLoss: 1.0189 Acc@1: 72.70%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 83/1000] Iter[450/ 41] Loss: 0.6569 SupLoss: 0.5547 UsupLoss: 2.1356 NLLLoss: 0.0941 Acc@1: 97.944%

| Validation Epoch #83 Loss: 1.1884 NLLLoss: 1.1884 Acc@1: 71.78%

| Best Test Acc: Acc@1: 77.31% | Epoch [ 84/1000] Iter[450/ 41] Loss: 0.7854 SupLoss: 0.7004 UsupLoss: 1.6628 NLLLoss: 0.2068 Acc@1: 96.456%

| Validation Epoch #84 Loss: 0.6851 NLLLoss: 0.6851 Acc@1: 78.78%

| Best Test Acc: Epoch #84 Loss: 0.6652 NLLLoss: 0.6652 Acc@1: 79.69%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 85/1000] Iter[450/ 41] Loss: 0.5480 SupLoss: 0.4609 UsupLoss: 1.7044 NLLLoss: 0.0734 Acc@1: 98.678%

| Validation Epoch #85 Loss: 0.9052 NLLLoss: 0.9052 Acc@1: 72.48%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 86/1000] Iter[450/ 41] Loss: 0.6656 SupLoss: 0.5641 UsupLoss: 1.9653 NLLLoss: 0.1001 Acc@1: 97.707%

| Validation Epoch #86 Loss: 0.9235 NLLLoss: 0.9235 Acc@1: 74.76%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 87/1000] Iter[450/ 41] Loss: 0.7014 SupLoss: 0.5858 UsupLoss: 2.2391 NLLLoss: 0.1079 Acc@1: 97.353%

| Validation Epoch #87 Loss: 1.6874 NLLLoss: 1.6874 Acc@1: 62.68%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 88/1000] Iter[450/ 41] Loss: 1.1662 SupLoss: 1.0219 UsupLoss: 2.7242 NLLLoss: 0.3414 Acc@1: 92.153%

| Validation Epoch #88 Loss: 1.4909 NLLLoss: 1.4909 Acc@1: 69.86%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 89/1000] Iter[450/ 41] Loss: 1.4114 SupLoss: 1.2278 UsupLoss: 3.4040 NLLLoss: 0.4854 Acc@1: 90.736%

| Validation Epoch #89 Loss: 2.7092 NLLLoss: 2.7092 Acc@1: 62.78%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 90/1000] Iter[450/ 41] Loss: 0.9547 SupLoss: 0.8377 UsupLoss: 2.0189 NLLLoss: 0.2944 Acc@1: 94.436%

| Validation Epoch #90 Loss: 1.2849 NLLLoss: 1.2849 Acc@1: 69.34%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 91/1000] Iter[450/ 41] Loss: 1.2712 SupLoss: 1.1224 UsupLoss: 2.6128 NLLLoss: 0.4653 Acc@1: 92.169%

| Validation Epoch #91 Loss: 0.7491 NLLLoss: 0.7491 Acc@1: 77.54%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 92/1000] Iter[450/ 41] Loss: 1.1079 SupLoss: 0.9552 UsupLoss: 2.5595 NLLLoss: 0.3230 Acc@1: 93.496%

| Validation Epoch #92 Loss: 0.7828 NLLLoss: 0.7828 Acc@1: 77.18%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 93/1000] Iter[450/ 41] Loss: 0.4688 SupLoss: 0.4067 UsupLoss: 0.9838 NLLLoss: 0.1033 Acc@1: 99.362%

| Validation Epoch #93 Loss: 0.7432 NLLLoss: 0.7432 Acc@1: 77.76%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 94/1000] Iter[450/ 41] Loss: 0.4790 SupLoss: 0.3868 UsupLoss: 1.5424 NLLLoss: 0.0526 Acc@1: 99.591%

| Validation Epoch #94 Loss: 0.8352 NLLLoss: 0.8352 Acc@1: 75.58%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 95/1000] Iter[450/ 41] Loss: 0.4975 SupLoss: 0.3966 UsupLoss: 1.6717 NLLLoss: 0.0540 Acc@1: 99.293%

| Validation Epoch #95 Loss: 0.8806 NLLLoss: 0.8806 Acc@1: 75.52%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 96/1000] Iter[450/ 41] Loss: 0.6358 SupLoss: 0.5258 UsupLoss: 1.7834 NLLLoss: 0.0966 Acc@1: 98.069%

| Validation Epoch #96 Loss: 0.9676 NLLLoss: 0.9676 Acc@1: 74.78%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 97/1000] Iter[450/ 41] Loss: 0.7349 SupLoss: 0.6110 UsupLoss: 1.9821 NLLLoss: 0.1241 Acc@1: 97.264%

| Validation Epoch #97 Loss: 1.9110 NLLLoss: 1.9110 Acc@1: 64.60%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 98/1000] Iter[450/ 41] Loss: 0.9252 SupLoss: 0.7824 UsupLoss: 2.2168 NLLLoss: 0.2162 Acc@1: 94.751%

| Validation Epoch #98 Loss: 1.2854 NLLLoss: 1.2854 Acc@1: 72.04%

| Best Test Acc: Acc@1: 79.69% | Epoch [ 99/1000] Iter[450/ 41] Loss: 1.9670 SupLoss: 1.7099 UsupLoss: 4.0288 NLLLoss: 0.8134 Acc@1: 88.496%

| Validation Epoch #99 Loss: 1.9276 NLLLoss: 1.9276 Acc@1: 50.44%

| Best Test Acc: Acc@1: 79.69% | Epoch [100/1000] Iter[450/ 41] Loss: 0.5873 SupLoss: 0.5132 UsupLoss: 0.9742 NLLLoss: 0.2371 Acc@1: 95.624%

| Validation Epoch #100 Loss: 0.7645 NLLLoss: 0.7645 Acc@1: 76.76%

| Best Test Acc: Acc@1: 79.69% | Epoch [101/1000] Iter[450/ 41] Loss: 0.4369 SupLoss: 0.3815 UsupLoss: 0.7469 NLLLoss: 0.0988 Acc@1: 99.422%

| Validation Epoch #101 Loss: 0.7992 NLLLoss: 0.7992 Acc@1: 76.10%

| Best Test Acc: Acc@1: 79.69% | Epoch [102/1000] Iter[450/ 41] Loss: 0.4730 SupLoss: 0.3839 UsupLoss: 1.2850 NLLLoss: 0.0569 Acc@1: 99.427%

| Validation Epoch #102 Loss: 0.7992 NLLLoss: 0.7992 Acc@1: 78.70%

| Best Test Acc: Acc@1: 79.69% | Epoch [103/1000] Iter[450/ 41] Loss: 0.4933 SupLoss: 0.4098 UsupLoss: 1.1703 NLLLoss: 0.0644 Acc@1: 99.236%

| Validation Epoch #103 Loss: 0.7330 NLLLoss: 0.7330 Acc@1: 78.28%

| Best Test Acc: Acc@1: 79.69% | Epoch [104/1000] Iter[450/ 41] Loss: 0.4689 SupLoss: 0.3838 UsupLoss: 1.1811 NLLLoss: 0.0634 Acc@1: 99.213%

| Validation Epoch #104 Loss: 0.8950 NLLLoss: 0.8950 Acc@1: 75.98%

| Best Test Acc: Acc@1: 79.69% | Epoch [105/1000] Iter[450/ 41] Loss: 0.4880 SupLoss: 0.4012 UsupLoss: 1.1881 NLLLoss: 0.0602 Acc@1: 99.369%

| Validation Epoch #105 Loss: 0.7542 NLLLoss: 0.7542 Acc@1: 77.82%

| Best Test Acc: Acc@1: 79.69% | Epoch [106/1000] Iter[450/ 41] Loss: 0.4927 SupLoss: 0.3967 UsupLoss: 1.2906 NLLLoss: 0.0673 Acc@1: 99.140%

| Validation Epoch #106 Loss: 0.8222 NLLLoss: 0.8222 Acc@1: 75.74%

| Best Test Acc: Acc@1: 79.69% | Epoch [107/1000] Iter[450/ 41] Loss: 0.5607 SupLoss: 0.4558 UsupLoss: 1.4031 NLLLoss: 0.0633 Acc@1: 99.244%

| Validation Epoch #107 Loss: 0.7665 NLLLoss: 0.7665 Acc@1: 78.04%

| Best Test Acc: Acc@1: 79.69% | Epoch [108/1000] Iter[450/ 41] Loss: 0.5488 SupLoss: 0.4435 UsupLoss: 1.3803 NLLLoss: 0.0671 Acc@1: 98.982%

| Validation Epoch #108 Loss: 0.8614 NLLLoss: 0.8614 Acc@1: 75.88%

| Best Test Acc: Acc@1: 79.69% | Epoch [109/1000] Iter[450/ 41] Loss: 0.5978 SupLoss: 0.4732 UsupLoss: 1.6219 NLLLoss: 0.0714 Acc@1: 98.784%

| Validation Epoch #109 Loss: 0.9429 NLLLoss: 0.9429 Acc@1: 72.98%

| Best Test Acc: Acc@1: 79.69% | Epoch [110/1000] Iter[450/ 41] Loss: 0.5396 SupLoss: 0.4335 UsupLoss: 1.3421 NLLLoss: 0.0643 Acc@1: 99.084%

| Validation Epoch #110 Loss: 0.8535 NLLLoss: 0.8535 Acc@1: 74.38%

| Best Test Acc: Acc@1: 79.69% | Epoch [111/1000] Iter[450/ 41] Loss: 0.5651 SupLoss: 0.4489 UsupLoss: 1.4532 NLLLoss: 0.0662 Acc@1: 99.056%

| Validation Epoch #111 Loss: 0.8027 NLLLoss: 0.8027 Acc@1: 77.12%

| Best Test Acc: Acc@1: 79.69% | Epoch [112/1000] Iter[450/ 41] Loss: 0.5658 SupLoss: 0.4523 UsupLoss: 1.3914 NLLLoss: 0.0673 Acc@1: 98.971%

| Validation Epoch #112 Loss: 0.7617 NLLLoss: 0.7617 Acc@1: 77.22%

| Best Test Acc: Acc@1: 79.69% | Epoch [113/1000] Iter[450/ 41] Loss: 0.5697 SupLoss: 0.4519 UsupLoss: 1.4286 NLLLoss: 0.0641 Acc@1: 99.080%

| Validation Epoch #113 Loss: 1.0020 NLLLoss: 1.0020 Acc@1: 72.72%

| Best Test Acc: Acc@1: 79.69% | Epoch [114/1000] Iter[450/ 41] Loss: 0.5972 SupLoss: 0.4715 UsupLoss: 1.4973 NLLLoss: 0.0725 Acc@1: 98.711%

| Validation Epoch #114 Loss: 0.7674 NLLLoss: 0.7674 Acc@1: 77.74%

| Best Test Acc: Acc@1: 79.69% | Epoch [115/1000] Iter[450/ 41] Loss: 0.6112 SupLoss: 0.4716 UsupLoss: 1.6512 NLLLoss: 0.0713 Acc@1: 98.667%

| Validation Epoch #115 Loss: 0.9201 NLLLoss: 0.9201 Acc@1: 70.26%

| Best Test Acc: Acc@1: 79.69% | Epoch [116/1000] Iter[450/ 41] Loss: 0.7002 SupLoss: 0.5673 UsupLoss: 1.5334 NLLLoss: 0.1141 Acc@1: 97.820%

| Validation Epoch #116 Loss: 1.1314 NLLLoss: 1.1314 Acc@1: 71.58%

| Best Test Acc: Acc@1: 79.69% | Epoch [117/1000] Iter[450/ 41] Loss: 0.9377 SupLoss: 0.7851 UsupLoss: 1.7107 NLLLoss: 0.2335 Acc@1: 94.996%

| Validation Epoch #117 Loss: 1.1536 NLLLoss: 1.1536 Acc@1: 73.14%

| Best Test Acc: Acc@1: 79.69% | Epoch [118/1000] Iter[450/ 41] Loss: 1.0191 SupLoss: 0.8702 UsupLoss: 1.6052 NLLLoss: 0.3364 Acc@1: 93.771%

| Validation Epoch #118 Loss: 0.6570 NLLLoss: 0.6570 Acc@1: 79.76%

| Best Test Acc: Epoch #118 Loss: 0.6567 NLLLoss: 0.6567 Acc@1: 80.00%

| Best Test Acc: Acc@1: 80.00% | Epoch [119/1000] Iter[450/ 41] Loss: 0.4394 SupLoss: 0.3312 UsupLoss: 1.1761 NLLLoss: 0.0574 Acc@1: 99.520%

| Validation Epoch #119 Loss: 0.7873 NLLLoss: 0.7873 Acc@1: 78.08%

| Best Test Acc: Acc@1: 80.00% | Epoch [120/1000] Iter[450/ 41] Loss: 0.4945 SupLoss: 0.3764 UsupLoss: 1.2713 NLLLoss: 0.0521 Acc@1: 99.520%

| Validation Epoch #120 Loss: 0.7921 NLLLoss: 0.7921 Acc@1: 76.58%

| Best Test Acc: Acc@1: 80.00% | Epoch [121/1000] Iter[450/ 41] Loss: 0.4700 SupLoss: 0.3674 UsupLoss: 1.0734 NLLLoss: 0.0547 Acc@1: 99.529%

| Validation Epoch #121 Loss: 0.7297 NLLLoss: 0.7297 Acc@1: 77.96%

| Best Test Acc: Acc@1: 80.00% | Epoch [122/1000] Iter[450/ 41] Loss: 0.5124 SupLoss: 0.4046 UsupLoss: 1.1121 NLLLoss: 0.0632 Acc@1: 99.262%

| Validation Epoch #122 Loss: 0.7754 NLLLoss: 0.7754 Acc@1: 77.02%

| Best Test Acc: Acc@1: 80.00% | Epoch [123/1000] Iter[450/ 41] Loss: 0.5149 SupLoss: 0.4045 UsupLoss: 1.1230 NLLLoss: 0.0595 Acc@1: 99.398%

| Validation Epoch #123 Loss: 0.7308 NLLLoss: 0.7308 Acc@1: 78.12%

| Best Test Acc: Acc@1: 80.00% | Epoch [124/1000] Iter[450/ 41] Loss: 0.5318 SupLoss: 0.4200 UsupLoss: 1.1180 NLLLoss: 0.0679 Acc@1: 99.227%

| Validation Epoch #124 Loss: 0.8026 NLLLoss: 0.8026 Acc@1: 76.60%

| Best Test Acc: Acc@1: 80.00% | Epoch [125/1000] Iter[450/ 41] Loss: 0.4830 SupLoss: 0.3699 UsupLoss: 1.1194 NLLLoss: 0.0588 Acc@1: 99.427%

| Validation Epoch #125 Loss: 0.7722 NLLLoss: 0.7722 Acc@1: 77.44%

| Best Test Acc: Acc@1: 80.00% | Epoch [126/1000] Iter[450/ 41] Loss: 0.5331 SupLoss: 0.4232 UsupLoss: 1.0662 NLLLoss: 0.0670 Acc@1: 99.273%

| Validation Epoch #126 Loss: 0.7171 NLLLoss: 0.7171 Acc@1: 78.52%

| Best Test Acc: Acc@1: 80.00% | Epoch [127/1000] Iter[450/ 41] Loss: 0.5576 SupLoss: 0.4358 UsupLoss: 1.1708 NLLLoss: 0.0649 Acc@1: 99.231%

| Validation Epoch #127 Loss: 0.7751 NLLLoss: 0.7751 Acc@1: 76.86%

| Best Test Acc: Acc@1: 80.00% | Epoch [128/1000] Iter[450/ 41] Loss: 0.5359 SupLoss: 0.4190 UsupLoss: 1.1016 NLLLoss: 0.0640 Acc@1: 99.331%

| Validation Epoch #128 Loss: 0.7612 NLLLoss: 0.7612 Acc@1: 77.14%

| Best Test Acc: Acc@1: 80.00% | Epoch [129/1000] Iter[450/ 41] Loss: 0.5683 SupLoss: 0.4447 UsupLoss: 1.1496 NLLLoss: 0.0659 Acc@1: 99.182%

| Validation Epoch #129 Loss: 0.8011 NLLLoss: 0.8011 Acc@1: 77.42%

| Best Test Acc: Acc@1: 80.00% | Epoch [130/1000] Iter[450/ 41] Loss: 0.5198 SupLoss: 0.3955 UsupLoss: 1.1358 NLLLoss: 0.0666 Acc@1: 99.178%

| Validation Epoch #130 Loss: 0.8237 NLLLoss: 0.8237 Acc@1: 77.24%

| Best Test Acc: Acc@1: 80.00% | Epoch [131/1000] Iter[450/ 41] Loss: 0.5103 SupLoss: 0.3817 UsupLoss: 1.1619 NLLLoss: 0.0608 Acc@1: 99.284%

| Validation Epoch #131 Loss: 0.8062 NLLLoss: 0.8062 Acc@1: 76.92%

| Best Test Acc: Acc@1: 80.00% | Epoch [132/1000] Iter[450/ 41] Loss: 0.5339 SupLoss: 0.4013 UsupLoss: 1.1781 NLLLoss: 0.0608 Acc@1: 99.389%

| Validation Epoch #132 Loss: 0.8960 NLLLoss: 0.8960 Acc@1: 73.54%

| Best Test Acc: Acc@1: 80.00% | Epoch [133/1000] Iter[450/ 41] Loss: 0.5835 SupLoss: 0.4411 UsupLoss: 1.2527 NLLLoss: 0.0682 Acc@1: 99.184%

| Validation Epoch #133 Loss: 0.7907 NLLLoss: 0.7907 Acc@1: 77.22%

| Best Test Acc: Acc@1: 80.00% | Epoch [134/1000] Iter[450/ 41] Loss: 0.5459 SupLoss: 0.3981 UsupLoss: 1.2766 NLLLoss: 0.0616 Acc@1: 99.236%

| Validation Epoch #134 Loss: 0.7554 NLLLoss: 0.7554 Acc@1: 77.06%

| Best Test Acc: Acc@1: 80.00% | Epoch [135/1000] Iter[450/ 41] Loss: 0.5316 SupLoss: 0.3952 UsupLoss: 1.1559 NLLLoss: 0.0589 Acc@1: 99.347%

| Validation Epoch #135 Loss: 0.7703 NLLLoss: 0.7703 Acc@1: 77.24%

| Best Test Acc: Acc@1: 80.00% | Epoch [136/1000] Iter[450/ 41] Loss: 0.6175 SupLoss: 0.4723 UsupLoss: 1.2140 NLLLoss: 0.0671 Acc@1: 99.189%

| Validation Epoch #136 Loss: 0.9839 NLLLoss: 0.9839 Acc@1: 73.20%

| Best Test Acc: Acc@1: 80.00% | Epoch [137/1000] Iter[450/ 41] Loss: 0.5487 SupLoss: 0.4014 UsupLoss: 1.2163 NLLLoss: 0.0582 Acc@1: 99.324%

| Validation Epoch #137 Loss: 0.8843 NLLLoss: 0.8843 Acc@1: 74.56%

| Best Test Acc: Acc@1: 80.00% | Epoch [138/1000] Iter[450/ 41] Loss: 0.5906 SupLoss: 0.4490 UsupLoss: 1.1455 NLLLoss: 0.0642 Acc@1: 99.191%

| Validation Epoch #138 Loss: 0.9216 NLLLoss: 0.9216 Acc@1: 74.10%

| Best Test Acc: Acc@1: 80.00% | Epoch [139/1000] Iter[450/ 41] Loss: 0.5595 SupLoss: 0.4158 UsupLoss: 1.1447 NLLLoss: 0.0626 Acc@1: 99.209%

| Validation Epoch #139 Loss: 0.7787 NLLLoss: 0.7787 Acc@1: 76.66%

| Best Test Acc: Acc@1: 80.00% | Epoch [140/1000] Iter[450/ 41] Loss: 0.5739 SupLoss: 0.4254 UsupLoss: 1.1627 NLLLoss: 0.0663 Acc@1: 99.169%

| Validation Epoch #140 Loss: 0.8513 NLLLoss: 0.8513 Acc@1: 76.66%

| Best Test Acc: Acc@1: 80.00% | Epoch [141/1000] Iter[450/ 41] Loss: 0.5594 SupLoss: 0.4076 UsupLoss: 1.1759 NLLLoss: 0.0582 Acc@1: 99.304%

| Validation Epoch #141 Loss: 0.8939 NLLLoss: 0.8939 Acc@1: 74.80%

| Best Test Acc: Acc@1: 80.00% | Epoch [142/1000] Iter[450/ 41] Loss: 0.6363 SupLoss: 0.4745 UsupLoss: 1.2306 NLLLoss: 0.0730 Acc@1: 98.836%

| Validation Epoch #142 Loss: 0.9085 NLLLoss: 0.9085 Acc@1: 75.72%

| Best Test Acc: Acc@1: 80.00% | Epoch [143/1000] Iter[450/ 41] Loss: 0.7103 SupLoss: 0.5242 UsupLoss: 1.4028 NLLLoss: 0.0805 Acc@1: 98.509%

| Validation Epoch #143 Loss: 0.9590 NLLLoss: 0.9590 Acc@1: 75.04%

| Best Test Acc: Acc@1: 80.00% | Epoch [144/1000] Iter[450/ 41] Loss: 0.7068 SupLoss: 0.5124 UsupLoss: 1.4439 NLLLoss: 0.0780 Acc@1: 98.589%

| Validation Epoch #144 Loss: 0.9464 NLLLoss: 0.9464 Acc@1: 73.76%

| Best Test Acc: Acc@1: 80.00% | Epoch [145/1000] Iter[450/ 41] Loss: 1.1252 SupLoss: 0.8621 UsupLoss: 1.9366 NLLLoss: 0.2692 Acc@1: 94.396%

| Validation Epoch #145 Loss: 3.5693 NLLLoss: 3.5693 Acc@1: 54.60%

| Best Test Acc: Acc@1: 80.00% | Epoch [146/1000] Iter[450/ 41] Loss: 2.2529 SupLoss: 1.9921 UsupLoss: 1.8323 NLLLoss: 1.2650 Acc@1: 86.020%

| Validation Epoch #146 Loss: 0.6978 NLLLoss: 0.6978 Acc@1: 79.12%

| Best Test Acc: Acc@1: 80.00% | Epoch [147/1000] Iter[450/ 41] Loss: 0.4834 SupLoss: 0.3862 UsupLoss: 0.6465 NLLLoss: 0.1341 Acc@1: 99.189%

| Validation Epoch #147 Loss: 0.7417 NLLLoss: 0.7417 Acc@1: 78.06%

| Best Test Acc: Acc@1: 80.00% | Epoch [148/1000] Iter[450/ 41] Loss: 0.6270 SupLoss: 0.4906 UsupLoss: 0.9230 NLLLoss: 0.1424 Acc@1: 98.313%

| Validation Epoch #148 Loss: 0.6449 NLLLoss: 0.6449 Acc@1: 80.88%

| Best Test Acc: Epoch #148 Loss: 0.6747 NLLLoss: 0.6747 Acc@1: 80.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [149/1000] Iter[450/ 41] Loss: 0.5269 SupLoss: 0.4042 UsupLoss: 0.8223 NLLLoss: 0.0683 Acc@1: 99.644%

| Validation Epoch #149 Loss: 0.8551 NLLLoss: 0.8551 Acc@1: 75.40%

| Best Test Acc: Acc@1: 80.08% | Epoch [150/1000] Iter[450/ 41] Loss: 0.6020 SupLoss: 0.4497 UsupLoss: 1.0146 NLLLoss: 0.0669 Acc@1: 99.253%

| Validation Epoch #150 Loss: 0.7640 NLLLoss: 0.7640 Acc@1: 78.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [151/1000] Iter[450/ 41] Loss: 0.5804 SupLoss: 0.4321 UsupLoss: 0.9721 NLLLoss: 0.0598 Acc@1: 99.362%

| Validation Epoch #151 Loss: 0.7251 NLLLoss: 0.7251 Acc@1: 78.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [152/1000] Iter[450/ 41] Loss: 0.5878 SupLoss: 0.4327 UsupLoss: 1.0045 NLLLoss: 0.0616 Acc@1: 99.313%

| Validation Epoch #152 Loss: 0.7710 NLLLoss: 0.7710 Acc@1: 77.24%

| Best Test Acc: Acc@1: 80.08% | Epoch [153/1000] Iter[450/ 41] Loss: 0.5858 SupLoss: 0.4250 UsupLoss: 1.0279 NLLLoss: 0.0648 Acc@1: 99.207%

| Validation Epoch #153 Loss: 0.7730 NLLLoss: 0.7730 Acc@1: 77.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [154/1000] Iter[450/ 41] Loss: 0.6507 SupLoss: 0.4726 UsupLoss: 1.1270 NLLLoss: 0.0687 Acc@1: 99.049%

| Validation Epoch #154 Loss: 0.8838 NLLLoss: 0.8838 Acc@1: 75.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [155/1000] Iter[450/ 41] Loss: 0.6495 SupLoss: 0.4683 UsupLoss: 1.1274 NLLLoss: 0.0746 Acc@1: 98.862%

| Validation Epoch #155 Loss: 0.7784 NLLLoss: 0.7784 Acc@1: 78.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [156/1000] Iter[450/ 41] Loss: 0.6214 SupLoss: 0.4436 UsupLoss: 1.0898 NLLLoss: 0.0619 Acc@1: 99.151%

| Validation Epoch #156 Loss: 0.9140 NLLLoss: 0.9140 Acc@1: 74.92%

| Best Test Acc: Acc@1: 80.08% | Epoch [157/1000] Iter[450/ 41] Loss: 0.6618 SupLoss: 0.4608 UsupLoss: 1.2187 NLLLoss: 0.0724 Acc@1: 98.791%

| Validation Epoch #157 Loss: 1.0453 NLLLoss: 1.0453 Acc@1: 72.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [158/1000] Iter[450/ 41] Loss: 0.7676 SupLoss: 0.5494 UsupLoss: 1.3058 NLLLoss: 0.0991 Acc@1: 98.047%

| Validation Epoch #158 Loss: 0.9886 NLLLoss: 0.9886 Acc@1: 74.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [159/1000] Iter[450/ 41] Loss: 1.1727 SupLoss: 0.9688 UsupLoss: 1.1924 NLLLoss: 0.3940 Acc@1: 93.651%

| Validation Epoch #159 Loss: 0.6618 NLLLoss: 0.6618 Acc@1: 79.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [160/1000] Iter[450/ 41] Loss: 0.4512 SupLoss: 0.3549 UsupLoss: 0.5431 NLLLoss: 0.1083 Acc@1: 99.702%

| Validation Epoch #160 Loss: 0.6899 NLLLoss: 0.6899 Acc@1: 79.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [161/1000] Iter[450/ 41] Loss: 0.5531 SupLoss: 0.4059 UsupLoss: 0.8343 NLLLoss: 0.0559 Acc@1: 99.484%

| Validation Epoch #161 Loss: 0.8380 NLLLoss: 0.8380 Acc@1: 76.42%

| Best Test Acc: Acc@1: 80.08% | Epoch [162/1000] Iter[450/ 41] Loss: 0.5843 SupLoss: 0.4174 UsupLoss: 0.9344 NLLLoss: 0.0601 Acc@1: 99.291%

| Validation Epoch #162 Loss: 0.7868 NLLLoss: 0.7868 Acc@1: 77.32%

| Best Test Acc: Acc@1: 80.08% | Epoch [163/1000] Iter[450/ 41] Loss: 0.5861 SupLoss: 0.4131 UsupLoss: 0.9558 NLLLoss: 0.0619 Acc@1: 99.251%

| Validation Epoch #163 Loss: 0.8314 NLLLoss: 0.8314 Acc@1: 77.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [164/1000] Iter[450/ 41] Loss: 0.7091 SupLoss: 0.5012 UsupLoss: 1.1406 NLLLoss: 0.0778 Acc@1: 98.627%

| Validation Epoch #164 Loss: 1.1061 NLLLoss: 1.1061 Acc@1: 73.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [165/1000] Iter[450/ 41] Loss: 0.6998 SupLoss: 0.4808 UsupLoss: 1.1853 NLLLoss: 0.0879 Acc@1: 98.098%

| Validation Epoch #165 Loss: 0.8410 NLLLoss: 0.8410 Acc@1: 76.42%

| Best Test Acc: Acc@1: 80.08% | Epoch [166/1000] Iter[450/ 41] Loss: 0.6815 SupLoss: 0.4692 UsupLoss: 1.1313 NLLLoss: 0.0696 Acc@1: 98.791%

| Validation Epoch #166 Loss: 0.9989 NLLLoss: 0.9989 Acc@1: 74.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [167/1000] Iter[450/ 41] Loss: 0.8638 SupLoss: 0.5987 UsupLoss: 1.3998 NLLLoss: 0.1213 Acc@1: 97.309%

| Validation Epoch #167 Loss: 1.0412 NLLLoss: 1.0412 Acc@1: 73.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [168/1000] Iter[450/ 41] Loss: 2.9414 SupLoss: 2.6031 UsupLoss: 1.7463 NLLLoss: 1.7614 Acc@1: 79.578%

| Validation Epoch #168 Loss: 1.4308 NLLLoss: 1.4308 Acc@1: 55.06%

| Best Test Acc: Acc@1: 80.08% | Epoch [169/1000] Iter[450/ 41] Loss: 0.8111 SupLoss: 0.6630 UsupLoss: 0.6950 NLLLoss: 0.3656 Acc@1: 92.296%

| Validation Epoch #169 Loss: 0.9557 NLLLoss: 0.9557 Acc@1: 72.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [170/1000] Iter[450/ 41] Loss: 0.6956 SupLoss: 0.4281 UsupLoss: 1.3379 NLLLoss: 0.0920 Acc@1: 98.656%

| Validation Epoch #170 Loss: 0.8155 NLLLoss: 0.8155 Acc@1: 76.94%

| Best Test Acc: Acc@1: 80.08% | Epoch [171/1000] Iter[450/ 41] Loss: 0.6352 SupLoss: 0.3998 UsupLoss: 1.1654 NLLLoss: 0.0738 Acc@1: 99.189%

| Validation Epoch #171 Loss: 0.7060 NLLLoss: 0.7060 Acc@1: 79.36%

| Best Test Acc: Acc@1: 80.08% | Epoch [172/1000] Iter[450/ 41] Loss: 0.6456 SupLoss: 0.4303 UsupLoss: 1.0492 NLLLoss: 0.0709 Acc@1: 99.242%

| Validation Epoch #172 Loss: 0.7545 NLLLoss: 0.7545 Acc@1: 78.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [173/1000] Iter[450/ 41] Loss: 0.5950 SupLoss: 0.3856 UsupLoss: 1.0049 NLLLoss: 0.0697 Acc@1: 99.316%

| Validation Epoch #173 Loss: 0.8082 NLLLoss: 0.8082 Acc@1: 77.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [174/1000] Iter[450/ 41] Loss: 0.6083 SupLoss: 0.4133 UsupLoss: 0.9199 NLLLoss: 0.0707 Acc@1: 99.289%

| Validation Epoch #174 Loss: 0.8162 NLLLoss: 0.8162 Acc@1: 77.72%

| Best Test Acc: Acc@1: 80.08% | Epoch [175/1000] Iter[450/ 41] Loss: 0.6174 SupLoss: 0.4141 UsupLoss: 0.9511 NLLLoss: 0.0721 Acc@1: 99.149%

| Validation Epoch #175 Loss: 0.6958 NLLLoss: 0.6958 Acc@1: 78.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [176/1000] Iter[450/ 41] Loss: 0.6243 SupLoss: 0.4451 UsupLoss: 0.8247 NLLLoss: 0.0699 Acc@1: 99.289%

| Validation Epoch #176 Loss: 0.7796 NLLLoss: 0.7796 Acc@1: 76.28%

| Best Test Acc: Acc@1: 80.08% | Epoch [177/1000] Iter[450/ 41] Loss: 0.5687 SupLoss: 0.3802 UsupLoss: 0.8583 NLLLoss: 0.0656 Acc@1: 99.353%

| Validation Epoch #177 Loss: 0.7740 NLLLoss: 0.7740 Acc@1: 78.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [178/1000] Iter[450/ 41] Loss: 0.5729 SupLoss: 0.3893 UsupLoss: 0.8233 NLLLoss: 0.0669 Acc@1: 99.322%

| Validation Epoch #178 Loss: 0.8077 NLLLoss: 0.8077 Acc@1: 77.36%

| Best Test Acc: Acc@1: 80.08% | Epoch [179/1000] Iter[450/ 41] Loss: 0.5801 SupLoss: 0.3895 UsupLoss: 0.8436 NLLLoss: 0.0634 Acc@1: 99.336%

| Validation Epoch #179 Loss: 0.7797 NLLLoss: 0.7797 Acc@1: 77.38%

| Best Test Acc: Acc@1: 80.08% | Epoch [180/1000] Iter[450/ 41] Loss: 0.5952 SupLoss: 0.4096 UsupLoss: 0.8089 NLLLoss: 0.0669 Acc@1: 99.378%

| Validation Epoch #180 Loss: 0.7503 NLLLoss: 0.7503 Acc@1: 78.14%

| Best Test Acc: Acc@1: 80.08% | Epoch [181/1000] Iter[450/ 41] Loss: 0.6294 SupLoss: 0.4430 UsupLoss: 0.8002 NLLLoss: 0.0727 Acc@1: 99.118%

| Validation Epoch #181 Loss: 0.6917 NLLLoss: 0.6917 Acc@1: 78.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [182/1000] Iter[450/ 41] Loss: 0.5890 SupLoss: 0.3956 UsupLoss: 0.8235 NLLLoss: 0.0626 Acc@1: 99.400%

| Validation Epoch #182 Loss: 0.7528 NLLLoss: 0.7528 Acc@1: 77.26%

| Best Test Acc: Acc@1: 80.08% | Epoch [183/1000] Iter[450/ 41] Loss: 0.6268 SupLoss: 0.4305 UsupLoss: 0.8232 NLLLoss: 0.0702 Acc@1: 99.280%

| Validation Epoch #183 Loss: 0.7393 NLLLoss: 0.7393 Acc@1: 77.94%

| Best Test Acc: Acc@1: 80.08% | Epoch [184/1000] Iter[450/ 41] Loss: 0.5922 SupLoss: 0.3995 UsupLoss: 0.7971 NLLLoss: 0.0644 Acc@1: 99.427%

| Validation Epoch #184 Loss: 0.8789 NLLLoss: 0.8789 Acc@1: 74.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [185/1000] Iter[450/ 41] Loss: 0.5656 SupLoss: 0.3808 UsupLoss: 0.7537 NLLLoss: 0.0651 Acc@1: 99.393%

| Validation Epoch #185 Loss: 0.6858 NLLLoss: 0.6858 Acc@1: 79.58%

| Best Test Acc: Acc@1: 80.08% | Epoch [186/1000] Iter[450/ 41] Loss: 0.5993 SupLoss: 0.4212 UsupLoss: 0.7164 NLLLoss: 0.0662 Acc@1: 99.376%

| Validation Epoch #186 Loss: 0.7373 NLLLoss: 0.7373 Acc@1: 78.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [187/1000] Iter[450/ 41] Loss: 0.5695 SupLoss: 0.3910 UsupLoss: 0.7074 NLLLoss: 0.0609 Acc@1: 99.460%

| Validation Epoch #187 Loss: 0.7625 NLLLoss: 0.7625 Acc@1: 76.82%

| Best Test Acc: Acc@1: 80.08% | Epoch [188/1000] Iter[450/ 41] Loss: 0.5857 SupLoss: 0.3977 UsupLoss: 0.7357 NLLLoss: 0.0660 Acc@1: 99.449%

| Validation Epoch #188 Loss: 0.8810 NLLLoss: 0.8810 Acc@1: 75.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [189/1000] Iter[450/ 41] Loss: 0.5837 SupLoss: 0.3998 UsupLoss: 0.7090 NLLLoss: 0.0644 Acc@1: 99.351%

| Validation Epoch #189 Loss: 0.6572 NLLLoss: 0.6572 Acc@1: 79.74%

| Best Test Acc: Acc@1: 80.08% | Epoch [190/1000] Iter[450/ 41] Loss: 0.5729 SupLoss: 0.3971 UsupLoss: 0.6681 NLLLoss: 0.0712 Acc@1: 99.422%

| Validation Epoch #190 Loss: 0.7560 NLLLoss: 0.7560 Acc@1: 77.24%

| Best Test Acc: Acc@1: 80.08% | Epoch [191/1000] Iter[450/ 41] Loss: 0.5619 SupLoss: 0.3658 UsupLoss: 0.7397 NLLLoss: 0.0605 Acc@1: 99.407%

| Validation Epoch #191 Loss: 0.7222 NLLLoss: 0.7222 Acc@1: 78.20%

| Best Test Acc: Acc@1: 80.08% | Epoch [192/1000] Iter[450/ 41] Loss: 0.5505 SupLoss: 0.3477 UsupLoss: 0.7565 NLLLoss: 0.0585 Acc@1: 99.400%

| Validation Epoch #192 Loss: 0.7765 NLLLoss: 0.7765 Acc@1: 78.80%

| Best Test Acc: Acc@1: 80.08% | Epoch [193/1000] Iter[450/ 41] Loss: 0.6502 SupLoss: 0.4524 UsupLoss: 0.7267 NLLLoss: 0.0688 Acc@1: 99.300%

| Validation Epoch #193 Loss: 0.9164 NLLLoss: 0.9164 Acc@1: 70.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [194/1000] Iter[450/ 41] Loss: 0.6404 SupLoss: 0.4290 UsupLoss: 0.7702 NLLLoss: 0.0667 Acc@1: 99.309%

| Validation Epoch #194 Loss: 0.7652 NLLLoss: 0.7652 Acc@1: 79.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [195/1000] Iter[450/ 41] Loss: 0.5929 SupLoss: 0.3799 UsupLoss: 0.7652 NLLLoss: 0.0671 Acc@1: 99.362%

| Validation Epoch #195 Loss: 0.7435 NLLLoss: 0.7435 Acc@1: 78.82%

| Best Test Acc: Acc@1: 80.08% | Epoch [196/1000] Iter[450/ 41] Loss: 0.5720 SupLoss: 0.3536 UsupLoss: 0.7755 NLLLoss: 0.0641 Acc@1: 99.400%

| Validation Epoch #196 Loss: 0.7113 NLLLoss: 0.7113 Acc@1: 80.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [197/1000] Iter[450/ 41] Loss: 0.5744 SupLoss: 0.3617 UsupLoss: 0.7456 NLLLoss: 0.0588 Acc@1: 99.482%

| Validation Epoch #197 Loss: 0.7592 NLLLoss: 0.7592 Acc@1: 79.16%

| Best Test Acc: Acc@1: 80.08% | Epoch [198/1000] Iter[450/ 41] Loss: 0.5994 SupLoss: 0.3933 UsupLoss: 0.7125 NLLLoss: 0.0682 Acc@1: 99.373%

| Validation Epoch #198 Loss: 0.7417 NLLLoss: 0.7417 Acc@1: 78.66%

| Best Test Acc: Acc@1: 80.08% | Epoch [199/1000] Iter[450/ 41] Loss: 0.5871 SupLoss: 0.3626 UsupLoss: 0.7683 NLLLoss: 0.0611 Acc@1: 99.460%

| Validation Epoch #199 Loss: 0.8211 NLLLoss: 0.8211 Acc@1: 77.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [200/1000] Iter[450/ 41] Loss: 0.6179 SupLoss: 0.4029 UsupLoss: 0.7269 NLLLoss: 0.0640 Acc@1: 99.469%

| Validation Epoch #200 Loss: 0.7352 NLLLoss: 0.7352 Acc@1: 78.52%

| Best Test Acc: Acc@1: 80.08% | Epoch [201/1000] Iter[450/ 41] Loss: 0.6365 SupLoss: 0.4125 UsupLoss: 0.7477 NLLLoss: 0.0674 Acc@1: 99.369%

| Validation Epoch #201 Loss: 0.7935 NLLLoss: 0.7935 Acc@1: 77.72%

| Best Test Acc: Acc@1: 80.08% | Epoch [202/1000] Iter[450/ 41] Loss: 0.6349 SupLoss: 0.4049 UsupLoss: 0.7587 NLLLoss: 0.0665 Acc@1: 99.402%

| Validation Epoch #202 Loss: 0.7980 NLLLoss: 0.7980 Acc@1: 74.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [203/1000] Iter[450/ 41] Loss: 0.6259 SupLoss: 0.4168 UsupLoss: 0.6793 NLLLoss: 0.0694 Acc@1: 99.378%

| Validation Epoch #203 Loss: 0.7824 NLLLoss: 0.7824 Acc@1: 77.38%

| Best Test Acc: Acc@1: 80.08% | Epoch [204/1000] Iter[450/ 41] Loss: 0.6080 SupLoss: 0.3908 UsupLoss: 0.6974 NLLLoss: 0.0642 Acc@1: 99.542%

| Validation Epoch #204 Loss: 0.6954 NLLLoss: 0.6954 Acc@1: 78.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [205/1000] Iter[450/ 41] Loss: 0.6543 SupLoss: 0.4247 UsupLoss: 0.7302 NLLLoss: 0.0675 Acc@1: 99.287%

| Validation Epoch #205 Loss: 0.7744 NLLLoss: 0.7744 Acc@1: 78.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [206/1000] Iter[450/ 41] Loss: 0.6984 SupLoss: 0.4611 UsupLoss: 0.7461 NLLLoss: 0.0700 Acc@1: 99.287%

| Validation Epoch #206 Loss: 0.8343 NLLLoss: 0.8343 Acc@1: 75.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [207/1000] Iter[450/ 41] Loss: 0.6641 SupLoss: 0.4173 UsupLoss: 0.7675 NLLLoss: 0.0676 Acc@1: 99.267%

| Validation Epoch #207 Loss: 0.7619 NLLLoss: 0.7619 Acc@1: 75.92%

| Best Test Acc: Acc@1: 80.08% | Epoch [208/1000] Iter[450/ 41] Loss: 0.7590 SupLoss: 0.4689 UsupLoss: 0.8944 NLLLoss: 0.0771 Acc@1: 98.964%

| Validation Epoch #208 Loss: 0.8450 NLLLoss: 0.8450 Acc@1: 76.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [209/1000] Iter[450/ 41] Loss: 0.8139 SupLoss: 0.4972 UsupLoss: 0.9660 NLLLoss: 0.0766 Acc@1: 98.853%

| Validation Epoch #209 Loss: 0.9741 NLLLoss: 0.9741 Acc@1: 73.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [210/1000] Iter[450/ 41] Loss: 0.8186 SupLoss: 0.4902 UsupLoss: 0.9903 NLLLoss: 0.0845 Acc@1: 98.558%

| Validation Epoch #210 Loss: 0.7534 NLLLoss: 0.7534 Acc@1: 79.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [211/1000] Iter[450/ 41] Loss: 0.8675 SupLoss: 0.5457 UsupLoss: 0.9579 NLLLoss: 0.0840 Acc@1: 98.591%

| Validation Epoch #211 Loss: 1.0166 NLLLoss: 1.0166 Acc@1: 73.52%

| Best Test Acc: Acc@1: 80.08% | Epoch [212/1000] Iter[450/ 41] Loss: 0.6940 SupLoss: 0.4619 UsupLoss: 0.6790 NLLLoss: 0.1100 Acc@1: 98.584%

| Validation Epoch #212 Loss: 0.6975 NLLLoss: 0.6975 Acc@1: 79.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [213/1000] Iter[450/ 41] Loss: 0.6082 SupLoss: 0.3738 UsupLoss: 0.6774 NLLLoss: 0.0554 Acc@1: 99.609%

| Validation Epoch #213 Loss: 1.0251 NLLLoss: 1.0251 Acc@1: 73.36%

| Best Test Acc: Acc@1: 80.08% | Epoch [214/1000] Iter[450/ 41] Loss: 0.6501 SupLoss: 0.3861 UsupLoss: 0.7566 NLLLoss: 0.0608 Acc@1: 99.364%

| Validation Epoch #214 Loss: 1.0321 NLLLoss: 1.0321 Acc@1: 71.06%

| Best Test Acc: Acc@1: 80.08% | Epoch [215/1000] Iter[450/ 41] Loss: 1.6963 SupLoss: 1.2936 UsupLoss: 1.1419 NLLLoss: 0.6178 Acc@1: 89.482%

| Validation Epoch #215 Loss: 2.6637 NLLLoss: 2.6637 Acc@1: 61.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [216/1000] Iter[450/ 41] Loss: 2.0447 SupLoss: 1.6869 UsupLoss: 0.9825 NLLLoss: 1.1764 Acc@1: 87.427%

| Validation Epoch #216 Loss: 0.7775 NLLLoss: 0.7775 Acc@1: 77.52%

| Best Test Acc: Acc@1: 80.08% | Epoch [217/1000] Iter[450/ 41] Loss: 0.8156 SupLoss: 0.4642 UsupLoss: 0.9705 NLLLoss: 0.0893 Acc@1: 98.820%

| Validation Epoch #217 Loss: 0.7753 NLLLoss: 0.7753 Acc@1: 78.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [218/1000] Iter[450/ 41] Loss: 0.6693 SupLoss: 0.3625 UsupLoss: 0.8409 NLLLoss: 0.0707 Acc@1: 99.378%

| Validation Epoch #218 Loss: 0.8346 NLLLoss: 0.8346 Acc@1: 77.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [219/1000] Iter[450/ 41] Loss: 0.6845 SupLoss: 0.4087 UsupLoss: 0.7465 NLLLoss: 0.0702 Acc@1: 99.378%

| Validation Epoch #219 Loss: 0.7932 NLLLoss: 0.7932 Acc@1: 75.42%

| Best Test Acc: Acc@1: 80.08% | Epoch [220/1000] Iter[450/ 41] Loss: 0.6393 SupLoss: 0.3949 UsupLoss: 0.6527 NLLLoss: 0.0654 Acc@1: 99.453%

| Validation Epoch #220 Loss: 0.6871 NLLLoss: 0.6871 Acc@1: 79.52%

| Best Test Acc: Acc@1: 80.08% | Epoch [221/1000] Iter[450/ 41] Loss: 0.5986 SupLoss: 0.3502 UsupLoss: 0.6571 NLLLoss: 0.0647 Acc@1: 99.418%

| Validation Epoch #221 Loss: 0.7239 NLLLoss: 0.7239 Acc@1: 79.16%

| Best Test Acc: Acc@1: 80.08% | Epoch [222/1000] Iter[450/ 41] Loss: 0.6505 SupLoss: 0.3966 UsupLoss: 0.6642 NLLLoss: 0.0662 Acc@1: 99.409%

| Validation Epoch #222 Loss: 0.8646 NLLLoss: 0.8646 Acc@1: 75.06%

| Best Test Acc: Acc@1: 80.08% | Epoch [223/1000] Iter[450/ 41] Loss: 0.6579 SupLoss: 0.3936 UsupLoss: 0.6848 NLLLoss: 0.0713 Acc@1: 99.173%

| Validation Epoch #223 Loss: 0.8042 NLLLoss: 0.8042 Acc@1: 76.74%

| Best Test Acc: Acc@1: 80.08% | Epoch [224/1000] Iter[450/ 41] Loss: 0.6366 SupLoss: 0.3732 UsupLoss: 0.6750 NLLLoss: 0.0696 Acc@1: 99.376%

| Validation Epoch #224 Loss: 0.7453 NLLLoss: 0.7453 Acc@1: 77.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [225/1000] Iter[450/ 41] Loss: 0.6924 SupLoss: 0.4280 UsupLoss: 0.6702 NLLLoss: 0.0718 Acc@1: 99.387%

| Validation Epoch #225 Loss: 0.6564 NLLLoss: 0.6564 Acc@1: 79.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [226/1000] Iter[450/ 41] Loss: 0.6828 SupLoss: 0.4192 UsupLoss: 0.6604 NLLLoss: 0.0723 Acc@1: 99.344%

| Validation Epoch #226 Loss: 0.7430 NLLLoss: 0.7430 Acc@1: 77.52%

| Best Test Acc: Acc@1: 80.08% | Epoch [227/1000] Iter[450/ 41] Loss: 0.6729 SupLoss: 0.4054 UsupLoss: 0.6634 NLLLoss: 0.0775 Acc@1: 99.380%

| Validation Epoch #227 Loss: 0.7787 NLLLoss: 0.7787 Acc@1: 77.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [228/1000] Iter[450/ 41] Loss: 0.6911 SupLoss: 0.4278 UsupLoss: 0.6458 NLLLoss: 0.0716 Acc@1: 99.322%

| Validation Epoch #228 Loss: 0.7464 NLLLoss: 0.7464 Acc@1: 78.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [229/1000] Iter[450/ 41] Loss: 0.6478 SupLoss: 0.3825 UsupLoss: 0.6438 NLLLoss: 0.0686 Acc@1: 99.373%

| Validation Epoch #229 Loss: 0.7991 NLLLoss: 0.7991 Acc@1: 77.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [230/1000] Iter[450/ 41] Loss: 0.7162 SupLoss: 0.4330 UsupLoss: 0.6811 NLLLoss: 0.0718 Acc@1: 99.349%

| Validation Epoch #230 Loss: 0.9589 NLLLoss: 0.9589 Acc@1: 73.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [231/1000] Iter[450/ 41] Loss: 0.6817 SupLoss: 0.4246 UsupLoss: 0.6102 NLLLoss: 0.0809 Acc@1: 99.289%

| Validation Epoch #231 Loss: 0.7143 NLLLoss: 0.7143 Acc@1: 78.28%

| Best Test Acc: Acc@1: 80.08% | Epoch [232/1000] Iter[450/ 41] Loss: 0.6608 SupLoss: 0.3832 UsupLoss: 0.6534 NLLLoss: 0.0712 Acc@1: 99.393%

| Validation Epoch #232 Loss: 0.7591 NLLLoss: 0.7591 Acc@1: 78.86%

| Best Test Acc: Acc@1: 80.08% | Epoch [233/1000] Iter[450/ 41] Loss: 0.6588 SupLoss: 0.3994 UsupLoss: 0.6038 NLLLoss: 0.0690 Acc@1: 99.398%

| Validation Epoch #233 Loss: 0.7816 NLLLoss: 0.7816 Acc@1: 77.32%

| Best Test Acc: Acc@1: 80.08% | Epoch [234/1000] Iter[450/ 41] Loss: 0.6677 SupLoss: 0.3980 UsupLoss: 0.6214 NLLLoss: 0.0751 Acc@1: 99.344%

| Validation Epoch #234 Loss: 0.7523 NLLLoss: 0.7523 Acc@1: 76.64%

| Best Test Acc: Acc@1: 80.08% | Epoch [235/1000] Iter[450/ 41] Loss: 0.6695 SupLoss: 0.3944 UsupLoss: 0.6279 NLLLoss: 0.0682 Acc@1: 99.424%

| Validation Epoch #235 Loss: 0.7460 NLLLoss: 0.7460 Acc@1: 77.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [236/1000] Iter[450/ 41] Loss: 0.6958 SupLoss: 0.4168 UsupLoss: 0.6304 NLLLoss: 0.0697 Acc@1: 99.296%

| Validation Epoch #236 Loss: 0.8115 NLLLoss: 0.8115 Acc@1: 77.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [237/1000] Iter[450/ 41] Loss: 0.6344 SupLoss: 0.3794 UsupLoss: 0.5694 NLLLoss: 0.0674 Acc@1: 99.542%

| Validation Epoch #237 Loss: 0.6944 NLLLoss: 0.6944 Acc@1: 79.94%

| Best Test Acc: Acc@1: 80.08% | Epoch [238/1000] Iter[450/ 41] Loss: 0.6701 SupLoss: 0.3863 UsupLoss: 0.6288 NLLLoss: 0.0680 Acc@1: 99.380%

| Validation Epoch #238 Loss: 0.7424 NLLLoss: 0.7424 Acc@1: 77.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [239/1000] Iter[450/ 41] Loss: 0.6939 SupLoss: 0.4146 UsupLoss: 0.6126 NLLLoss: 0.0684 Acc@1: 99.393%

| Validation Epoch #239 Loss: 0.7374 NLLLoss: 0.7374 Acc@1: 76.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [240/1000] Iter[450/ 41] Loss: 0.6999 SupLoss: 0.4191 UsupLoss: 0.6093 NLLLoss: 0.0728 Acc@1: 99.356%

| Validation Epoch #240 Loss: 0.7580 NLLLoss: 0.7580 Acc@1: 78.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [241/1000] Iter[450/ 41] Loss: 0.6670 SupLoss: 0.3868 UsupLoss: 0.6020 NLLLoss: 0.0747 Acc@1: 99.327%

| Validation Epoch #241 Loss: 0.7096 NLLLoss: 0.7096 Acc@1: 78.64%

| Best Test Acc: Acc@1: 80.08% | Epoch [242/1000] Iter[450/ 41] Loss: 0.7023 SupLoss: 0.4231 UsupLoss: 0.5939 NLLLoss: 0.0709 Acc@1: 99.404%

| Validation Epoch #242 Loss: 0.6831 NLLLoss: 0.6831 Acc@1: 79.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [243/1000] Iter[450/ 41] Loss: 0.6481 SupLoss: 0.3595 UsupLoss: 0.6080 NLLLoss: 0.0674 Acc@1: 99.436%

| Validation Epoch #243 Loss: 0.8613 NLLLoss: 0.8613 Acc@1: 75.56%

| Best Test Acc: Acc@1: 80.08% | Epoch [244/1000] Iter[450/ 41] Loss: 0.7061 SupLoss: 0.4118 UsupLoss: 0.6145 NLLLoss: 0.0708 Acc@1: 99.382%

| Validation Epoch #244 Loss: 0.7056 NLLLoss: 0.7056 Acc@1: 78.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [245/1000] Iter[450/ 41] Loss: 0.6945 SupLoss: 0.4055 UsupLoss: 0.5971 NLLLoss: 0.0724 Acc@1: 99.398%

| Validation Epoch #245 Loss: 0.8481 NLLLoss: 0.8481 Acc@1: 75.68%

| Best Test Acc: Acc@1: 80.08% | Epoch [246/1000] Iter[450/ 41] Loss: 0.6847 SupLoss: 0.3884 UsupLoss: 0.6069 NLLLoss: 0.0774 Acc@1: 99.402%

| Validation Epoch #246 Loss: 0.7665 NLLLoss: 0.7665 Acc@1: 77.80%

| Best Test Acc: Acc@1: 80.08% | Epoch [247/1000] Iter[450/ 41] Loss: 0.7431 SupLoss: 0.4115 UsupLoss: 0.6741 NLLLoss: 0.0718 Acc@1: 99.300%

| Validation Epoch #247 Loss: 0.7958 NLLLoss: 0.7958 Acc@1: 77.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [248/1000] Iter[450/ 41] Loss: 0.6745 SupLoss: 0.3715 UsupLoss: 0.6092 NLLLoss: 0.0686 Acc@1: 99.347%

| Validation Epoch #248 Loss: 0.7711 NLLLoss: 0.7711 Acc@1: 75.72%

| Best Test Acc: Acc@1: 80.08% | Epoch [249/1000] Iter[450/ 41] Loss: 0.6663 SupLoss: 0.3658 UsupLoss: 0.5987 NLLLoss: 0.0677 Acc@1: 99.487%

| Validation Epoch #249 Loss: 0.7484 NLLLoss: 0.7484 Acc@1: 77.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [250/1000] Iter[450/ 41] Loss: 0.6753 SupLoss: 0.3851 UsupLoss: 0.5716 NLLLoss: 0.0694 Acc@1: 99.484%

| Validation Epoch #250 Loss: 0.7856 NLLLoss: 0.7856 Acc@1: 77.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [251/1000] Iter[450/ 41] Loss: 0.7215 SupLoss: 0.4211 UsupLoss: 0.5871 NLLLoss: 0.0725 Acc@1: 99.300%

| Validation Epoch #251 Loss: 0.7475 NLLLoss: 0.7475 Acc@1: 76.56%

| Best Test Acc: Acc@1: 80.08% | Epoch [252/1000] Iter[450/ 41] Loss: 0.6763 SupLoss: 0.3672 UsupLoss: 0.5984 NLLLoss: 0.0751 Acc@1: 99.276%

| Validation Epoch #252 Loss: 0.7265 NLLLoss: 0.7265 Acc@1: 77.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [253/1000] Iter[450/ 41] Loss: 0.7155 SupLoss: 0.3944 UsupLoss: 0.6173 NLLLoss: 0.0676 Acc@1: 99.324%

| Validation Epoch #253 Loss: 0.7220 NLLLoss: 0.7220 Acc@1: 79.32%

| Best Test Acc: Acc@1: 80.08% | Epoch [254/1000] Iter[450/ 41] Loss: 0.7008 SupLoss: 0.3952 UsupLoss: 0.5807 NLLLoss: 0.0735 Acc@1: 99.416%

| Validation Epoch #254 Loss: 0.7234 NLLLoss: 0.7234 Acc@1: 78.50%

| Best Test Acc: Acc@1: 80.08% | Epoch [255/1000] Iter[450/ 41] Loss: 0.7387 SupLoss: 0.4188 UsupLoss: 0.6037 NLLLoss: 0.0735 Acc@1: 99.200%

| Validation Epoch #255 Loss: 0.6870 NLLLoss: 0.6870 Acc@1: 79.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [256/1000] Iter[450/ 41] Loss: 0.7129 SupLoss: 0.4086 UsupLoss: 0.5685 NLLLoss: 0.0746 Acc@1: 99.289%

| Validation Epoch #256 Loss: 0.7266 NLLLoss: 0.7266 Acc@1: 78.50%

| Best Test Acc: Acc@1: 80.08% | Epoch [257/1000] Iter[450/ 41] Loss: 0.7103 SupLoss: 0.4119 UsupLoss: 0.5521 NLLLoss: 0.0796 Acc@1: 99.258%

| Validation Epoch #257 Loss: 0.7104 NLLLoss: 0.7104 Acc@1: 78.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [258/1000] Iter[450/ 41] Loss: 0.7265 SupLoss: 0.3971 UsupLoss: 0.6047 NLLLoss: 0.0723 Acc@1: 99.380%

| Validation Epoch #258 Loss: 0.7900 NLLLoss: 0.7900 Acc@1: 75.96%

| Best Test Acc: Acc@1: 80.08% | Epoch [259/1000] Iter[450/ 41] Loss: 0.7113 SupLoss: 0.3828 UsupLoss: 0.5980 NLLLoss: 0.0748 Acc@1: 99.282%

| Validation Epoch #259 Loss: 0.7534 NLLLoss: 0.7534 Acc@1: 78.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [260/1000] Iter[450/ 41] Loss: 0.7444 SupLoss: 0.4283 UsupLoss: 0.5688 NLLLoss: 0.0848 Acc@1: 99.282%

| Validation Epoch #260 Loss: 0.7999 NLLLoss: 0.7999 Acc@1: 77.26%

| Best Test Acc: Acc@1: 80.08% | Epoch [261/1000] Iter[450/ 41] Loss: 0.6991 SupLoss: 0.3953 UsupLoss: 0.5421 NLLLoss: 0.0842 Acc@1: 99.173%

| Validation Epoch #261 Loss: 0.7790 NLLLoss: 0.7790 Acc@1: 75.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [262/1000] Iter[450/ 41] Loss: 0.7134 SupLoss: 0.3984 UsupLoss: 0.5579 NLLLoss: 0.0723 Acc@1: 99.427%

| Validation Epoch #262 Loss: 0.6906 NLLLoss: 0.6906 Acc@1: 78.14%

| Best Test Acc: Acc@1: 80.08% | Epoch [263/1000] Iter[450/ 41] Loss: 0.7446 SupLoss: 0.4348 UsupLoss: 0.5433 NLLLoss: 0.0787 Acc@1: 99.307%

| Validation Epoch #263 Loss: 0.7577 NLLLoss: 0.7577 Acc@1: 77.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [264/1000] Iter[450/ 41] Loss: 0.7546 SupLoss: 0.4357 UsupLoss: 0.5550 NLLLoss: 0.0810 Acc@1: 99.304%

| Validation Epoch #264 Loss: 0.7223 NLLLoss: 0.7223 Acc@1: 78.84%

| Best Test Acc: Acc@1: 80.08% | Epoch [265/1000] Iter[450/ 41] Loss: 0.7414 SupLoss: 0.4011 UsupLoss: 0.5881 NLLLoss: 0.0778 Acc@1: 99.249%

| Validation Epoch #265 Loss: 0.7557 NLLLoss: 0.7557 Acc@1: 77.74%

| Best Test Acc: Acc@1: 80.08% | Epoch [266/1000] Iter[450/ 41] Loss: 0.6997 SupLoss: 0.3932 UsupLoss: 0.5241 NLLLoss: 0.0765 Acc@1: 99.276%

| Validation Epoch #266 Loss: 0.7195 NLLLoss: 0.7195 Acc@1: 78.68%

| Best Test Acc: Acc@1: 80.08% | Epoch [267/1000] Iter[450/ 41] Loss: 0.6909 SupLoss: 0.3829 UsupLoss: 0.5225 NLLLoss: 0.0765 Acc@1: 99.353%

| Validation Epoch #267 Loss: 0.7979 NLLLoss: 0.7979 Acc@1: 77.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [268/1000] Iter[450/ 41] Loss: 0.7251 SupLoss: 0.3895 UsupLoss: 0.5657 NLLLoss: 0.0785 Acc@1: 99.338%

| Validation Epoch #268 Loss: 0.8481 NLLLoss: 0.8481 Acc@1: 76.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [269/1000] Iter[450/ 41] Loss: 0.7226 SupLoss: 0.4068 UsupLoss: 0.5270 NLLLoss: 0.0835 Acc@1: 99.198%

| Validation Epoch #269 Loss: 0.6557 NLLLoss: 0.6557 Acc@1: 80.52%

| Best Test Acc: Acc@1: 80.08% | Epoch [270/1000] Iter[450/ 41] Loss: 0.7307 SupLoss: 0.3874 UsupLoss: 0.5687 NLLLoss: 0.0778 Acc@1: 99.267%

| Validation Epoch #270 Loss: 0.7693 NLLLoss: 0.7693 Acc@1: 76.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [271/1000] Iter[450/ 41] Loss: 0.7615 SupLoss: 0.4211 UsupLoss: 0.5598 NLLLoss: 0.0818 Acc@1: 99.180%

| Validation Epoch #271 Loss: 0.8162 NLLLoss: 0.8162 Acc@1: 77.96%

| Best Test Acc: Acc@1: 80.08% | Epoch [272/1000] Iter[450/ 41] Loss: 0.7845 SupLoss: 0.4328 UsupLoss: 0.5739 NLLLoss: 0.0836 Acc@1: 99.173%

| Validation Epoch #272 Loss: 0.7750 NLLLoss: 0.7750 Acc@1: 75.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [273/1000] Iter[450/ 41] Loss: 0.7592 SupLoss: 0.4091 UsupLoss: 0.5667 NLLLoss: 0.0821 Acc@1: 99.216%

| Validation Epoch #273 Loss: 0.8309 NLLLoss: 0.8309 Acc@1: 76.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [274/1000] Iter[450/ 41] Loss: 0.7451 SupLoss: 0.4011 UsupLoss: 0.5520 NLLLoss: 0.0739 Acc@1: 99.373%

| Validation Epoch #274 Loss: 0.7997 NLLLoss: 0.7997 Acc@1: 75.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [275/1000] Iter[450/ 41] Loss: 0.7450 SupLoss: 0.4186 UsupLoss: 0.5197 NLLLoss: 0.0853 Acc@1: 99.264%

| Validation Epoch #275 Loss: 0.6895 NLLLoss: 0.6895 Acc@1: 79.40%

| Best Test Acc: Acc@1: 80.08% | Epoch [276/1000] Iter[450/ 41] Loss: 0.8318 SupLoss: 0.4624 UsupLoss: 0.5845 NLLLoss: 0.0813 Acc@1: 99.176%

| Validation Epoch #276 Loss: 0.7982 NLLLoss: 0.7982 Acc@1: 78.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [277/1000] Iter[450/ 41] Loss: 0.7893 SupLoss: 0.4211 UsupLoss: 0.5779 NLLLoss: 0.0828 Acc@1: 99.102%

| Validation Epoch #277 Loss: 0.9473 NLLLoss: 0.9473 Acc@1: 74.28%

| Best Test Acc: Acc@1: 80.08% | Epoch [278/1000] Iter[450/ 41] Loss: 0.7707 SupLoss: 0.4286 UsupLoss: 0.5325 NLLLoss: 0.0825 Acc@1: 99.220%

| Validation Epoch #278 Loss: 0.7821 NLLLoss: 0.7821 Acc@1: 77.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [279/1000] Iter[450/ 41] Loss: 0.7758 SupLoss: 0.4402 UsupLoss: 0.5179 NLLLoss: 0.0866 Acc@1: 99.129%

| Validation Epoch #279 Loss: 0.8071 NLLLoss: 0.8071 Acc@1: 77.24%

| Best Test Acc: Acc@1: 80.08% | Epoch [280/1000] Iter[450/ 41] Loss: 0.7526 SupLoss: 0.3824 UsupLoss: 0.5682 NLLLoss: 0.0825 Acc@1: 99.180%

| Validation Epoch #280 Loss: 0.8734 NLLLoss: 0.8734 Acc@1: 76.30%

| Best Test Acc: Acc@1: 80.08% | Epoch [281/1000] Iter[450/ 41] Loss: 0.7833 SupLoss: 0.4335 UsupLoss: 0.5323 NLLLoss: 0.0886 Acc@1: 99.184%

| Validation Epoch #281 Loss: 0.7423 NLLLoss: 0.7423 Acc@1: 77.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [282/1000] Iter[450/ 41] Loss: 0.8052 SupLoss: 0.4227 UsupLoss: 0.5790 NLLLoss: 0.0822 Acc@1: 99.227%

| Validation Epoch #282 Loss: 0.8472 NLLLoss: 0.8472 Acc@1: 76.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [283/1000] Iter[450/ 41] Loss: 0.7574 SupLoss: 0.4160 UsupLoss: 0.5118 NLLLoss: 0.0898 Acc@1: 99.024%

| Validation Epoch #283 Loss: 0.8021 NLLLoss: 0.8021 Acc@1: 77.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [284/1000] Iter[450/ 41] Loss: 0.7894 SupLoss: 0.4341 UsupLoss: 0.5287 NLLLoss: 0.0855 Acc@1: 99.096%

| Validation Epoch #284 Loss: 0.8242 NLLLoss: 0.8242 Acc@1: 76.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [285/1000] Iter[450/ 41] Loss: 0.7365 SupLoss: 0.3845 UsupLoss: 0.5192 NLLLoss: 0.0781 Acc@1: 99.267%

| Validation Epoch #285 Loss: 0.7920 NLLLoss: 0.7920 Acc@1: 77.38%

| Best Test Acc: Acc@1: 80.08% | Epoch [286/1000] Iter[450/ 41] Loss: 0.8338 SupLoss: 0.4423 UsupLoss: 0.5738 NLLLoss: 0.0862 Acc@1: 99.096%

| Validation Epoch #286 Loss: 0.7445 NLLLoss: 0.7445 Acc@1: 77.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [287/1000] Iter[450/ 41] Loss: 0.8215 SupLoss: 0.4273 UsupLoss: 0.5735 NLLLoss: 0.0841 Acc@1: 99.142%

| Validation Epoch #287 Loss: 0.7641 NLLLoss: 0.7641 Acc@1: 77.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [288/1000] Iter[450/ 41] Loss: 0.7711 SupLoss: 0.3925 UsupLoss: 0.5466 NLLLoss: 0.0850 Acc@1: 99.140%

| Validation Epoch #288 Loss: 0.7882 NLLLoss: 0.7882 Acc@1: 77.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [289/1000] Iter[450/ 41] Loss: 0.8094 SupLoss: 0.3919 UsupLoss: 0.5997 NLLLoss: 0.0853 Acc@1: 99.089%

| Validation Epoch #289 Loss: 0.7350 NLLLoss: 0.7350 Acc@1: 77.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [290/1000] Iter[450/ 41] Loss: 0.8067 SupLoss: 0.4291 UsupLoss: 0.5372 NLLLoss: 0.0869 Acc@1: 99.171%

| Validation Epoch #290 Loss: 0.7201 NLLLoss: 0.7201 Acc@1: 79.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [291/1000] Iter[450/ 41] Loss: 0.7905 SupLoss: 0.4024 UsupLoss: 0.5491 NLLLoss: 0.0834 Acc@1: 99.138%

| Validation Epoch #291 Loss: 0.7796 NLLLoss: 0.7796 Acc@1: 78.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [292/1000] Iter[450/ 41] Loss: 0.7622 SupLoss: 0.3823 UsupLoss: 0.5341 NLLLoss: 0.0823 Acc@1: 99.284%

| Validation Epoch #292 Loss: 0.7843 NLLLoss: 0.7843 Acc@1: 77.24%

| Best Test Acc: Acc@1: 80.08% | Epoch [293/1000] Iter[450/ 41] Loss: 0.7665 SupLoss: 0.3931 UsupLoss: 0.5208 NLLLoss: 0.0836 Acc@1: 99.247%

| Validation Epoch #293 Loss: 0.7518 NLLLoss: 0.7518 Acc@1: 78.28%

| Best Test Acc: Acc@1: 80.08% | Epoch [294/1000] Iter[450/ 41] Loss: 0.8243 SupLoss: 0.4344 UsupLoss: 0.5403 NLLLoss: 0.0875 Acc@1: 99.122%

| Validation Epoch #294 Loss: 0.7337 NLLLoss: 0.7337 Acc@1: 78.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [295/1000] Iter[450/ 41] Loss: 0.8018 SupLoss: 0.3865 UsupLoss: 0.5734 NLLLoss: 0.0834 Acc@1: 99.193%

| Validation Epoch #295 Loss: 0.7175 NLLLoss: 0.7175 Acc@1: 77.56%

| Best Test Acc: Acc@1: 80.08% | Epoch [296/1000] Iter[450/ 41] Loss: 0.7771 SupLoss: 0.3833 UsupLoss: 0.5389 NLLLoss: 0.0831 Acc@1: 99.240%

| Validation Epoch #296 Loss: 0.7565 NLLLoss: 0.7565 Acc@1: 78.20%

| Best Test Acc: Acc@1: 80.08% | Epoch [297/1000] Iter[450/ 41] Loss: 0.8190 SupLoss: 0.4157 UsupLoss: 0.5484 NLLLoss: 0.0843 Acc@1: 99.053%

| Validation Epoch #297 Loss: 0.8881 NLLLoss: 0.8881 Acc@1: 74.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [298/1000] Iter[450/ 41] Loss: 0.8158 SupLoss: 0.4359 UsupLoss: 0.5131 NLLLoss: 0.0866 Acc@1: 99.251%

| Validation Epoch #298 Loss: 0.7587 NLLLoss: 0.7587 Acc@1: 77.36%

| Best Test Acc: Acc@1: 80.08% | Epoch [299/1000] Iter[450/ 41] Loss: 0.8085 SupLoss: 0.4081 UsupLoss: 0.5374 NLLLoss: 0.0822 Acc@1: 99.218%

| Validation Epoch #299 Loss: 0.7462 NLLLoss: 0.7462 Acc@1: 78.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [300/1000] Iter[450/ 41] Loss: 0.8381 SupLoss: 0.4167 UsupLoss: 0.5622 NLLLoss: 0.0951 Acc@1: 98.933%

| Validation Epoch #300 Loss: 0.8153 NLLLoss: 0.8153 Acc@1: 75.80%

| Best Test Acc: Acc@1: 80.08% | Epoch [301/1000] Iter[450/ 41] Loss: 0.8478 SupLoss: 0.4179 UsupLoss: 0.5696 NLLLoss: 0.0905 Acc@1: 98.940%

| Validation Epoch #301 Loss: 0.9254 NLLLoss: 0.9254 Acc@1: 75.16%

| Best Test Acc: Acc@1: 80.08% | Epoch [302/1000] Iter[450/ 41] Loss: 0.8711 SupLoss: 0.4435 UsupLoss: 0.5631 NLLLoss: 0.0922 Acc@1: 99.002%

| Validation Epoch #302 Loss: 0.8186 NLLLoss: 0.8186 Acc@1: 78.20%

| Best Test Acc: Acc@1: 80.08% | Epoch [303/1000] Iter[450/ 41] Loss: 0.9861 SupLoss: 0.4987 UsupLoss: 0.6386 NLLLoss: 0.0984 Acc@1: 98.753%

| Validation Epoch #303 Loss: 0.8140 NLLLoss: 0.8140 Acc@1: 77.24%

| Best Test Acc: Acc@1: 80.08% | Epoch [304/1000] Iter[450/ 41] Loss: 1.0319 SupLoss: 0.5179 UsupLoss: 0.6704 NLLLoss: 0.1238 Acc@1: 98.038%

| Validation Epoch #304 Loss: 0.8992 NLLLoss: 0.8992 Acc@1: 75.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [305/1000] Iter[450/ 41] Loss: 2.2335 SupLoss: 1.6572 UsupLoss: 0.7436 NLLLoss: 1.1235 Acc@1: 85.162%

| Validation Epoch #305 Loss: 0.8801 NLLLoss: 0.8801 Acc@1: 73.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [306/1000] Iter[450/ 41] Loss: 0.9291 SupLoss: 0.4368 UsupLoss: 0.6343 NLLLoss: 0.1088 Acc@1: 98.524%

| Validation Epoch #306 Loss: 0.7265 NLLLoss: 0.7265 Acc@1: 78.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [307/1000] Iter[450/ 41] Loss: 0.8287 SupLoss: 0.4107 UsupLoss: 0.5356 NLLLoss: 0.0783 Acc@1: 99.296%

| Validation Epoch #307 Loss: 0.7259 NLLLoss: 0.7259 Acc@1: 79.74%

| Best Test Acc: Acc@1: 80.08% | Epoch [308/1000] Iter[450/ 41] Loss: 0.8709 SupLoss: 0.4351 UsupLoss: 0.5554 NLLLoss: 0.0917 Acc@1: 99.056%

| Validation Epoch #308 Loss: 0.6954 NLLLoss: 0.6954 Acc@1: 79.40%

| Best Test Acc: Acc@1: 80.08% | Epoch [309/1000] Iter[450/ 41] Loss: 0.8414 SupLoss: 0.4036 UsupLoss: 0.5554 NLLLoss: 0.0900 Acc@1: 99.067%

| Validation Epoch #309 Loss: 0.7798 NLLLoss: 0.7798 Acc@1: 77.64%

| Best Test Acc: Acc@1: 80.08% | Epoch [310/1000] Iter[450/ 41] Loss: 0.8634 SupLoss: 0.4437 UsupLoss: 0.5288 NLLLoss: 0.1023 Acc@1: 98.956%

| Validation Epoch #310 Loss: 0.8347 NLLLoss: 0.8347 Acc@1: 77.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [311/1000] Iter[450/ 41] Loss: 0.8529 SupLoss: 0.4157 UsupLoss: 0.5487 NLLLoss: 0.0933 Acc@1: 98.929%

| Validation Epoch #311 Loss: 0.9120 NLLLoss: 0.9120 Acc@1: 73.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [312/1000] Iter[450/ 41] Loss: 0.8230 SupLoss: 0.3920 UsupLoss: 0.5376 NLLLoss: 0.0865 Acc@1: 99.058%

| Validation Epoch #312 Loss: 0.7550 NLLLoss: 0.7550 Acc@1: 77.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [313/1000] Iter[450/ 41] Loss: 0.8623 SupLoss: 0.4274 UsupLoss: 0.5392 NLLLoss: 0.0987 Acc@1: 98.929%

| Validation Epoch #313 Loss: 0.7323 NLLLoss: 0.7323 Acc@1: 77.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [314/1000] Iter[450/ 41] Loss: 0.8362 SupLoss: 0.3827 UsupLoss: 0.5599 NLLLoss: 0.0920 Acc@1: 99.031%

| Validation Epoch #314 Loss: 0.7153 NLLLoss: 0.7153 Acc@1: 78.80%

| Best Test Acc: Acc@1: 80.08% | Epoch [315/1000] Iter[450/ 41] Loss: 0.8896 SupLoss: 0.4410 UsupLoss: 0.5506 NLLLoss: 0.0901 Acc@1: 98.982%

| Validation Epoch #315 Loss: 0.7357 NLLLoss: 0.7357 Acc@1: 77.56%

| Best Test Acc: Acc@1: 80.08% | Epoch [316/1000] Iter[450/ 41] Loss: 0.8884 SupLoss: 0.4428 UsupLoss: 0.5437 NLLLoss: 0.0983 Acc@1: 98.909%

| Validation Epoch #316 Loss: 0.7228 NLLLoss: 0.7228 Acc@1: 79.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [317/1000] Iter[450/ 41] Loss: 0.8519 SupLoss: 0.4235 UsupLoss: 0.5199 NLLLoss: 0.0961 Acc@1: 98.967%

| Validation Epoch #317 Loss: 0.8603 NLLLoss: 0.8603 Acc@1: 74.66%

| Best Test Acc: Acc@1: 80.08% | Epoch [318/1000] Iter[450/ 41] Loss: 0.8647 SupLoss: 0.4120 UsupLoss: 0.5464 NLLLoss: 0.0933 Acc@1: 98.960%

| Validation Epoch #318 Loss: 0.7980 NLLLoss: 0.7980 Acc@1: 75.30%

| Best Test Acc: Acc@1: 80.08% | Epoch [319/1000] Iter[450/ 41] Loss: 0.8257 SupLoss: 0.4127 UsupLoss: 0.4954 NLLLoss: 0.0942 Acc@1: 99.149%

| Validation Epoch #319 Loss: 0.7009 NLLLoss: 0.7009 Acc@1: 79.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [320/1000] Iter[450/ 41] Loss: 0.8580 SupLoss: 0.4109 UsupLoss: 0.5348 NLLLoss: 0.0883 Acc@1: 99.133%

| Validation Epoch #320 Loss: 0.8049 NLLLoss: 0.8049 Acc@1: 76.50%

| Best Test Acc: Acc@1: 80.08% | Epoch [321/1000] Iter[450/ 41] Loss: 0.8840 SupLoss: 0.4252 UsupLoss: 0.5461 NLLLoss: 0.0905 Acc@1: 99.022%

| Validation Epoch #321 Loss: 0.6989 NLLLoss: 0.6989 Acc@1: 78.16%

| Best Test Acc: Acc@1: 80.08% | Epoch [322/1000] Iter[450/ 41] Loss: 0.8622 SupLoss: 0.4296 UsupLoss: 0.5116 NLLLoss: 0.0928 Acc@1: 99.047%

| Validation Epoch #322 Loss: 0.7634 NLLLoss: 0.7634 Acc@1: 76.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [323/1000] Iter[450/ 41] Loss: 0.8868 SupLoss: 0.4254 UsupLoss: 0.5444 NLLLoss: 0.0877 Acc@1: 99.073%

| Validation Epoch #323 Loss: 0.7097 NLLLoss: 0.7097 Acc@1: 78.20%

| Best Test Acc: Acc@1: 80.08% | Epoch [324/1000] Iter[450/ 41] Loss: 0.8728 SupLoss: 0.4315 UsupLoss: 0.5170 NLLLoss: 0.1019 Acc@1: 98.913%

| Validation Epoch #324 Loss: 1.0061 NLLLoss: 1.0061 Acc@1: 72.72%

| Best Test Acc: Acc@1: 80.08% | Epoch [325/1000] Iter[450/ 41] Loss: 0.8694 SupLoss: 0.3989 UsupLoss: 0.5490 NLLLoss: 0.0943 Acc@1: 98.871%

| Validation Epoch #325 Loss: 0.7500 NLLLoss: 0.7500 Acc@1: 77.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [326/1000] Iter[450/ 41] Loss: 0.8652 SupLoss: 0.4010 UsupLoss: 0.5395 NLLLoss: 0.0978 Acc@1: 98.982%

| Validation Epoch #326 Loss: 0.7817 NLLLoss: 0.7817 Acc@1: 78.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [327/1000] Iter[450/ 41] Loss: 0.8658 SupLoss: 0.4378 UsupLoss: 0.4942 NLLLoss: 0.0940 Acc@1: 99.136%

| Validation Epoch #327 Loss: 0.7275 NLLLoss: 0.7275 Acc@1: 78.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [328/1000] Iter[450/ 41] Loss: 0.8550 SupLoss: 0.3933 UsupLoss: 0.5313 NLLLoss: 0.0870 Acc@1: 99.089%

| Validation Epoch #328 Loss: 0.7867 NLLLoss: 0.7867 Acc@1: 78.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [329/1000] Iter[450/ 41] Loss: 0.8714 SupLoss: 0.4145 UsupLoss: 0.5232 NLLLoss: 0.0927 Acc@1: 99.058%

| Validation Epoch #329 Loss: 0.7863 NLLLoss: 0.7863 Acc@1: 76.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [330/1000] Iter[450/ 41] Loss: 0.8849 SupLoss: 0.4367 UsupLoss: 0.5115 NLLLoss: 0.1021 Acc@1: 98.902%

| Validation Epoch #330 Loss: 0.8338 NLLLoss: 0.8338 Acc@1: 75.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [331/1000] Iter[450/ 41] Loss: 0.9078 SupLoss: 0.4344 UsupLoss: 0.5376 NLLLoss: 0.0989 Acc@1: 98.916%

| Validation Epoch #331 Loss: 0.7290 NLLLoss: 0.7290 Acc@1: 77.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [332/1000] Iter[450/ 41] Loss: 0.8968 SupLoss: 0.4176 UsupLoss: 0.5420 NLLLoss: 0.0972 Acc@1: 98.904%

| Validation Epoch #332 Loss: 0.6907 NLLLoss: 0.6907 Acc@1: 79.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [333/1000] Iter[450/ 41] Loss: 0.9198 SupLoss: 0.4516 UsupLoss: 0.5269 NLLLoss: 0.1002 Acc@1: 98.924%

| Validation Epoch #333 Loss: 0.7169 NLLLoss: 0.7169 Acc@1: 78.50%

| Best Test Acc: Acc@1: 80.08% | Epoch [334/1000] Iter[450/ 41] Loss: 0.9364 SupLoss: 0.4673 UsupLoss: 0.5259 NLLLoss: 0.1057 Acc@1: 98.767%

| Validation Epoch #334 Loss: 0.6985 NLLLoss: 0.6985 Acc@1: 78.92%

| Best Test Acc: Acc@1: 80.08% | Epoch [335/1000] Iter[450/ 41] Loss: 0.8336 SupLoss: 0.3868 UsupLoss: 0.4982 NLLLoss: 0.0896 Acc@1: 99.238%

| Validation Epoch #335 Loss: 0.7256 NLLLoss: 0.7256 Acc@1: 79.38%

| Best Test Acc: Acc@1: 80.08% | Epoch [336/1000] Iter[450/ 41] Loss: 0.8943 SupLoss: 0.4148 UsupLoss: 0.5332 NLLLoss: 0.0969 Acc@1: 98.913%

| Validation Epoch #336 Loss: 0.7125 NLLLoss: 0.7125 Acc@1: 78.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [337/1000] Iter[450/ 41] Loss: 0.8790 SupLoss: 0.4303 UsupLoss: 0.4964 NLLLoss: 0.0996 Acc@1: 98.962%

| Validation Epoch #337 Loss: 0.7648 NLLLoss: 0.7648 Acc@1: 78.20%

| Best Test Acc: Acc@1: 80.08% | Epoch [338/1000] Iter[450/ 41] Loss: 0.8329 SupLoss: 0.4010 UsupLoss: 0.4756 NLLLoss: 0.0985 Acc@1: 99.016%

| Validation Epoch #338 Loss: 0.7911 NLLLoss: 0.7911 Acc@1: 76.42%

| Best Test Acc: Acc@1: 80.08% | Epoch [339/1000] Iter[450/ 41] Loss: 0.9335 SupLoss: 0.4776 UsupLoss: 0.5007 NLLLoss: 0.0985 Acc@1: 98.938%

| Validation Epoch #339 Loss: 0.7422 NLLLoss: 0.7422 Acc@1: 78.94%

| Best Test Acc: Acc@1: 80.08% | Epoch [340/1000] Iter[450/ 41] Loss: 0.8786 SupLoss: 0.4304 UsupLoss: 0.4900 NLLLoss: 0.1000 Acc@1: 98.920%

| Validation Epoch #340 Loss: 0.7429 NLLLoss: 0.7429 Acc@1: 79.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [341/1000] Iter[450/ 41] Loss: 0.8902 SupLoss: 0.4003 UsupLoss: 0.5346 NLLLoss: 0.0951 Acc@1: 98.956%

| Validation Epoch #341 Loss: 0.6881 NLLLoss: 0.6881 Acc@1: 80.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [342/1000] Iter[450/ 41] Loss: 0.8894 SupLoss: 0.4260 UsupLoss: 0.5036 NLLLoss: 0.0974 Acc@1: 98.991%

| Validation Epoch #342 Loss: 0.7531 NLLLoss: 0.7531 Acc@1: 77.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [343/1000] Iter[450/ 41] Loss: 0.8869 SupLoss: 0.4210 UsupLoss: 0.5043 NLLLoss: 0.1033 Acc@1: 98.827%

| Validation Epoch #343 Loss: 0.6532 NLLLoss: 0.6532 Acc@1: 79.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [344/1000] Iter[450/ 41] Loss: 0.9278 SupLoss: 0.4235 UsupLoss: 0.5446 NLLLoss: 0.0950 Acc@1: 98.829%

| Validation Epoch #344 Loss: 0.7396 NLLLoss: 0.7396 Acc@1: 78.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [345/1000] Iter[450/ 41] Loss: 0.9211 SupLoss: 0.4352 UsupLoss: 0.5226 NLLLoss: 0.1016 Acc@1: 98.856%

| Validation Epoch #345 Loss: 0.7286 NLLLoss: 0.7286 Acc@1: 78.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [346/1000] Iter[450/ 41] Loss: 0.8884 SupLoss: 0.4343 UsupLoss: 0.4862 NLLLoss: 0.0971 Acc@1: 99.071%

| Validation Epoch #346 Loss: 0.7901 NLLLoss: 0.7901 Acc@1: 77.96%

| Best Test Acc: Acc@1: 80.08% | Epoch [347/1000] Iter[450/ 41] Loss: 0.9047 SupLoss: 0.4512 UsupLoss: 0.4839 NLLLoss: 0.0980 Acc@1: 98.936%

| Validation Epoch #347 Loss: 0.7137 NLLLoss: 0.7137 Acc@1: 79.50%

| Best Test Acc: Acc@1: 80.08% | Epoch [348/1000] Iter[450/ 41] Loss: 0.8958 SupLoss: 0.4190 UsupLoss: 0.5079 NLLLoss: 0.0962 Acc@1: 98.871%

| Validation Epoch #348 Loss: 0.8323 NLLLoss: 0.8323 Acc@1: 77.58%

| Best Test Acc: Acc@1: 80.08% | Epoch [349/1000] Iter[450/ 41] Loss: 0.8960 SupLoss: 0.4598 UsupLoss: 0.4628 NLLLoss: 0.0986 Acc@1: 99.042%

| Validation Epoch #349 Loss: 0.7777 NLLLoss: 0.7777 Acc@1: 76.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [350/1000] Iter[450/ 41] Loss: 0.9250 SupLoss: 0.4414 UsupLoss: 0.5121 NLLLoss: 0.0921 Acc@1: 99.016%

| Validation Epoch #350 Loss: 0.8399 NLLLoss: 0.8399 Acc@1: 74.74%

| Best Test Acc: Acc@1: 80.08% | Epoch [351/1000] Iter[450/ 41] Loss: 0.9864 SupLoss: 0.4654 UsupLoss: 0.5500 NLLLoss: 0.1126 Acc@1: 98.464%

| Validation Epoch #351 Loss: 0.8253 NLLLoss: 0.8253 Acc@1: 76.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [352/1000] Iter[450/ 41] Loss: 0.9338 SupLoss: 0.4308 UsupLoss: 0.5288 NLLLoss: 0.1073 Acc@1: 98.662%

| Validation Epoch #352 Loss: 0.7262 NLLLoss: 0.7262 Acc@1: 78.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [353/1000] Iter[450/ 41] Loss: 0.8593 SupLoss: 0.4089 UsupLoss: 0.4714 NLLLoss: 0.0991 Acc@1: 99.091%

| Validation Epoch #353 Loss: 0.7921 NLLLoss: 0.7921 Acc@1: 77.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [354/1000] Iter[450/ 41] Loss: 0.9215 SupLoss: 0.4481 UsupLoss: 0.4949 NLLLoss: 0.1044 Acc@1: 98.847%

| Validation Epoch #354 Loss: 0.6682 NLLLoss: 0.6682 Acc@1: 80.14%

| Best Test Acc: Acc@1: 80.08% | Epoch [355/1000] Iter[450/ 41] Loss: 0.9384 SupLoss: 0.4260 UsupLoss: 0.5345 NLLLoss: 0.0960 Acc@1: 98.842%

| Validation Epoch #355 Loss: 0.8347 NLLLoss: 0.8347 Acc@1: 76.80%

| Best Test Acc: Acc@1: 80.08% | Epoch [356/1000] Iter[450/ 41] Loss: 0.9220 SupLoss: 0.4200 UsupLoss: 0.5224 NLLLoss: 0.1102 Acc@1: 98.727%

| Validation Epoch #356 Loss: 0.6915 NLLLoss: 0.6915 Acc@1: 77.96%

| Best Test Acc: Acc@1: 80.08% | Epoch [357/1000] Iter[450/ 41] Loss: 0.9698 SupLoss: 0.4630 UsupLoss: 0.5261 NLLLoss: 0.1034 Acc@1: 98.867%

| Validation Epoch #357 Loss: 0.7918 NLLLoss: 0.7918 Acc@1: 76.28%

| Best Test Acc: Acc@1: 80.08% | Epoch [358/1000] Iter[450/ 41] Loss: 0.9901 SupLoss: 0.4739 UsupLoss: 0.5344 NLLLoss: 0.1093 Acc@1: 98.584%

| Validation Epoch #358 Loss: 0.7616 NLLLoss: 0.7616 Acc@1: 78.06%

| Best Test Acc: Acc@1: 80.08% | Epoch [359/1000] Iter[450/ 41] Loss: 0.9340 SupLoss: 0.4224 UsupLoss: 0.5279 NLLLoss: 0.0999 Acc@1: 98.796%

| Validation Epoch #359 Loss: 0.8068 NLLLoss: 0.8068 Acc@1: 75.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [360/1000] Iter[450/ 41] Loss: 0.8883 SupLoss: 0.3931 UsupLoss: 0.5095 NLLLoss: 0.0950 Acc@1: 98.916%

| Validation Epoch #360 Loss: 0.7032 NLLLoss: 0.7032 Acc@1: 79.92%

| Best Test Acc: Acc@1: 80.08% | Epoch [361/1000] Iter[450/ 41] Loss: 0.9428 SupLoss: 0.4594 UsupLoss: 0.4957 NLLLoss: 0.1041 Acc@1: 98.900%

| Validation Epoch #361 Loss: 0.7800 NLLLoss: 0.7800 Acc@1: 77.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [362/1000] Iter[450/ 41] Loss: 0.8988 SupLoss: 0.4124 UsupLoss: 0.4977 NLLLoss: 0.1006 Acc@1: 98.924%

| Validation Epoch #362 Loss: 0.7464 NLLLoss: 0.7464 Acc@1: 78.68%

| Best Test Acc: Acc@1: 80.08% | Epoch [363/1000] Iter[450/ 41] Loss: 0.9113 SupLoss: 0.4129 UsupLoss: 0.5089 NLLLoss: 0.0951 Acc@1: 98.976%

| Validation Epoch #363 Loss: 0.7371 NLLLoss: 0.7371 Acc@1: 79.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [364/1000] Iter[450/ 41] Loss: 0.9909 SupLoss: 0.4854 UsupLoss: 0.5156 NLLLoss: 0.1086 Acc@1: 98.722%

| Validation Epoch #364 Loss: 0.9086 NLLLoss: 0.9086 Acc@1: 73.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [365/1000] Iter[450/ 41] Loss: 0.9432 SupLoss: 0.4434 UsupLoss: 0.5083 NLLLoss: 0.1071 Acc@1: 98.769%

| Validation Epoch #365 Loss: 0.7607 NLLLoss: 0.7607 Acc@1: 77.92%

| Best Test Acc: Acc@1: 80.08% | Epoch [366/1000] Iter[450/ 41] Loss: 0.9451 SupLoss: 0.4490 UsupLoss: 0.5035 NLLLoss: 0.0969 Acc@1: 98.933%

| Validation Epoch #366 Loss: 0.7845 NLLLoss: 0.7845 Acc@1: 77.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [367/1000] Iter[450/ 41] Loss: 0.9355 SupLoss: 0.4328 UsupLoss: 0.5093 NLLLoss: 0.0991 Acc@1: 98.876%

| Validation Epoch #367 Loss: 0.7388 NLLLoss: 0.7388 Acc@1: 78.42%

| Best Test Acc: Acc@1: 80.08% | Epoch [368/1000] Iter[450/ 41] Loss: 0.8926 SupLoss: 0.4146 UsupLoss: 0.4824 NLLLoss: 0.1075 Acc@1: 98.889%

| Validation Epoch #368 Loss: 0.8145 NLLLoss: 0.8145 Acc@1: 75.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [369/1000] Iter[450/ 41] Loss: 0.9399 SupLoss: 0.4351 UsupLoss: 0.5086 NLLLoss: 0.1098 Acc@1: 98.702%

| Validation Epoch #369 Loss: 0.7293 NLLLoss: 0.7293 Acc@1: 79.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [370/1000] Iter[450/ 41] Loss: 0.9602 SupLoss: 0.4482 UsupLoss: 0.5153 NLLLoss: 0.0985 Acc@1: 98.896%

| Validation Epoch #370 Loss: 0.8017 NLLLoss: 0.8017 Acc@1: 76.68%

| Best Test Acc: Acc@1: 80.08% | Epoch [371/1000] Iter[450/ 41] Loss: 0.9428 SupLoss: 0.4447 UsupLoss: 0.5002 NLLLoss: 0.1023 Acc@1: 98.778%

| Validation Epoch #371 Loss: 0.7601 NLLLoss: 0.7601 Acc@1: 78.68%

| Best Test Acc: Acc@1: 80.08% | Epoch [372/1000] Iter[450/ 41] Loss: 0.9148 SupLoss: 0.4256 UsupLoss: 0.4903 NLLLoss: 0.1153 Acc@1: 98.782%

| Validation Epoch #372 Loss: 0.6743 NLLLoss: 0.6743 Acc@1: 79.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [373/1000] Iter[450/ 41] Loss: 0.9232 SupLoss: 0.4048 UsupLoss: 0.5187 NLLLoss: 0.1038 Acc@1: 98.700%

| Validation Epoch #373 Loss: 0.7340 NLLLoss: 0.7340 Acc@1: 78.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [374/1000] Iter[450/ 41] Loss: 0.9291 SupLoss: 0.4228 UsupLoss: 0.5059 NLLLoss: 0.0978 Acc@1: 98.927%

| Validation Epoch #374 Loss: 0.7282 NLLLoss: 0.7282 Acc@1: 78.84%

| Best Test Acc: Acc@1: 80.08% | Epoch [375/1000] Iter[450/ 41] Loss: 0.9356 SupLoss: 0.4249 UsupLoss: 0.5093 NLLLoss: 0.1085 Acc@1: 98.729%

| Validation Epoch #375 Loss: 0.7754 NLLLoss: 0.7754 Acc@1: 76.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [376/1000] Iter[450/ 41] Loss: 0.9491 SupLoss: 0.4388 UsupLoss: 0.5087 NLLLoss: 0.0997 Acc@1: 98.813%

| Validation Epoch #376 Loss: 0.7032 NLLLoss: 0.7032 Acc@1: 78.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [377/1000] Iter[450/ 41] Loss: 0.9531 SupLoss: 0.4036 UsupLoss: 0.5473 NLLLoss: 0.1004 Acc@1: 98.744%

| Validation Epoch #377 Loss: 0.9067 NLLLoss: 0.9067 Acc@1: 76.20%

| Best Test Acc: Acc@1: 80.08% | Epoch [378/1000] Iter[450/ 41] Loss: 0.9054 SupLoss: 0.4148 UsupLoss: 0.4866 NLLLoss: 0.1099 Acc@1: 98.780%

| Validation Epoch #378 Loss: 0.7623 NLLLoss: 0.7623 Acc@1: 78.68%

| Best Test Acc: Acc@1: 80.08% | Epoch [379/1000] Iter[450/ 41] Loss: 0.9174 SupLoss: 0.3988 UsupLoss: 0.5149 NLLLoss: 0.0994 Acc@1: 98.884%

| Validation Epoch #379 Loss: 0.7408 NLLLoss: 0.7408 Acc@1: 78.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [380/1000] Iter[450/ 41] Loss: 0.9529 SupLoss: 0.4589 UsupLoss: 0.4893 NLLLoss: 0.1102 Acc@1: 98.713%

| Validation Epoch #380 Loss: 0.7067 NLLLoss: 0.7067 Acc@1: 79.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [381/1000] Iter[450/ 41] Loss: 0.9607 SupLoss: 0.4587 UsupLoss: 0.4962 NLLLoss: 0.1073 Acc@1: 98.740%

| Validation Epoch #381 Loss: 0.7584 NLLLoss: 0.7584 Acc@1: 77.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [382/1000] Iter[450/ 41] Loss: 0.9545 SupLoss: 0.4281 UsupLoss: 0.5202 NLLLoss: 0.1092 Acc@1: 98.611%

| Validation Epoch #382 Loss: 0.8804 NLLLoss: 0.8804 Acc@1: 75.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [383/1000] Iter[450/ 41] Loss: 0.9665 SupLoss: 0.4502 UsupLoss: 0.5094 NLLLoss: 0.1053 Acc@1: 98.691%

| Validation Epoch #383 Loss: 0.8201 NLLLoss: 0.8201 Acc@1: 74.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [384/1000] Iter[450/ 41] Loss: 0.9367 SupLoss: 0.4502 UsupLoss: 0.4790 NLLLoss: 0.1057 Acc@1: 98.747%

| Validation Epoch #384 Loss: 0.8446 NLLLoss: 0.8446 Acc@1: 73.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [385/1000] Iter[450/ 41] Loss: 0.9297 SupLoss: 0.4133 UsupLoss: 0.5090 NLLLoss: 0.1019 Acc@1: 98.840%

| Validation Epoch #385 Loss: 0.7524 NLLLoss: 0.7524 Acc@1: 76.64%

| Best Test Acc: Acc@1: 80.08% | Epoch [386/1000] Iter[450/ 41] Loss: 0.9505 SupLoss: 0.4264 UsupLoss: 0.5157 NLLLoss: 0.1023 Acc@1: 98.811%

| Validation Epoch #386 Loss: 0.8560 NLLLoss: 0.8560 Acc@1: 75.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [387/1000] Iter[450/ 41] Loss: 0.9678 SupLoss: 0.4224 UsupLoss: 0.5367 NLLLoss: 0.1049 Acc@1: 98.762%

| Validation Epoch #387 Loss: 0.8742 NLLLoss: 0.8742 Acc@1: 75.30%

| Best Test Acc: Acc@1: 80.08% | Epoch [388/1000] Iter[450/ 41] Loss: 0.8728 SupLoss: 0.3937 UsupLoss: 0.4698 NLLLoss: 0.0950 Acc@1: 99.007%

| Validation Epoch #388 Loss: 0.7848 NLLLoss: 0.7848 Acc@1: 77.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [389/1000] Iter[450/ 41] Loss: 0.9493 SupLoss: 0.4265 UsupLoss: 0.5132 NLLLoss: 0.1099 Acc@1: 98.633%

| Validation Epoch #389 Loss: 0.8410 NLLLoss: 0.8410 Acc@1: 76.32%

| Best Test Acc: Acc@1: 80.08% | Epoch [390/1000] Iter[450/ 41] Loss: 0.9217 SupLoss: 0.4501 UsupLoss: 0.4617 NLLLoss: 0.1054 Acc@1: 98.791%

| Validation Epoch #390 Loss: 0.6422 NLLLoss: 0.6422 Acc@1: 80.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [391/1000] Iter[450/ 41] Loss: 0.9730 SupLoss: 0.4250 UsupLoss: 0.5378 NLLLoss: 0.1057 Acc@1: 98.713%

| Validation Epoch #391 Loss: 0.7758 NLLLoss: 0.7758 Acc@1: 77.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [392/1000] Iter[450/ 41] Loss: 1.0134 SupLoss: 0.4698 UsupLoss: 0.5329 NLLLoss: 0.1091 Acc@1: 98.587%

| Validation Epoch #392 Loss: 0.8718 NLLLoss: 0.8718 Acc@1: 75.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [393/1000] Iter[450/ 41] Loss: 0.8915 SupLoss: 0.4050 UsupLoss: 0.4757 NLLLoss: 0.1080 Acc@1: 98.738%

| Validation Epoch #393 Loss: 0.7833 NLLLoss: 0.7833 Acc@1: 76.42%

| Best Test Acc: Acc@1: 80.08% | Epoch [394/1000] Iter[450/ 41] Loss: 0.9730 SupLoss: 0.4381 UsupLoss: 0.5233 NLLLoss: 0.1082 Acc@1: 98.591%

| Validation Epoch #394 Loss: 0.7429 NLLLoss: 0.7429 Acc@1: 78.90%

| Best Test Acc: Acc@1: 80.08% | Epoch [395/1000] Iter[450/ 41] Loss: 1.0097 SupLoss: 0.4711 UsupLoss: 0.5273 NLLLoss: 0.1182 Acc@1: 98.480%

| Validation Epoch #395 Loss: 0.7333 NLLLoss: 0.7333 Acc@1: 77.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [396/1000] Iter[450/ 41] Loss: 1.0013 SupLoss: 0.4635 UsupLoss: 0.5268 NLLLoss: 0.1044 Acc@1: 98.698%

| Validation Epoch #396 Loss: 0.6826 NLLLoss: 0.6826 Acc@1: 80.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [397/1000] Iter[450/ 41] Loss: 0.9963 SupLoss: 0.4685 UsupLoss: 0.5163 NLLLoss: 0.1180 Acc@1: 98.498%

| Validation Epoch #397 Loss: 0.7170 NLLLoss: 0.7170 Acc@1: 78.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [398/1000] Iter[450/ 41] Loss: 1.0300 SupLoss: 0.4827 UsupLoss: 0.5352 NLLLoss: 0.1161 Acc@1: 98.498%

| Validation Epoch #398 Loss: 0.7203 NLLLoss: 0.7203 Acc@1: 78.82%

| Best Test Acc: Acc@1: 80.08% | Epoch [399/1000] Iter[450/ 41] Loss: 0.9917 SupLoss: 0.4602 UsupLoss: 0.5199 NLLLoss: 0.1115 Acc@1: 98.607%

| Validation Epoch #399 Loss: 0.8033 NLLLoss: 0.8033 Acc@1: 76.30%

| Best Test Acc: Acc@1: 80.08% | Epoch [400/1000] Iter[450/ 41] Loss: 1.0106 SupLoss: 0.4414 UsupLoss: 0.5572 NLLLoss: 0.1155 Acc@1: 98.311%

| Validation Epoch #400 Loss: 0.8224 NLLLoss: 0.8224 Acc@1: 76.80%

| Best Test Acc: Acc@1: 80.08% | Epoch [401/1000] Iter[450/ 41] Loss: 0.9339 SupLoss: 0.4008 UsupLoss: 0.5212 NLLLoss: 0.1077 Acc@1: 98.678%

| Validation Epoch #401 Loss: 0.7484 NLLLoss: 0.7484 Acc@1: 77.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [402/1000] Iter[450/ 41] Loss: 1.0385 SupLoss: 0.4608 UsupLoss: 0.5656 NLLLoss: 0.1162 Acc@1: 98.456%

| Validation Epoch #402 Loss: 0.8058 NLLLoss: 0.8058 Acc@1: 76.72%

| Best Test Acc: Acc@1: 80.08% | Epoch [403/1000] Iter[450/ 41] Loss: 1.0123 SupLoss: 0.4370 UsupLoss: 0.5632 NLLLoss: 0.1120 Acc@1: 98.458%

| Validation Epoch #403 Loss: 0.8887 NLLLoss: 0.8887 Acc@1: 75.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [404/1000] Iter[450/ 41] Loss: 0.9988 SupLoss: 0.4532 UsupLoss: 0.5338 NLLLoss: 0.1078 Acc@1: 98.504%

| Validation Epoch #404 Loss: 0.8088 NLLLoss: 0.8088 Acc@1: 76.68%

| Best Test Acc: Acc@1: 80.08% | Epoch [405/1000] Iter[450/ 41] Loss: 1.0430 SupLoss: 0.4710 UsupLoss: 0.5600 NLLLoss: 0.1238 Acc@1: 98.411%

| Validation Epoch #405 Loss: 0.7421 NLLLoss: 0.7421 Acc@1: 77.38%

| Best Test Acc: Acc@1: 80.08% | Epoch [406/1000] Iter[450/ 41] Loss: 0.9629 SupLoss: 0.4451 UsupLoss: 0.5062 NLLLoss: 0.1072 Acc@1: 98.667%

| Validation Epoch #406 Loss: 0.6640 NLLLoss: 0.6640 Acc@1: 79.30%

| Best Test Acc: Acc@1: 80.08% | Epoch [407/1000] Iter[450/ 41] Loss: 0.9365 SupLoss: 0.4325 UsupLoss: 0.4927 NLLLoss: 0.0983 Acc@1: 98.911%

| Validation Epoch #407 Loss: 0.7886 NLLLoss: 0.7886 Acc@1: 77.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [408/1000] Iter[450/ 41] Loss: 0.9157 SupLoss: 0.4276 UsupLoss: 0.4766 NLLLoss: 0.1046 Acc@1: 98.924%

| Validation Epoch #408 Loss: 0.7510 NLLLoss: 0.7510 Acc@1: 78.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [409/1000] Iter[450/ 41] Loss: 0.9561 SupLoss: 0.4565 UsupLoss: 0.4881 NLLLoss: 0.1066 Acc@1: 98.613%

| Validation Epoch #409 Loss: 0.7922 NLLLoss: 0.7922 Acc@1: 77.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [410/1000] Iter[450/ 41] Loss: 0.9650 SupLoss: 0.4452 UsupLoss: 0.5080 NLLLoss: 0.1062 Acc@1: 98.609%

| Validation Epoch #410 Loss: 0.7546 NLLLoss: 0.7546 Acc@1: 78.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [411/1000] Iter[450/ 41] Loss: 0.9248 SupLoss: 0.4211 UsupLoss: 0.4922 NLLLoss: 0.1064 Acc@1: 98.822%

| Validation Epoch #411 Loss: 0.8399 NLLLoss: 0.8399 Acc@1: 76.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [412/1000] Iter[450/ 41] Loss: 0.9692 SupLoss: 0.4686 UsupLoss: 0.4892 NLLLoss: 0.1073 Acc@1: 98.684%

| Validation Epoch #412 Loss: 0.7788 NLLLoss: 0.7788 Acc@1: 77.66%

| Best Test Acc: Acc@1: 80.08% | Epoch [413/1000] Iter[450/ 41] Loss: 0.9763 SupLoss: 0.4637 UsupLoss: 0.5012 NLLLoss: 0.1101 Acc@1: 98.627%

| Validation Epoch #413 Loss: 0.7447 NLLLoss: 0.7447 Acc@1: 76.96%

| Best Test Acc: Acc@1: 80.08% | Epoch [414/1000] Iter[450/ 41] Loss: 0.9519 SupLoss: 0.4802 UsupLoss: 0.4602 NLLLoss: 0.1109 Acc@1: 98.729%

| Validation Epoch #414 Loss: 0.6831 NLLLoss: 0.6831 Acc@1: 79.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [415/1000] Iter[450/ 41] Loss: 0.9328 SupLoss: 0.4239 UsupLoss: 0.4977 NLLLoss: 0.1080 Acc@1: 98.836%

| Validation Epoch #415 Loss: 0.7101 NLLLoss: 0.7101 Acc@1: 79.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [416/1000] Iter[450/ 41] Loss: 0.9037 SupLoss: 0.4202 UsupLoss: 0.4726 NLLLoss: 0.1065 Acc@1: 98.829%

| Validation Epoch #416 Loss: 0.7589 NLLLoss: 0.7589 Acc@1: 77.86%

| Best Test Acc: Acc@1: 80.08% | Epoch [417/1000] Iter[450/ 41] Loss: 1.0158 SupLoss: 0.4696 UsupLoss: 0.5348 NLLLoss: 0.1141 Acc@1: 98.467%

| Validation Epoch #417 Loss: 0.8057 NLLLoss: 0.8057 Acc@1: 77.82%

| Best Test Acc: Acc@1: 80.08% | Epoch [418/1000] Iter[450/ 41] Loss: 1.0061 SupLoss: 0.4656 UsupLoss: 0.5288 NLLLoss: 0.1173 Acc@1: 98.371%

| Validation Epoch #418 Loss: 0.7328 NLLLoss: 0.7328 Acc@1: 77.64%

| Best Test Acc: Acc@1: 80.08% | Epoch [419/1000] Iter[450/ 41] Loss: 0.9492 SupLoss: 0.4250 UsupLoss: 0.5125 NLLLoss: 0.1118 Acc@1: 98.658%

| Validation Epoch #419 Loss: 0.7271 NLLLoss: 0.7271 Acc@1: 77.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [420/1000] Iter[450/ 41] Loss: 0.9749 SupLoss: 0.4661 UsupLoss: 0.4974 NLLLoss: 0.1082 Acc@1: 98.684%

| Validation Epoch #420 Loss: 0.7361 NLLLoss: 0.7361 Acc@1: 77.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [421/1000] Iter[450/ 41] Loss: 0.9480 SupLoss: 0.4469 UsupLoss: 0.4894 NLLLoss: 0.1096 Acc@1: 98.696%

| Validation Epoch #421 Loss: 0.8197 NLLLoss: 0.8197 Acc@1: 76.92%

| Best Test Acc: Acc@1: 80.08% | Epoch [422/1000] Iter[450/ 41] Loss: 0.9836 SupLoss: 0.4596 UsupLoss: 0.5124 NLLLoss: 0.1036 Acc@1: 98.702%

| Validation Epoch #422 Loss: 0.8144 NLLLoss: 0.8144 Acc@1: 76.86%

| Best Test Acc: Acc@1: 80.08% | Epoch [423/1000] Iter[450/ 41] Loss: 0.9843 SupLoss: 0.4712 UsupLoss: 0.5016 NLLLoss: 0.1121 Acc@1: 98.644%

| Validation Epoch #423 Loss: 0.8623 NLLLoss: 0.8623 Acc@1: 76.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [424/1000] Iter[450/ 41] Loss: 0.9994 SupLoss: 0.4673 UsupLoss: 0.5206 NLLLoss: 0.1135 Acc@1: 98.596%

| Validation Epoch #424 Loss: 0.9938 NLLLoss: 0.9938 Acc@1: 73.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [425/1000] Iter[450/ 41] Loss: 1.0721 SupLoss: 0.4944 UsupLoss: 0.5651 NLLLoss: 0.1276 Acc@1: 98.191%

| Validation Epoch #425 Loss: 0.8290 NLLLoss: 0.8290 Acc@1: 76.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [426/1000] Iter[450/ 41] Loss: 0.9405 SupLoss: 0.4470 UsupLoss: 0.4821 NLLLoss: 0.1067 Acc@1: 98.876%

| Validation Epoch #426 Loss: 0.7483 NLLLoss: 0.7483 Acc@1: 77.88%

| Best Test Acc: Acc@1: 80.08% | Epoch [427/1000] Iter[450/ 41] Loss: 1.8478 SupLoss: 1.3753 UsupLoss: 0.4538 NLLLoss: 1.0776 Acc@1: 73.269%

| Validation Epoch #427 Loss: 2.1438 NLLLoss: 2.1438 Acc@1: 21.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [428/1000] Iter[450/ 41] Loss: 1.5708 SupLoss: 1.4273 UsupLoss: 0.1282 NLLLoss: 1.2493 Acc@1: 57.771%

| Validation Epoch #428 Loss: 0.9651 NLLLoss: 0.9651 Acc@1: 67.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [429/1000] Iter[450/ 41] Loss: 1.1664 SupLoss: 0.6728 UsupLoss: 0.4787 NLLLoss: 0.3519 Acc@1: 92.491%

| Validation Epoch #429 Loss: 0.7988 NLLLoss: 0.7988 Acc@1: 74.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [430/1000] Iter[450/ 41] Loss: 1.1344 SupLoss: 0.5621 UsupLoss: 0.5581 NLLLoss: 0.2299 Acc@1: 96.073%

| Validation Epoch #430 Loss: 0.8112 NLLLoss: 0.8112 Acc@1: 75.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [431/1000] Iter[450/ 41] Loss: 1.1705 SupLoss: 0.5685 UsupLoss: 0.5880 NLLLoss: 0.2123 Acc@1: 96.373%

| Validation Epoch #431 Loss: 0.7435 NLLLoss: 0.7435 Acc@1: 76.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [432/1000] Iter[450/ 41] Loss: 1.1091 SupLoss: 0.5316 UsupLoss: 0.5634 NLLLoss: 0.2087 Acc@1: 96.698%

| Validation Epoch #432 Loss: 0.7740 NLLLoss: 0.7740 Acc@1: 77.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [433/1000] Iter[450/ 41] Loss: 1.1760 SupLoss: 0.5453 UsupLoss: 0.6168 NLLLoss: 0.1885 Acc@1: 96.891%

| Validation Epoch #433 Loss: 0.7724 NLLLoss: 0.7724 Acc@1: 76.40%

| Best Test Acc: Acc@1: 80.08% | Epoch [434/1000] Iter[450/ 41] Loss: 1.1089 SupLoss: 0.5263 UsupLoss: 0.5690 NLLLoss: 0.1851 Acc@1: 97.047%

| Validation Epoch #434 Loss: 0.7416 NLLLoss: 0.7416 Acc@1: 76.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [435/1000] Iter[450/ 41] Loss: 1.0835 SupLoss: 0.4876 UsupLoss: 0.5821 NLLLoss: 0.1755 Acc@1: 97.407%

| Validation Epoch #435 Loss: 0.8685 NLLLoss: 0.8685 Acc@1: 74.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [436/1000] Iter[450/ 41] Loss: 1.1463 SupLoss: 0.5295 UsupLoss: 0.6028 NLLLoss: 0.1869 Acc@1: 97.042%

| Validation Epoch #436 Loss: 0.7976 NLLLoss: 0.7976 Acc@1: 75.26%

| Best Test Acc: Acc@1: 80.08% | Epoch [437/1000] Iter[450/ 41] Loss: 1.1061 SupLoss: 0.5021 UsupLoss: 0.5904 NLLLoss: 0.1822 Acc@1: 97.113%

| Validation Epoch #437 Loss: 0.7234 NLLLoss: 0.7234 Acc@1: 78.20%

| Best Test Acc: Acc@1: 80.08% | Epoch [438/1000] Iter[450/ 41] Loss: 1.1230 SupLoss: 0.5132 UsupLoss: 0.5961 NLLLoss: 0.1743 Acc@1: 97.253%

| Validation Epoch #438 Loss: 0.8432 NLLLoss: 0.8432 Acc@1: 75.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [439/1000] Iter[450/ 41] Loss: 1.1111 SupLoss: 0.4671 UsupLoss: 0.6306 NLLLoss: 0.1704 Acc@1: 97.438%

| Validation Epoch #439 Loss: 0.7392 NLLLoss: 0.7392 Acc@1: 77.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [440/1000] Iter[450/ 41] Loss: 1.1057 SupLoss: 0.4999 UsupLoss: 0.5927 NLLLoss: 0.1732 Acc@1: 97.456%

| Validation Epoch #440 Loss: 0.8127 NLLLoss: 0.8127 Acc@1: 75.84%

| Best Test Acc: Acc@1: 80.08% | Epoch [441/1000] Iter[450/ 41] Loss: 1.1667 SupLoss: 0.4937 UsupLoss: 0.6590 NLLLoss: 0.1792 Acc@1: 96.951%

| Validation Epoch #441 Loss: 0.7223 NLLLoss: 0.7223 Acc@1: 77.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [442/1000] Iter[450/ 41] Loss: 1.1168 SupLoss: 0.5136 UsupLoss: 0.5905 NLLLoss: 0.1610 Acc@1: 97.822%

| Validation Epoch #442 Loss: 0.8207 NLLLoss: 0.8207 Acc@1: 75.50%

| Best Test Acc: Acc@1: 80.08% | Epoch [443/1000] Iter[450/ 41] Loss: 1.1393 SupLoss: 0.5111 UsupLoss: 0.6147 NLLLoss: 0.1641 Acc@1: 97.440%

| Validation Epoch #443 Loss: 0.7938 NLLLoss: 0.7938 Acc@1: 75.86%

| Best Test Acc: Acc@1: 80.08% | Epoch [444/1000] Iter[450/ 41] Loss: 1.1722 SupLoss: 0.5126 UsupLoss: 0.6463 NLLLoss: 0.1839 Acc@1: 96.953%

| Validation Epoch #444 Loss: 0.7336 NLLLoss: 0.7336 Acc@1: 78.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [445/1000] Iter[450/ 41] Loss: 1.1766 SupLoss: 0.5262 UsupLoss: 0.6370 NLLLoss: 0.1793 Acc@1: 97.149%

| Validation Epoch #445 Loss: 0.7461 NLLLoss: 0.7461 Acc@1: 76.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [446/1000] Iter[450/ 41] Loss: 1.1234 SupLoss: 0.5026 UsupLoss: 0.6077 NLLLoss: 0.1603 Acc@1: 97.593%

| Validation Epoch #446 Loss: 0.7783 NLLLoss: 0.7783 Acc@1: 76.56%

| Best Test Acc: Acc@1: 80.08% | Epoch [447/1000] Iter[450/ 41] Loss: 1.1703 SupLoss: 0.5379 UsupLoss: 0.6194 NLLLoss: 0.1654 Acc@1: 97.433%

| Validation Epoch #447 Loss: 0.7340 NLLLoss: 0.7340 Acc@1: 76.18%

| Best Test Acc: Acc@1: 80.08% | Epoch [448/1000] Iter[450/ 41] Loss: 1.1136 SupLoss: 0.5029 UsupLoss: 0.5979 NLLLoss: 0.1726 Acc@1: 97.533%

| Validation Epoch #448 Loss: 0.6916 NLLLoss: 0.6916 Acc@1: 79.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [449/1000] Iter[450/ 41] Loss: 1.1436 SupLoss: 0.5073 UsupLoss: 0.6232 NLLLoss: 0.1731 Acc@1: 97.358%

| Validation Epoch #449 Loss: 0.7208 NLLLoss: 0.7208 Acc@1: 78.30%

| Best Test Acc: Acc@1: 80.08% | Epoch [450/1000] Iter[450/ 41] Loss: 1.0620 SupLoss: 0.4934 UsupLoss: 0.5564 NLLLoss: 0.1559 Acc@1: 97.944%

| Validation Epoch #450 Loss: 0.7404 NLLLoss: 0.7404 Acc@1: 77.94%

| Best Test Acc: Acc@1: 80.08% | Epoch [451/1000] Iter[450/ 41] Loss: 1.0803 SupLoss: 0.5110 UsupLoss: 0.5575 NLLLoss: 0.1549 Acc@1: 97.967%

| Validation Epoch #451 Loss: 0.7810 NLLLoss: 0.7810 Acc@1: 76.40%

| Best Test Acc: Acc@1: 80.08% | Epoch [452/1000] Iter[450/ 41] Loss: 1.0834 SupLoss: 0.5086 UsupLoss: 0.5622 NLLLoss: 0.1705 Acc@1: 97.802%

| Validation Epoch #452 Loss: 0.7633 NLLLoss: 0.7633 Acc@1: 76.70%

| Best Test Acc: Acc@1: 80.08% | Epoch [453/1000] Iter[450/ 41] Loss: 1.1590 SupLoss: 0.5140 UsupLoss: 0.6324 NLLLoss: 0.1722 Acc@1: 97.220%

| Validation Epoch #453 Loss: 0.8015 NLLLoss: 0.8015 Acc@1: 76.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [454/1000] Iter[450/ 41] Loss: 1.1934 SupLoss: 0.5609 UsupLoss: 0.6200 NLLLoss: 0.1767 Acc@1: 97.340%

| Validation Epoch #454 Loss: 0.7651 NLLLoss: 0.7651 Acc@1: 76.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [455/1000] Iter[450/ 41] Loss: 1.1204 SupLoss: 0.5233 UsupLoss: 0.5848 NLLLoss: 0.1728 Acc@1: 97.589%

| Validation Epoch #455 Loss: 0.7172 NLLLoss: 0.7172 Acc@1: 78.02%

| Best Test Acc: Acc@1: 80.08% | Epoch [456/1000] Iter[450/ 41] Loss: 1.1291 SupLoss: 0.5371 UsupLoss: 0.5799 NLLLoss: 0.1941 Acc@1: 97.233%

| Validation Epoch #456 Loss: 0.7734 NLLLoss: 0.7734 Acc@1: 76.76%

| Best Test Acc: Acc@1: 80.08% | Epoch [457/1000] Iter[450/ 41] Loss: 1.1319 SupLoss: 0.5335 UsupLoss: 0.5864 NLLLoss: 0.1663 Acc@1: 97.518%

| Validation Epoch #457 Loss: 0.7822 NLLLoss: 0.7822 Acc@1: 76.74%

| Best Test Acc: Acc@1: 80.08% | Epoch [458/1000] Iter[450/ 41] Loss: 1.1254 SupLoss: 0.4785 UsupLoss: 0.6348 NLLLoss: 0.1610 Acc@1: 97.522%

| Validation Epoch #458 Loss: 0.7349 NLLLoss: 0.7349 Acc@1: 77.38%

| Best Test Acc: Acc@1: 80.08% | Epoch [459/1000] Iter[450/ 41] Loss: 1.1707 SupLoss: 0.5455 UsupLoss: 0.6128 NLLLoss: 0.1807 Acc@1: 97.218%

| Validation Epoch #459 Loss: 0.7482 NLLLoss: 0.7482 Acc@1: 77.00%

| Best Test Acc: Acc@1: 80.08% | Epoch [460/1000] Iter[450/ 41] Loss: 1.0852 SupLoss: 0.4998 UsupLoss: 0.5731 NLLLoss: 0.1811 Acc@1: 97.556%

| Validation Epoch #460 Loss: 0.7205 NLLLoss: 0.7205 Acc@1: 77.78%

| Best Test Acc: Acc@1: 80.08% | Epoch [461/1000] Iter[450/ 41] Loss: 1.1249 SupLoss: 0.5003 UsupLoss: 0.6127 NLLLoss: 0.1660 Acc@1: 97.498%

| Validation Epoch #461 Loss: 0.8455 NLLLoss: 0.8455 Acc@1: 75.10%

| Best Test Acc: Acc@1: 80.08% | Epoch [462/1000] Iter[450/ 41] Loss: 1.0825 SupLoss: 0.4839 UsupLoss: 0.5856 NLLLoss: 0.1778 Acc@1: 97.398%

| Validation Epoch #462 Loss: 0.6648 NLLLoss: 0.6648 Acc@1: 80.04%

| Best Test Acc: Acc@1: 80.08% | Epoch [463/1000] Iter[450/ 41] Loss: 1.0629 SupLoss: 0.4640 UsupLoss: 0.5869 NLLLoss: 0.1491 Acc@1: 97.896%

| Validation Epoch #463 Loss: 0.7452 NLLLoss: 0.7452 Acc@1: 77.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [464/1000] Iter[450/ 41] Loss: 1.0260 SupLoss: 0.4563 UsupLoss: 0.5578 NLLLoss: 0.1560 Acc@1: 98.016%

| Validation Epoch #464 Loss: 0.8567 NLLLoss: 0.8567 Acc@1: 74.84%

| Best Test Acc: Acc@1: 80.08% | Epoch [465/1000] Iter[450/ 41] Loss: 1.0273 SupLoss: 0.4823 UsupLoss: 0.5329 NLLLoss: 0.1487 Acc@1: 98.198%

| Validation Epoch #465 Loss: 0.6707 NLLLoss: 0.6707 Acc@1: 79.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [466/1000] Iter[450/ 41] Loss: 1.0495 SupLoss: 0.4624 UsupLoss: 0.5755 NLLLoss: 0.1385 Acc@1: 98.096%

| Validation Epoch #466 Loss: 0.7504 NLLLoss: 0.7504 Acc@1: 77.40%

| Best Test Acc: Acc@1: 80.08% | Epoch [467/1000] Iter[450/ 41] Loss: 1.0071 SupLoss: 0.4590 UsupLoss: 0.5365 NLLLoss: 0.1427 Acc@1: 98.084%

| Validation Epoch #467 Loss: 0.6612 NLLLoss: 0.6612 Acc@1: 79.74%

| Best Test Acc: Acc@1: 80.08% | Epoch [468/1000] Iter[450/ 41] Loss: 0.9854 SupLoss: 0.4782 UsupLoss: 0.4959 NLLLoss: 0.1405 Acc@1: 98.340%

| Validation Epoch #468 Loss: 0.7472 NLLLoss: 0.7472 Acc@1: 77.58%

| Best Test Acc: Acc@1: 80.08% | Epoch [469/1000] Iter[450/ 41] Loss: 1.0142 SupLoss: 0.4523 UsupLoss: 0.5503 NLLLoss: 0.1360 Acc@1: 98.162%

| Validation Epoch #469 Loss: 0.7968 NLLLoss: 0.7968 Acc@1: 76.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [470/1000] Iter[450/ 41] Loss: 1.0277 SupLoss: 0.4786 UsupLoss: 0.5374 NLLLoss: 0.1457 Acc@1: 98.098%

| Validation Epoch #470 Loss: 0.6991 NLLLoss: 0.6991 Acc@1: 78.46%

| Best Test Acc: Acc@1: 80.08% | Epoch [471/1000] Iter[450/ 41] Loss: 1.0226 SupLoss: 0.4670 UsupLoss: 0.5443 NLLLoss: 0.1388 Acc@1: 98.191%

| Validation Epoch #471 Loss: 0.9056 NLLLoss: 0.9056 Acc@1: 73.44%

| Best Test Acc: Acc@1: 80.08% | Epoch [472/1000] Iter[450/ 41] Loss: 1.0530 SupLoss: 0.5155 UsupLoss: 0.5260 NLLLoss: 0.1658 Acc@1: 97.713%

| Validation Epoch #472 Loss: 0.9036 NLLLoss: 0.9036 Acc@1: 72.54%

| Best Test Acc: Acc@1: 80.08% | Epoch [473/1000] Iter[450/ 41] Loss: 1.0344 SupLoss: 0.4535 UsupLoss: 0.5689 NLLLoss: 0.1392 Acc@1: 98.211%

| Validation Epoch #473 Loss: 0.7420 NLLLoss: 0.7420 Acc@1: 78.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [474/1000] Iter[450/ 41] Loss: 1.0495 SupLoss: 0.4494 UsupLoss: 0.5882 NLLLoss: 0.1391 Acc@1: 98.053%

| Validation Epoch #474 Loss: 1.0090 NLLLoss: 1.0090 Acc@1: 71.64%

| Best Test Acc: Acc@1: 80.08% | Epoch [475/1000] Iter[450/ 41] Loss: 1.0541 SupLoss: 0.4939 UsupLoss: 0.5487 NLLLoss: 0.1438 Acc@1: 98.118%

| Validation Epoch #475 Loss: 0.7517 NLLLoss: 0.7517 Acc@1: 77.42%

| Best Test Acc: Acc@1: 80.08% | Epoch [476/1000] Iter[450/ 41] Loss: 1.0396 SupLoss: 0.4740 UsupLoss: 0.5534 NLLLoss: 0.1425 Acc@1: 98.069%

| Validation Epoch #476 Loss: 0.6890 NLLLoss: 0.6890 Acc@1: 78.98%

| Best Test Acc: Acc@1: 80.08% | Epoch [477/1000] Iter[450/ 41] Loss: 1.0281 SupLoss: 0.4493 UsupLoss: 0.5668 NLLLoss: 0.1371 Acc@1: 98.189%

| Validation Epoch #477 Loss: 0.6879 NLLLoss: 0.6879 Acc@1: 78.96%

| Best Test Acc: Acc@1: 80.08% | Epoch [478/1000] Iter[450/ 41] Loss: 1.0130 SupLoss: 0.4685 UsupLoss: 0.5330 NLLLoss: 0.1354 Acc@1: 98.409%

| Validation Epoch #478 Loss: 0.7309 NLLLoss: 0.7309 Acc@1: 77.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [479/1000] Iter[450/ 41] Loss: 1.0297 SupLoss: 0.4883 UsupLoss: 0.5303 NLLLoss: 0.1352 Acc@1: 98.429%

| Validation Epoch #479 Loss: 0.7581 NLLLoss: 0.7581 Acc@1: 77.66%

| Best Test Acc: Acc@1: 80.08% | Epoch [480/1000] Iter[450/ 41] Loss: 1.0470 SupLoss: 0.4947 UsupLoss: 0.5405 NLLLoss: 0.1620 Acc@1: 97.838%

| Validation Epoch #480 Loss: 0.7826 NLLLoss: 0.7826 Acc@1: 76.62%

| Best Test Acc: Acc@1: 80.08% | Epoch [481/1000] Iter[450/ 41] Loss: 1.0119 SupLoss: 0.4768 UsupLoss: 0.5234 NLLLoss: 0.1404 Acc@1: 98.249%

| Validation Epoch #481 Loss: 0.7084 NLLLoss: 0.7084 Acc@1: 78.36%

| Best Test Acc: Acc@1: 80.08% | Epoch [482/1000] Iter[450/ 41] Loss: 0.9899 SupLoss: 0.4440 UsupLoss: 0.5340 NLLLoss: 0.1317 Acc@1: 98.416%

| Validation Epoch #482 Loss: 0.7523 NLLLoss: 0.7523 Acc@1: 77.28%

| Best Test Acc: Acc@1: 80.08% | Epoch [483/1000] Iter[450/ 41] Loss: 0.9929 SupLoss: 0.4719 UsupLoss: 0.5097 NLLLoss: 0.1420 Acc@1: 98.351%

| Validation Epoch #483 Loss: 0.6597 NLLLoss: 0.6597 Acc@1: 79.14%

| Best Test Acc: Acc@1: 80.08% | Epoch [484/1000] Iter[450/ 41] Loss: 1.0139 SupLoss: 0.4540 UsupLoss: 0.5484 NLLLoss: 0.1386 Acc@1: 98.464%

| Validation Epoch #484 Loss: 0.7194 NLLLoss: 0.7194 Acc@1: 78.34%

| Best Test Acc: Acc@1: 80.08% | Epoch [485/1000] Iter[450/ 41] Loss: 0.9821 SupLoss: 0.4497 UsupLoss: 0.5210 NLLLoss: 0.1377 Acc@1: 98.331%

| Validation Epoch #485 Loss: 0.7856 NLLLoss: 0.7856 Acc@1: 78.08%

| Best Test Acc: Acc@1: 80.08% | Epoch [486/1000] Iter[450/ 41] Loss: 1.0606 SupLoss: 0.5093 UsupLoss: 0.5396 NLLLoss: 0.1527 Acc@1: 97.847%

| Validation Epoch #486 Loss: 0.8018 NLLLoss: 0.8018 Acc@1: 77.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [487/1000] Iter[450/ 41] Loss: 1.0212 SupLoss: 0.4564 UsupLoss: 0.5529 NLLLoss: 0.1429 Acc@1: 98.071%

| Validation Epoch #487 Loss: 0.7936 NLLLoss: 0.7936 Acc@1: 76.06%

| Best Test Acc: Acc@1: 80.08% | Epoch [488/1000] Iter[450/ 41] Loss: 1.0217 SupLoss: 0.4669 UsupLoss: 0.5429 NLLLoss: 0.1450 Acc@1: 98.102%

| Validation Epoch #488 Loss: 0.8154 NLLLoss: 0.8154 Acc@1: 76.36%

| Best Test Acc: Acc@1: 80.08% | Epoch [489/1000] Iter[450/ 41] Loss: 0.9755 SupLoss: 0.4681 UsupLoss: 0.4960 NLLLoss: 0.1365 Acc@1: 98.527%

| Validation Epoch #489 Loss: 0.8053 NLLLoss: 0.8053 Acc@1: 76.30%

| Best Test Acc: Acc@1: 80.08% | Epoch [490/1000] Iter[450/ 41] Loss: 0.9832 SupLoss: 0.4389 UsupLoss: 0.5328 NLLLoss: 0.1271 Acc@1: 98.329%

| Validation Epoch #490 Loss: 0.7938 NLLLoss: 0.7938 Acc@1: 76.92%

| Best Test Acc: Acc@1: 80.08% | Epoch [491/1000] Iter[450/ 41] Loss: 1.0179 SupLoss: 0.4821 UsupLoss: 0.5241 NLLLoss: 0.1234 Acc@1: 98.476%

| Validation Epoch #491 Loss: 0.6883 NLLLoss: 0.6883 Acc@1: 79.22%

| Best Test Acc: Acc@1: 80.08% | Epoch [492/1000] Iter[450/ 41] Loss: 0.9597 SupLoss: 0.4243 UsupLoss: 0.5239 NLLLoss: 0.1162 Acc@1: 98.593%

| Validation Epoch #492 Loss: 0.8109 NLLLoss: 0.8109 Acc@1: 75.48%

| Best Test Acc: Acc@1: 80.08% | Epoch [493/1000] Iter[450/ 41] Loss: 0.9626 SupLoss: 0.4226 UsupLoss: 0.5284 NLLLoss: 0.1173 Acc@1: 98.476%

| Validation Epoch #493 Loss: 0.7524 NLLLoss: 0.7524 Acc@1: 76.60%

| Best Test Acc: Acc@1: 80.08% | Epoch [494/1000] Iter[450/ 41] Loss: 0.9242 SupLoss: 0.4300 UsupLoss: 0.4832 NLLLoss: 0.1104 Acc@1: 98.809%

| Validation Epoch #494 Loss: 0.6934 NLLLoss: 0.6934 Acc@1: 79.52%

| Best Test Acc: Acc@1: 80.08% | Epoch [495/1000] Iter[450/ 41] Loss: 0.9400 SupLoss: 0.4536 UsupLoss: 0.4752 NLLLoss: 0.1130 Acc@1: 98.769%

| Validation Epoch #495 Loss: 0.8462 NLLLoss: 0.8462 Acc@1: 75.12%

| Best Test Acc: Acc@1: 80.08% | Epoch [496/1000] Iter[450/ 41] Loss: 0.9625 SupLoss: 0.4507 UsupLoss: 0.5008 NLLLoss: 0.1135 Acc@1: 98.791%

| Validation Epoch #496 Loss: 0.6598 NLLLoss: 0.6598 Acc@1: 80.14%

| Best Test Acc: Acc@1: 80.08% | Epoch [497/1000] Iter[450/ 41] Loss: 0.9167 SupLoss: 0.4162 UsupLoss: 0.4895 NLLLoss: 0.1107 Acc@1: 98.791%

| Validation Epoch #497 Loss: 0.7895 NLLLoss: 0.7895 Acc@1: 77.38%

| Best Test Acc: Acc@1: 80.08% | Epoch [498/1000] Iter[450/ 41] Loss: 0.9659 SupLoss: 0.4207 UsupLoss: 0.5340 NLLLoss: 0.1202 Acc@1: 98.489%

| Validation Epoch #498 Loss: 0.6969 NLLLoss: 0.6969 Acc@1: 78.64%

| Best Test Acc: Acc@1: 80.08% | Epoch [499/1000] Iter[450/ 41] Loss: 0.9912 SupLoss: 0.4601 UsupLoss: 0.5198 NLLLoss: 0.1150 Acc@1: 98.540%

| Validation Epoch #499 Loss: 0.7885 NLLLoss: 0.7885 Acc@1: 77.94%

| Best Test Acc: Acc@1: 80.08% | Epoch [500/1000] Iter[450/ 41] Loss: 0.8999 SupLoss: 0.3132 UsupLoss: 0.5777 NLLLoss: 0.0691 Acc@1: 99.036%

| Validation Epoch #500 Loss: 0.6562 NLLLoss: 0.6562 Acc@1: 82.00%

| Best Test Acc: Epoch #500 Loss: 0.6797 NLLLoss: 0.6797 Acc@1: 81.53%

| Best Test Acc: Acc@1: 81.53% | Epoch [501/1000] Iter[450/ 41] Loss: 0.8705 SupLoss: 0.3015 UsupLoss: 0.5617 NLLLoss: 0.0464 Acc@1: 99.611%

| Validation Epoch #501 Loss: 0.5401 NLLLoss: 0.5401 Acc@1: 84.68%

| Best Test Acc: Epoch #501 Loss: 0.5685 NLLLoss: 0.5685 Acc@1: 84.52%

| Best Test Acc: Acc@1: 84.52% | Epoch [502/1000] Iter[450/ 41] Loss: 0.8521 SupLoss: 0.2966 UsupLoss: 0.5485 NLLLoss: 0.0464 Acc@1: 99.667%

| Validation Epoch #502 Loss: 0.6032 NLLLoss: 0.6032 Acc@1: 83.54%

| Best Test Acc: Acc@1: 84.52% | Epoch [503/1000] Iter[450/ 41] Loss: 0.9089 SupLoss: 0.3048 UsupLoss: 0.5975 NLLLoss: 0.0387 Acc@1: 99.789%

| Validation Epoch #503 Loss: 0.6023 NLLLoss: 0.6023 Acc@1: 83.88%

| Best Test Acc: Acc@1: 84.52% | Epoch [504/1000] Iter[450/ 41] Loss: 0.8547 SupLoss: 0.3162 UsupLoss: 0.5319 NLLLoss: 0.0394 Acc@1: 99.853%

| Validation Epoch #504 Loss: 0.5543 NLLLoss: 0.5543 Acc@1: 85.12%

| Best Test Acc: Epoch #504 Loss: 0.5803 NLLLoss: 0.5803 Acc@1: 84.85%

| Best Test Acc: Acc@1: 84.85% | Epoch [505/1000] Iter[450/ 41] Loss: 0.8681 SupLoss: 0.2874 UsupLoss: 0.5742 NLLLoss: 0.0363 Acc@1: 99.818%

| Validation Epoch #505 Loss: 0.5520 NLLLoss: 0.5520 Acc@1: 85.56%

| Best Test Acc: Epoch #505 Loss: 0.5778 NLLLoss: 0.5778 Acc@1: 84.65%

| Best Test Acc: Acc@1: 84.65% | Epoch [506/1000] Iter[450/ 41] Loss: 0.8507 SupLoss: 0.3046 UsupLoss: 0.5396 NLLLoss: 0.0361 Acc@1: 99.876%

| Validation Epoch #506 Loss: 0.5485 NLLLoss: 0.5485 Acc@1: 85.10%

| Best Test Acc: Acc@1: 84.65% | Epoch [507/1000] Iter[450/ 41] Loss: 0.7989 SupLoss: 0.2561 UsupLoss: 0.5366 NLLLoss: 0.0331 Acc@1: 99.869%

| Validation Epoch #507 Loss: 0.5771 NLLLoss: 0.5771 Acc@1: 84.26%

| Best Test Acc: Acc@1: 84.65% | Epoch [508/1000] Iter[450/ 41] Loss: 0.8766 SupLoss: 0.3248 UsupLoss: 0.5456 NLLLoss: 0.0358 Acc@1: 99.842%

| Validation Epoch #508 Loss: 0.6102 NLLLoss: 0.6102 Acc@1: 84.02%

| Best Test Acc: Acc@1: 84.65% | Epoch [509/1000] Iter[450/ 41] Loss: 0.8137 SupLoss: 0.3082 UsupLoss: 0.4993 NLLLoss: 0.0335 Acc@1: 99.902%

| Validation Epoch #509 Loss: 0.5619 NLLLoss: 0.5619 Acc@1: 84.74%

| Best Test Acc: Acc@1: 84.65% | Epoch [510/1000] Iter[450/ 41] Loss: 0.8049 SupLoss: 0.2809 UsupLoss: 0.5180 NLLLoss: 0.0344 Acc@1: 99.884%

| Validation Epoch #510 Loss: 0.5726 NLLLoss: 0.5726 Acc@1: 84.48%

| Best Test Acc: Acc@1: 84.65% | Epoch [511/1000] Iter[450/ 41] Loss: 0.8371 SupLoss: 0.3076 UsupLoss: 0.5235 NLLLoss: 0.0316 Acc@1: 99.878%

| Validation Epoch #511 Loss: 0.5228 NLLLoss: 0.5228 Acc@1: 85.98%

| Best Test Acc: Epoch #511 Loss: 0.5401 NLLLoss: 0.5401 Acc@1: 85.56%

| Best Test Acc: Acc@1: 85.56% | Epoch [512/1000] Iter[450/ 41] Loss: 0.8427 SupLoss: 0.3327 UsupLoss: 0.5040 NLLLoss: 0.0337 Acc@1: 99.871%

| Validation Epoch #512 Loss: 0.5811 NLLLoss: 0.5811 Acc@1: 84.40%

| Best Test Acc: Acc@1: 85.56% | Epoch [513/1000] Iter[450/ 41] Loss: 0.7960 SupLoss: 0.2823 UsupLoss: 0.5077 NLLLoss: 0.0317 Acc@1: 99.880%

| Validation Epoch #513 Loss: 0.5375 NLLLoss: 0.5375 Acc@1: 85.78%

| Best Test Acc: Acc@1: 85.56% | Epoch [514/1000] Iter[450/ 41] Loss: 0.8329 SupLoss: 0.3250 UsupLoss: 0.5020 NLLLoss: 0.0320 Acc@1: 99.902%

| Validation Epoch #514 Loss: 0.5763 NLLLoss: 0.5763 Acc@1: 83.86%

| Best Test Acc: Acc@1: 85.56% | Epoch [515/1000] Iter[450/ 41] Loss: 0.7803 SupLoss: 0.2856 UsupLoss: 0.4889 NLLLoss: 0.0321 Acc@1: 99.902%

| Validation Epoch #515 Loss: 0.5465 NLLLoss: 0.5465 Acc@1: 84.94%

| Best Test Acc: Acc@1: 85.56% | Epoch [516/1000] Iter[450/ 41] Loss: 0.8063 SupLoss: 0.3191 UsupLoss: 0.4814 NLLLoss: 0.0320 Acc@1: 99.907%

| Validation Epoch #516 Loss: 0.4905 NLLLoss: 0.4905 Acc@1: 86.30%

| Best Test Acc: Epoch #516 Loss: 0.5012 NLLLoss: 0.5012 Acc@1: 86.08%

| Best Test Acc: Acc@1: 86.08% | Epoch [517/1000] Iter[450/ 41] Loss: 0.8019 SupLoss: 0.2945 UsupLoss: 0.5016 NLLLoss: 0.0305 Acc@1: 99.902%

| Validation Epoch #517 Loss: 0.5598 NLLLoss: 0.5598 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.08% | Epoch [518/1000] Iter[450/ 41] Loss: 0.8043 SupLoss: 0.2934 UsupLoss: 0.5051 NLLLoss: 0.0325 Acc@1: 99.869%

| Validation Epoch #518 Loss: 0.5167 NLLLoss: 0.5167 Acc@1: 85.80%

| Best Test Acc: Acc@1: 86.08% | Epoch [519/1000] Iter[450/ 41] Loss: 0.7930 SupLoss: 0.2664 UsupLoss: 0.5208 NLLLoss: 0.0317 Acc@1: 99.849%

| Validation Epoch #519 Loss: 0.5351 NLLLoss: 0.5351 Acc@1: 85.74%

| Best Test Acc: Acc@1: 86.08% | Epoch [520/1000] Iter[450/ 41] Loss: 0.7989 SupLoss: 0.2693 UsupLoss: 0.5238 NLLLoss: 0.0304 Acc@1: 99.889%

| Validation Epoch #520 Loss: 0.5253 NLLLoss: 0.5253 Acc@1: 85.52%

| Best Test Acc: Acc@1: 86.08% | Epoch [521/1000] Iter[450/ 41] Loss: 0.7955 SupLoss: 0.2568 UsupLoss: 0.5329 NLLLoss: 0.0313 Acc@1: 99.840%

| Validation Epoch #521 Loss: 0.5388 NLLLoss: 0.5388 Acc@1: 85.50%

| Best Test Acc: Acc@1: 86.08% | Epoch [522/1000] Iter[450/ 41] Loss: 0.7684 SupLoss: 0.2853 UsupLoss: 0.4773 NLLLoss: 0.0343 Acc@1: 99.864%

| Validation Epoch #522 Loss: 0.5337 NLLLoss: 0.5337 Acc@1: 86.10%

| Best Test Acc: Acc@1: 86.08% | Epoch [523/1000] Iter[450/ 41] Loss: 0.8164 SupLoss: 0.3245 UsupLoss: 0.4862 NLLLoss: 0.0341 Acc@1: 99.862%

| Validation Epoch #523 Loss: 0.5867 NLLLoss: 0.5867 Acc@1: 84.44%

| Best Test Acc: Acc@1: 86.08% | Epoch [524/1000] Iter[450/ 41] Loss: 0.7690 SupLoss: 0.2984 UsupLoss: 0.4651 NLLLoss: 0.0327 Acc@1: 99.896%

| Validation Epoch #524 Loss: 0.5198 NLLLoss: 0.5198 Acc@1: 86.24%

| Best Test Acc: Acc@1: 86.08% | Epoch [525/1000] Iter[450/ 41] Loss: 0.7776 SupLoss: 0.2836 UsupLoss: 0.4884 NLLLoss: 0.0314 Acc@1: 99.896%

| Validation Epoch #525 Loss: 0.5539 NLLLoss: 0.5539 Acc@1: 84.90%

| Best Test Acc: Acc@1: 86.08% | Epoch [526/1000] Iter[450/ 41] Loss: 0.7551 SupLoss: 0.2655 UsupLoss: 0.4840 NLLLoss: 0.0316 Acc@1: 99.907%

| Validation Epoch #526 Loss: 0.5556 NLLLoss: 0.5556 Acc@1: 85.66%

| Best Test Acc: Acc@1: 86.08% | Epoch [527/1000] Iter[450/ 41] Loss: 0.7731 SupLoss: 0.2841 UsupLoss: 0.4835 NLLLoss: 0.0325 Acc@1: 99.840%

| Validation Epoch #527 Loss: 0.5223 NLLLoss: 0.5223 Acc@1: 85.98%

| Best Test Acc: Acc@1: 86.08% | Epoch [528/1000] Iter[450/ 41] Loss: 0.7567 SupLoss: 0.2558 UsupLoss: 0.4954 NLLLoss: 0.0290 Acc@1: 99.904%

| Validation Epoch #528 Loss: 0.5079 NLLLoss: 0.5079 Acc@1: 85.94%

| Best Test Acc: Acc@1: 86.08% | Epoch [529/1000] Iter[450/ 41] Loss: 0.7950 SupLoss: 0.2976 UsupLoss: 0.4918 NLLLoss: 0.0329 Acc@1: 99.856%

| Validation Epoch #529 Loss: 0.5347 NLLLoss: 0.5347 Acc@1: 85.40%

| Best Test Acc: Acc@1: 86.08% | Epoch [530/1000] Iter[450/ 41] Loss: 0.7641 SupLoss: 0.2973 UsupLoss: 0.4613 NLLLoss: 0.0328 Acc@1: 99.878%

| Validation Epoch #530 Loss: 0.5453 NLLLoss: 0.5453 Acc@1: 85.72%

| Best Test Acc: Acc@1: 86.08% | Epoch [531/1000] Iter[450/ 41] Loss: 0.7192 SupLoss: 0.2512 UsupLoss: 0.4626 NLLLoss: 0.0316 Acc@1: 99.884%

| Validation Epoch #531 Loss: 0.5837 NLLLoss: 0.5837 Acc@1: 84.92%

| Best Test Acc: Acc@1: 86.08% | Epoch [532/1000] Iter[450/ 41] Loss: 0.7955 SupLoss: 0.2987 UsupLoss: 0.4912 NLLLoss: 0.0330 Acc@1: 99.873%

| Validation Epoch #532 Loss: 0.5487 NLLLoss: 0.5487 Acc@1: 85.68%

| Best Test Acc: Acc@1: 86.08% | Epoch [533/1000] Iter[450/ 41] Loss: 0.7504 SupLoss: 0.2875 UsupLoss: 0.4575 NLLLoss: 0.0322 Acc@1: 99.871%

| Validation Epoch #533 Loss: 0.5231 NLLLoss: 0.5231 Acc@1: 85.30%

| Best Test Acc: Acc@1: 86.08% | Epoch [534/1000] Iter[450/ 41] Loss: 0.7431 SupLoss: 0.2633 UsupLoss: 0.4744 NLLLoss: 0.0312 Acc@1: 99.873%

| Validation Epoch #534 Loss: 0.5125 NLLLoss: 0.5125 Acc@1: 85.52%

| Best Test Acc: Acc@1: 86.08% | Epoch [535/1000] Iter[450/ 41] Loss: 0.7809 SupLoss: 0.2898 UsupLoss: 0.4857 NLLLoss: 0.0326 Acc@1: 99.856%

| Validation Epoch #535 Loss: 0.5447 NLLLoss: 0.5447 Acc@1: 85.36%

| Best Test Acc: Acc@1: 86.08% | Epoch [536/1000] Iter[450/ 41] Loss: 0.7671 SupLoss: 0.2793 UsupLoss: 0.4825 NLLLoss: 0.0325 Acc@1: 99.862%

| Validation Epoch #536 Loss: 0.5765 NLLLoss: 0.5765 Acc@1: 84.36%

| Best Test Acc: Acc@1: 86.08% | Epoch [537/1000] Iter[450/ 41] Loss: 0.7585 SupLoss: 0.2847 UsupLoss: 0.4683 NLLLoss: 0.0386 Acc@1: 99.849%

| Validation Epoch #537 Loss: 0.5251 NLLLoss: 0.5251 Acc@1: 85.88%

| Best Test Acc: Acc@1: 86.08% | Epoch [538/1000] Iter[450/ 41] Loss: 0.7693 SupLoss: 0.2804 UsupLoss: 0.4835 NLLLoss: 0.0315 Acc@1: 99.856%

| Validation Epoch #538 Loss: 0.5736 NLLLoss: 0.5736 Acc@1: 84.64%

| Best Test Acc: Acc@1: 86.08% | Epoch [539/1000] Iter[450/ 41] Loss: 0.7030 SupLoss: 0.2302 UsupLoss: 0.4674 NLLLoss: 0.0321 Acc@1: 99.873%

| Validation Epoch #539 Loss: 0.5400 NLLLoss: 0.5400 Acc@1: 85.72%

| Best Test Acc: Acc@1: 86.08% | Epoch [540/1000] Iter[450/ 41] Loss: 0.7421 SupLoss: 0.2749 UsupLoss: 0.4618 NLLLoss: 0.0327 Acc@1: 99.838%

| Validation Epoch #540 Loss: 0.5447 NLLLoss: 0.5447 Acc@1: 85.22%

| Best Test Acc: Acc@1: 86.08% | Epoch [541/1000] Iter[450/ 41] Loss: 0.7703 SupLoss: 0.2803 UsupLoss: 0.4846 NLLLoss: 0.0317 Acc@1: 99.842%

| Validation Epoch #541 Loss: 0.5412 NLLLoss: 0.5412 Acc@1: 85.60%

| Best Test Acc: Acc@1: 86.08% | Epoch [542/1000] Iter[450/ 41] Loss: 0.7369 SupLoss: 0.2860 UsupLoss: 0.4455 NLLLoss: 0.0344 Acc@1: 99.831%

| Validation Epoch #542 Loss: 0.5317 NLLLoss: 0.5317 Acc@1: 85.60%

| Best Test Acc: Acc@1: 86.08% | Epoch [543/1000] Iter[450/ 41] Loss: 0.7542 SupLoss: 0.2817 UsupLoss: 0.4671 NLLLoss: 0.0314 Acc@1: 99.851%

| Validation Epoch #543 Loss: 0.5672 NLLLoss: 0.5672 Acc@1: 85.16%

| Best Test Acc: Acc@1: 86.08% | Epoch [544/1000] Iter[450/ 41] Loss: 0.7311 SupLoss: 0.2428 UsupLoss: 0.4829 NLLLoss: 0.0316 Acc@1: 99.836%

| Validation Epoch #544 Loss: 0.5357 NLLLoss: 0.5357 Acc@1: 85.44%

| Best Test Acc: Acc@1: 86.08% | Epoch [545/1000] Iter[450/ 41] Loss: 0.7699 SupLoss: 0.2778 UsupLoss: 0.4867 NLLLoss: 0.0313 Acc@1: 99.842%

| Validation Epoch #545 Loss: 0.5057 NLLLoss: 0.5057 Acc@1: 85.64%

| Best Test Acc: Acc@1: 86.08% | Epoch [546/1000] Iter[450/ 41] Loss: 0.7967 SupLoss: 0.3022 UsupLoss: 0.4891 NLLLoss: 0.0328 Acc@1: 99.840%

| Validation Epoch #546 Loss: 0.5734 NLLLoss: 0.5734 Acc@1: 85.04%

| Best Test Acc: Acc@1: 86.08% | Epoch [547/1000] Iter[450/ 41] Loss: 0.7351 SupLoss: 0.2551 UsupLoss: 0.4746 NLLLoss: 0.0326 Acc@1: 99.882%

| Validation Epoch #547 Loss: 0.5536 NLLLoss: 0.5536 Acc@1: 84.80%

| Best Test Acc: Acc@1: 86.08% | Epoch [548/1000] Iter[450/ 41] Loss: 0.7305 SupLoss: 0.2860 UsupLoss: 0.4393 NLLLoss: 0.0329 Acc@1: 99.858%

| Validation Epoch #548 Loss: 0.5545 NLLLoss: 0.5545 Acc@1: 85.04%

| Best Test Acc: Acc@1: 86.08% | Epoch [549/1000] Iter[450/ 41] Loss: 0.7681 SupLoss: 0.2870 UsupLoss: 0.4758 NLLLoss: 0.0343 Acc@1: 99.844%

| Validation Epoch #549 Loss: 0.5220 NLLLoss: 0.5220 Acc@1: 86.18%

| Best Test Acc: Acc@1: 86.08% | Epoch [550/1000] Iter[450/ 41] Loss: 0.7454 SupLoss: 0.2758 UsupLoss: 0.4642 NLLLoss: 0.0338 Acc@1: 99.804%

| Validation Epoch #550 Loss: 0.4986 NLLLoss: 0.4986 Acc@1: 86.10%

| Best Test Acc: Acc@1: 86.08% | Epoch [551/1000] Iter[450/ 41] Loss: 0.7156 SupLoss: 0.2625 UsupLoss: 0.4478 NLLLoss: 0.0327 Acc@1: 99.853%

| Validation Epoch #551 Loss: 0.5224 NLLLoss: 0.5224 Acc@1: 85.90%

| Best Test Acc: Acc@1: 86.08% | Epoch [552/1000] Iter[450/ 41] Loss: 0.7668 SupLoss: 0.2923 UsupLoss: 0.4692 NLLLoss: 0.0326 Acc@1: 99.836%

| Validation Epoch #552 Loss: 0.5525 NLLLoss: 0.5525 Acc@1: 84.90%

| Best Test Acc: Acc@1: 86.08% | Epoch [553/1000] Iter[450/ 41] Loss: 0.7280 SupLoss: 0.2753 UsupLoss: 0.4474 NLLLoss: 0.0335 Acc@1: 99.844%

| Validation Epoch #553 Loss: 0.5231 NLLLoss: 0.5231 Acc@1: 86.26%

| Best Test Acc: Acc@1: 86.08% | Epoch [554/1000] Iter[450/ 41] Loss: 0.7733 SupLoss: 0.2992 UsupLoss: 0.4689 NLLLoss: 0.0317 Acc@1: 99.847%

| Validation Epoch #554 Loss: 0.5613 NLLLoss: 0.5613 Acc@1: 85.02%

| Best Test Acc: Acc@1: 86.08% | Epoch [555/1000] Iter[450/ 41] Loss: 0.7318 SupLoss: 0.2848 UsupLoss: 0.4418 NLLLoss: 0.0302 Acc@1: 99.862%

| Validation Epoch #555 Loss: 0.5148 NLLLoss: 0.5148 Acc@1: 85.84%

| Best Test Acc: Acc@1: 86.08% | Epoch [556/1000] Iter[450/ 41] Loss: 0.7316 SupLoss: 0.2744 UsupLoss: 0.4520 NLLLoss: 0.0304 Acc@1: 99.867%

| Validation Epoch #556 Loss: 0.5507 NLLLoss: 0.5507 Acc@1: 85.10%

| Best Test Acc: Acc@1: 86.08% | Epoch [557/1000] Iter[450/ 41] Loss: 0.7485 SupLoss: 0.2889 UsupLoss: 0.4542 NLLLoss: 0.0327 Acc@1: 99.864%

| Validation Epoch #557 Loss: 0.5184 NLLLoss: 0.5184 Acc@1: 85.54%

| Best Test Acc: Acc@1: 86.08% | Epoch [558/1000] Iter[450/ 41] Loss: 0.7135 SupLoss: 0.2538 UsupLoss: 0.4546 NLLLoss: 0.0327 Acc@1: 99.829%

| Validation Epoch #558 Loss: 0.5158 NLLLoss: 0.5158 Acc@1: 85.94%

| Best Test Acc: Acc@1: 86.08% | Epoch [559/1000] Iter[450/ 41] Loss: 0.7040 SupLoss: 0.2773 UsupLoss: 0.4214 NLLLoss: 0.0337 Acc@1: 99.853%

| Validation Epoch #559 Loss: 0.4813 NLLLoss: 0.4813 Acc@1: 86.74%

| Best Test Acc: Epoch #559 Loss: 0.4857 NLLLoss: 0.4857 Acc@1: 86.77%

| Best Test Acc: Acc@1: 86.77% | Epoch [560/1000] Iter[450/ 41] Loss: 0.7265 SupLoss: 0.2680 UsupLoss: 0.4534 NLLLoss: 0.0313 Acc@1: 99.833%

| Validation Epoch #560 Loss: 0.5303 NLLLoss: 0.5303 Acc@1: 86.00%

| Best Test Acc: Acc@1: 86.77% | Epoch [561/1000] Iter[450/ 41] Loss: 0.7326 SupLoss: 0.2855 UsupLoss: 0.4420 NLLLoss: 0.0325 Acc@1: 99.849%

| Validation Epoch #561 Loss: 0.5486 NLLLoss: 0.5486 Acc@1: 85.36%

| Best Test Acc: Acc@1: 86.77% | Epoch [562/1000] Iter[450/ 41] Loss: 0.7157 SupLoss: 0.2620 UsupLoss: 0.4486 NLLLoss: 0.0306 Acc@1: 99.871%

| Validation Epoch #562 Loss: 0.5773 NLLLoss: 0.5773 Acc@1: 84.76%

| Best Test Acc: Acc@1: 86.77% | Epoch [563/1000] Iter[450/ 41] Loss: 0.7687 SupLoss: 0.2875 UsupLoss: 0.4761 NLLLoss: 0.0298 Acc@1: 99.862%

| Validation Epoch #563 Loss: 0.5403 NLLLoss: 0.5403 Acc@1: 85.66%

| Best Test Acc: Acc@1: 86.77% | Epoch [564/1000] Iter[450/ 41] Loss: 0.7599 SupLoss: 0.2764 UsupLoss: 0.4782 NLLLoss: 0.0314 Acc@1: 99.809%

| Validation Epoch #564 Loss: 0.5900 NLLLoss: 0.5900 Acc@1: 84.56%

| Best Test Acc: Acc@1: 86.77% | Epoch [565/1000] Iter[450/ 41] Loss: 0.7160 SupLoss: 0.2539 UsupLoss: 0.4569 NLLLoss: 0.0334 Acc@1: 99.824%

| Validation Epoch #565 Loss: 0.5182 NLLLoss: 0.5182 Acc@1: 85.76%

| Best Test Acc: Acc@1: 86.77% | Epoch [566/1000] Iter[450/ 41] Loss: 0.7412 SupLoss: 0.2807 UsupLoss: 0.4554 NLLLoss: 0.0318 Acc@1: 99.829%

| Validation Epoch #566 Loss: 0.6043 NLLLoss: 0.6043 Acc@1: 84.50%

| Best Test Acc: Acc@1: 86.77% | Epoch [567/1000] Iter[450/ 41] Loss: 0.7086 SupLoss: 0.2478 UsupLoss: 0.4557 NLLLoss: 0.0312 Acc@1: 99.838%

| Validation Epoch #567 Loss: 0.5876 NLLLoss: 0.5876 Acc@1: 84.52%

| Best Test Acc: Acc@1: 86.77% | Epoch [568/1000] Iter[450/ 41] Loss: 0.7509 SupLoss: 0.2863 UsupLoss: 0.4594 NLLLoss: 0.0325 Acc@1: 99.793%

| Validation Epoch #568 Loss: 0.5891 NLLLoss: 0.5891 Acc@1: 84.40%

| Best Test Acc: Acc@1: 86.77% | Epoch [569/1000] Iter[450/ 41] Loss: 0.7279 SupLoss: 0.2787 UsupLoss: 0.4441 NLLLoss: 0.0326 Acc@1: 99.860%

| Validation Epoch #569 Loss: 0.5123 NLLLoss: 0.5123 Acc@1: 86.00%

| Best Test Acc: Acc@1: 86.77% | Epoch [570/1000] Iter[450/ 41] Loss: 0.7562 SupLoss: 0.2911 UsupLoss: 0.4600 NLLLoss: 0.0300 Acc@1: 99.867%

| Validation Epoch #570 Loss: 0.5483 NLLLoss: 0.5483 Acc@1: 85.12%

| Best Test Acc: Acc@1: 86.77% | Epoch [571/1000] Iter[450/ 41] Loss: 0.7366 SupLoss: 0.3022 UsupLoss: 0.4291 NLLLoss: 0.0327 Acc@1: 99.822%

| Validation Epoch #571 Loss: 0.5290 NLLLoss: 0.5290 Acc@1: 85.60%

| Best Test Acc: Acc@1: 86.77% | Epoch [572/1000] Iter[450/ 41] Loss: 0.7445 SupLoss: 0.2789 UsupLoss: 0.4605 NLLLoss: 0.0317 Acc@1: 99.836%

| Validation Epoch #572 Loss: 0.6063 NLLLoss: 0.6063 Acc@1: 84.06%

| Best Test Acc: Acc@1: 86.77% | Epoch [573/1000] Iter[450/ 41] Loss: 0.7723 SupLoss: 0.2978 UsupLoss: 0.4693 NLLLoss: 0.0313 Acc@1: 99.820%

| Validation Epoch #573 Loss: 0.5052 NLLLoss: 0.5052 Acc@1: 85.38%

| Best Test Acc: Acc@1: 86.77% | Epoch [574/1000] Iter[450/ 41] Loss: 0.7221 SupLoss: 0.2523 UsupLoss: 0.4646 NLLLoss: 0.0304 Acc@1: 99.858%

| Validation Epoch #574 Loss: 0.5564 NLLLoss: 0.5564 Acc@1: 84.82%

| Best Test Acc: Acc@1: 86.77% | Epoch [575/1000] Iter[450/ 41] Loss: 0.7558 SupLoss: 0.2967 UsupLoss: 0.4539 NLLLoss: 0.0312 Acc@1: 99.853%

| Validation Epoch #575 Loss: 0.5209 NLLLoss: 0.5209 Acc@1: 85.40%

| Best Test Acc: Acc@1: 86.77% | Epoch [576/1000] Iter[450/ 41] Loss: 0.7593 SupLoss: 0.2821 UsupLoss: 0.4720 NLLLoss: 0.0324 Acc@1: 99.789%

| Validation Epoch #576 Loss: 0.5507 NLLLoss: 0.5507 Acc@1: 85.24%

| Best Test Acc: Acc@1: 86.77% | Epoch [577/1000] Iter[450/ 41] Loss: 0.7408 SupLoss: 0.2881 UsupLoss: 0.4476 NLLLoss: 0.0320 Acc@1: 99.796%

| Validation Epoch #577 Loss: 0.5967 NLLLoss: 0.5967 Acc@1: 84.40%

| Best Test Acc: Acc@1: 86.77% | Epoch [578/1000] Iter[450/ 41] Loss: 0.7427 SupLoss: 0.2896 UsupLoss: 0.4478 NLLLoss: 0.0329 Acc@1: 99.842%

| Validation Epoch #578 Loss: 0.5917 NLLLoss: 0.5917 Acc@1: 83.46%

| Best Test Acc: Acc@1: 86.77% | Epoch [579/1000] Iter[450/ 41] Loss: 0.7371 SupLoss: 0.2834 UsupLoss: 0.4486 NLLLoss: 0.0346 Acc@1: 99.822%

| Validation Epoch #579 Loss: 0.5316 NLLLoss: 0.5316 Acc@1: 85.42%

| Best Test Acc: Acc@1: 86.77% | Epoch [580/1000] Iter[450/ 41] Loss: 0.7342 SupLoss: 0.2866 UsupLoss: 0.4425 NLLLoss: 0.0314 Acc@1: 99.840%

| Validation Epoch #580 Loss: 0.5639 NLLLoss: 0.5639 Acc@1: 84.40%

| Best Test Acc: Acc@1: 86.77% | Epoch [581/1000] Iter[450/ 41] Loss: 0.7500 SupLoss: 0.2515 UsupLoss: 0.4932 NLLLoss: 0.0295 Acc@1: 99.831%

| Validation Epoch #581 Loss: 0.5269 NLLLoss: 0.5269 Acc@1: 84.82%

| Best Test Acc: Acc@1: 86.77% | Epoch [582/1000] Iter[450/ 41] Loss: 0.7783 SupLoss: 0.3044 UsupLoss: 0.4686 NLLLoss: 0.0305 Acc@1: 99.864%

| Validation Epoch #582 Loss: 0.5276 NLLLoss: 0.5276 Acc@1: 85.10%

| Best Test Acc: Acc@1: 86.77% | Epoch [583/1000] Iter[450/ 41] Loss: 0.7301 SupLoss: 0.2592 UsupLoss: 0.4657 NLLLoss: 0.0309 Acc@1: 99.829%

| Validation Epoch #583 Loss: 0.5356 NLLLoss: 0.5356 Acc@1: 85.60%

| Best Test Acc: Acc@1: 86.77% | Epoch [584/1000] Iter[450/ 41] Loss: 0.7159 SupLoss: 0.2568 UsupLoss: 0.4539 NLLLoss: 0.0327 Acc@1: 99.778%

| Validation Epoch #584 Loss: 0.5510 NLLLoss: 0.5510 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.77% | Epoch [585/1000] Iter[450/ 41] Loss: 0.7190 SupLoss: 0.2354 UsupLoss: 0.4783 NLLLoss: 0.0293 Acc@1: 99.840%

| Validation Epoch #585 Loss: 0.5645 NLLLoss: 0.5645 Acc@1: 85.30%

| Best Test Acc: Acc@1: 86.77% | Epoch [586/1000] Iter[450/ 41] Loss: 0.7258 SupLoss: 0.2718 UsupLoss: 0.4488 NLLLoss: 0.0306 Acc@1: 99.842%

| Validation Epoch #586 Loss: 0.5688 NLLLoss: 0.5688 Acc@1: 84.78%

| Best Test Acc: Acc@1: 86.77% | Epoch [587/1000] Iter[450/ 41] Loss: 0.7344 SupLoss: 0.2665 UsupLoss: 0.4629 NLLLoss: 0.0316 Acc@1: 99.789%

| Validation Epoch #587 Loss: 0.5795 NLLLoss: 0.5795 Acc@1: 84.16%

| Best Test Acc: Acc@1: 86.77% | Epoch [588/1000] Iter[450/ 41] Loss: 0.7327 SupLoss: 0.2695 UsupLoss: 0.4580 NLLLoss: 0.0325 Acc@1: 99.838%

| Validation Epoch #588 Loss: 0.5879 NLLLoss: 0.5879 Acc@1: 84.66%

| Best Test Acc: Acc@1: 86.77% | Epoch [589/1000] Iter[450/ 41] Loss: 0.6880 SupLoss: 0.2571 UsupLoss: 0.4257 NLLLoss: 0.0305 Acc@1: 99.844%

| Validation Epoch #589 Loss: 0.5360 NLLLoss: 0.5360 Acc@1: 85.72%

| Best Test Acc: Acc@1: 86.77% | Epoch [590/1000] Iter[450/ 41] Loss: 0.7112 SupLoss: 0.2485 UsupLoss: 0.4575 NLLLoss: 0.0287 Acc@1: 99.860%

| Validation Epoch #590 Loss: 0.5170 NLLLoss: 0.5170 Acc@1: 85.98%

| Best Test Acc: Acc@1: 86.77% | Epoch [591/1000] Iter[450/ 41] Loss: 0.7329 SupLoss: 0.2897 UsupLoss: 0.4380 NLLLoss: 0.0308 Acc@1: 99.858%

| Validation Epoch #591 Loss: 0.6231 NLLLoss: 0.6231 Acc@1: 83.50%

| Best Test Acc: Acc@1: 86.77% | Epoch [592/1000] Iter[450/ 41] Loss: 0.7391 SupLoss: 0.2835 UsupLoss: 0.4505 NLLLoss: 0.0314 Acc@1: 99.869%

| Validation Epoch #592 Loss: 0.6133 NLLLoss: 0.6133 Acc@1: 83.94%

| Best Test Acc: Acc@1: 86.77% | Epoch [593/1000] Iter[450/ 41] Loss: 0.7031 SupLoss: 0.2579 UsupLoss: 0.4401 NLLLoss: 0.0308 Acc@1: 99.867%

| Validation Epoch #593 Loss: 0.5200 NLLLoss: 0.5200 Acc@1: 85.54%

| Best Test Acc: Acc@1: 86.77% | Epoch [594/1000] Iter[450/ 41] Loss: 0.7430 SupLoss: 0.2808 UsupLoss: 0.4571 NLLLoss: 0.0294 Acc@1: 99.844%

| Validation Epoch #594 Loss: 0.5849 NLLLoss: 0.5849 Acc@1: 84.30%

| Best Test Acc: Acc@1: 86.77% | Epoch [595/1000] Iter[450/ 41] Loss: 0.7399 SupLoss: 0.2833 UsupLoss: 0.4514 NLLLoss: 0.0324 Acc@1: 99.758%

| Validation Epoch #595 Loss: 0.5748 NLLLoss: 0.5748 Acc@1: 84.94%

| Best Test Acc: Acc@1: 86.77% | Epoch [596/1000] Iter[450/ 41] Loss: 0.7495 SupLoss: 0.2826 UsupLoss: 0.4617 NLLLoss: 0.0298 Acc@1: 99.831%

| Validation Epoch #596 Loss: 0.5783 NLLLoss: 0.5783 Acc@1: 84.30%

| Best Test Acc: Acc@1: 86.77% | Epoch [597/1000] Iter[450/ 41] Loss: 0.7846 SupLoss: 0.3212 UsupLoss: 0.4581 NLLLoss: 0.0313 Acc@1: 99.851%

| Validation Epoch #597 Loss: 0.4986 NLLLoss: 0.4986 Acc@1: 86.76%

| Best Test Acc: Epoch #597 Loss: 0.5202 NLLLoss: 0.5202 Acc@1: 86.39%

| Best Test Acc: Acc@1: 86.39% | Epoch [598/1000] Iter[450/ 41] Loss: 0.7422 SupLoss: 0.2779 UsupLoss: 0.4590 NLLLoss: 0.0313 Acc@1: 99.813%

| Validation Epoch #598 Loss: 0.5178 NLLLoss: 0.5178 Acc@1: 85.68%

| Best Test Acc: Acc@1: 86.39% | Epoch [599/1000] Iter[450/ 41] Loss: 0.7115 SupLoss: 0.2499 UsupLoss: 0.4563 NLLLoss: 0.0283 Acc@1: 99.860%

| Validation Epoch #599 Loss: 0.5139 NLLLoss: 0.5139 Acc@1: 85.82%

| Best Test Acc: Acc@1: 86.39% | Epoch [600/1000] Iter[450/ 41] Loss: 0.7401 SupLoss: 0.2623 UsupLoss: 0.4725 NLLLoss: 0.0300 Acc@1: 99.847%

| Validation Epoch #600 Loss: 0.4907 NLLLoss: 0.4907 Acc@1: 85.98%

| Best Test Acc: Acc@1: 86.39% | Epoch [601/1000] Iter[450/ 41] Loss: 0.7303 SupLoss: 0.2693 UsupLoss: 0.4558 NLLLoss: 0.0293 Acc@1: 99.867%

| Validation Epoch #601 Loss: 0.5683 NLLLoss: 0.5683 Acc@1: 84.16%

| Best Test Acc: Acc@1: 86.39% | Epoch [602/1000] Iter[450/ 41] Loss: 0.7557 SupLoss: 0.3072 UsupLoss: 0.4433 NLLLoss: 0.0327 Acc@1: 99.829%

| Validation Epoch #602 Loss: 0.5367 NLLLoss: 0.5367 Acc@1: 84.84%

| Best Test Acc: Acc@1: 86.39% | Epoch [603/1000] Iter[450/ 41] Loss: 0.7056 SupLoss: 0.2480 UsupLoss: 0.4524 NLLLoss: 0.0293 Acc@1: 99.869%

| Validation Epoch #603 Loss: 0.5030 NLLLoss: 0.5030 Acc@1: 85.56%

| Best Test Acc: Acc@1: 86.39% | Epoch [604/1000] Iter[450/ 41] Loss: 0.7411 SupLoss: 0.2780 UsupLoss: 0.4580 NLLLoss: 0.0310 Acc@1: 99.851%

| Validation Epoch #604 Loss: 0.5282 NLLLoss: 0.5282 Acc@1: 85.50%

| Best Test Acc: Acc@1: 86.39% | Epoch [605/1000] Iter[450/ 41] Loss: 0.6956 SupLoss: 0.2419 UsupLoss: 0.4487 NLLLoss: 0.0301 Acc@1: 99.829%

| Validation Epoch #605 Loss: 0.5303 NLLLoss: 0.5303 Acc@1: 85.66%

| Best Test Acc: Acc@1: 86.39% | Epoch [606/1000] Iter[450/ 41] Loss: 0.7436 SupLoss: 0.2692 UsupLoss: 0.4691 NLLLoss: 0.0287 Acc@1: 99.844%

| Validation Epoch #606 Loss: 0.5169 NLLLoss: 0.5169 Acc@1: 85.68%

| Best Test Acc: Acc@1: 86.39% | Epoch [607/1000] Iter[450/ 41] Loss: 0.7722 SupLoss: 0.2934 UsupLoss: 0.4736 NLLLoss: 0.0303 Acc@1: 99.827%

| Validation Epoch #607 Loss: 0.5874 NLLLoss: 0.5874 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.39% | Epoch [608/1000] Iter[450/ 41] Loss: 0.7659 SupLoss: 0.2926 UsupLoss: 0.4681 NLLLoss: 0.0317 Acc@1: 99.829%

| Validation Epoch #608 Loss: 0.5593 NLLLoss: 0.5593 Acc@1: 84.30%

| Best Test Acc: Acc@1: 86.39% | Epoch [609/1000] Iter[450/ 41] Loss: 0.7103 SupLoss: 0.2700 UsupLoss: 0.4351 NLLLoss: 0.0338 Acc@1: 99.804%

| Validation Epoch #609 Loss: 0.4854 NLLLoss: 0.4854 Acc@1: 86.52%

| Best Test Acc: Acc@1: 86.39% | Epoch [610/1000] Iter[450/ 41] Loss: 0.7425 SupLoss: 0.2852 UsupLoss: 0.4521 NLLLoss: 0.0306 Acc@1: 99.833%

| Validation Epoch #610 Loss: 0.5078 NLLLoss: 0.5078 Acc@1: 85.88%

| Best Test Acc: Acc@1: 86.39% | Epoch [611/1000] Iter[450/ 41] Loss: 0.7682 SupLoss: 0.3064 UsupLoss: 0.4565 NLLLoss: 0.0320 Acc@1: 99.836%

| Validation Epoch #611 Loss: 0.5290 NLLLoss: 0.5290 Acc@1: 85.86%

| Best Test Acc: Acc@1: 86.39% | Epoch [612/1000] Iter[450/ 41] Loss: 0.7413 SupLoss: 0.2687 UsupLoss: 0.4673 NLLLoss: 0.0298 Acc@1: 99.807%

| Validation Epoch #612 Loss: 0.5863 NLLLoss: 0.5863 Acc@1: 83.70%

| Best Test Acc: Acc@1: 86.39% | Epoch [613/1000] Iter[450/ 41] Loss: 0.7293 SupLoss: 0.2723 UsupLoss: 0.4518 NLLLoss: 0.0315 Acc@1: 99.793%

| Validation Epoch #613 Loss: 0.5719 NLLLoss: 0.5719 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.39% | Epoch [614/1000] Iter[450/ 41] Loss: 0.7539 SupLoss: 0.2923 UsupLoss: 0.4564 NLLLoss: 0.0307 Acc@1: 99.818%

| Validation Epoch #614 Loss: 0.5535 NLLLoss: 0.5535 Acc@1: 85.32%

| Best Test Acc: Acc@1: 86.39% | Epoch [615/1000] Iter[450/ 41] Loss: 0.7236 SupLoss: 0.2490 UsupLoss: 0.4694 NLLLoss: 0.0293 Acc@1: 99.840%

| Validation Epoch #615 Loss: 0.5632 NLLLoss: 0.5632 Acc@1: 84.82%

| Best Test Acc: Acc@1: 86.39% | Epoch [616/1000] Iter[450/ 41] Loss: 0.7508 SupLoss: 0.2575 UsupLoss: 0.4880 NLLLoss: 0.0312 Acc@1: 99.762%

| Validation Epoch #616 Loss: 0.4795 NLLLoss: 0.4795 Acc@1: 86.60%

| Best Test Acc: Acc@1: 86.39% | Epoch [617/1000] Iter[450/ 41] Loss: 0.7186 SupLoss: 0.2667 UsupLoss: 0.4467 NLLLoss: 0.0325 Acc@1: 99.842%

| Validation Epoch #617 Loss: 0.5737 NLLLoss: 0.5737 Acc@1: 85.08%

| Best Test Acc: Acc@1: 86.39% | Epoch [618/1000] Iter[450/ 41] Loss: 0.7587 SupLoss: 0.3020 UsupLoss: 0.4515 NLLLoss: 0.0310 Acc@1: 99.831%

| Validation Epoch #618 Loss: 0.5409 NLLLoss: 0.5409 Acc@1: 85.06%

| Best Test Acc: Acc@1: 86.39% | Epoch [619/1000] Iter[450/ 41] Loss: 0.7143 SupLoss: 0.2662 UsupLoss: 0.4430 NLLLoss: 0.0300 Acc@1: 99.856%

| Validation Epoch #619 Loss: 0.5147 NLLLoss: 0.5147 Acc@1: 86.08%

| Best Test Acc: Acc@1: 86.39% | Epoch [620/1000] Iter[450/ 41] Loss: 0.7466 SupLoss: 0.2952 UsupLoss: 0.4462 NLLLoss: 0.0300 Acc@1: 99.867%

| Validation Epoch #620 Loss: 0.5329 NLLLoss: 0.5329 Acc@1: 85.48%

| Best Test Acc: Acc@1: 86.39% | Epoch [621/1000] Iter[450/ 41] Loss: 0.7252 SupLoss: 0.2499 UsupLoss: 0.4700 NLLLoss: 0.0294 Acc@1: 99.844%

| Validation Epoch #621 Loss: 0.5104 NLLLoss: 0.5104 Acc@1: 85.18%

| Best Test Acc: Acc@1: 86.39% | Epoch [622/1000] Iter[450/ 41] Loss: 0.7339 SupLoss: 0.2964 UsupLoss: 0.4322 NLLLoss: 0.0317 Acc@1: 99.836%

| Validation Epoch #622 Loss: 0.6218 NLLLoss: 0.6218 Acc@1: 83.18%

| Best Test Acc: Acc@1: 86.39% | Epoch [623/1000] Iter[450/ 41] Loss: 0.7384 SupLoss: 0.2997 UsupLoss: 0.4336 NLLLoss: 0.0296 Acc@1: 99.853%

| Validation Epoch #623 Loss: 0.5574 NLLLoss: 0.5574 Acc@1: 84.32%

| Best Test Acc: Acc@1: 86.39% | Epoch [624/1000] Iter[450/ 41] Loss: 0.7161 SupLoss: 0.2753 UsupLoss: 0.4357 NLLLoss: 0.0298 Acc@1: 99.887%

| Validation Epoch #624 Loss: 0.5740 NLLLoss: 0.5740 Acc@1: 84.72%

| Best Test Acc: Acc@1: 86.39% | Epoch [625/1000] Iter[450/ 41] Loss: 0.7389 SupLoss: 0.3030 UsupLoss: 0.4308 NLLLoss: 0.0298 Acc@1: 99.869%

| Validation Epoch #625 Loss: 0.5597 NLLLoss: 0.5597 Acc@1: 84.48%

| Best Test Acc: Acc@1: 86.39% | Epoch [626/1000] Iter[450/ 41] Loss: 0.7131 SupLoss: 0.2712 UsupLoss: 0.4368 NLLLoss: 0.0299 Acc@1: 99.842%

| Validation Epoch #626 Loss: 0.6161 NLLLoss: 0.6161 Acc@1: 83.64%

| Best Test Acc: Acc@1: 86.39% | Epoch [627/1000] Iter[450/ 41] Loss: 0.7429 SupLoss: 0.3000 UsupLoss: 0.4377 NLLLoss: 0.0300 Acc@1: 99.838%

| Validation Epoch #627 Loss: 0.5023 NLLLoss: 0.5023 Acc@1: 86.26%

| Best Test Acc: Acc@1: 86.39% | Epoch [628/1000] Iter[450/ 41] Loss: 0.6867 SupLoss: 0.2661 UsupLoss: 0.4156 NLLLoss: 0.0305 Acc@1: 99.898%

| Validation Epoch #628 Loss: 0.5015 NLLLoss: 0.5015 Acc@1: 85.94%

| Best Test Acc: Acc@1: 86.39% | Epoch [629/1000] Iter[450/ 41] Loss: 0.7548 SupLoss: 0.3157 UsupLoss: 0.4341 NLLLoss: 0.0302 Acc@1: 99.847%

| Validation Epoch #629 Loss: 0.5347 NLLLoss: 0.5347 Acc@1: 85.18%

| Best Test Acc: Acc@1: 86.39% | Epoch [630/1000] Iter[450/ 41] Loss: 0.7495 SupLoss: 0.2710 UsupLoss: 0.4734 NLLLoss: 0.0289 Acc@1: 99.816%

| Validation Epoch #630 Loss: 0.5452 NLLLoss: 0.5452 Acc@1: 84.82%

| Best Test Acc: Acc@1: 86.39% | Epoch [631/1000] Iter[450/ 41] Loss: 0.7316 SupLoss: 0.2822 UsupLoss: 0.4442 NLLLoss: 0.0321 Acc@1: 99.820%

| Validation Epoch #631 Loss: 0.5451 NLLLoss: 0.5451 Acc@1: 84.60%

| Best Test Acc: Acc@1: 86.39% | Epoch [632/1000] Iter[450/ 41] Loss: 0.7188 SupLoss: 0.2793 UsupLoss: 0.4343 NLLLoss: 0.0276 Acc@1: 99.869%

| Validation Epoch #632 Loss: 0.5045 NLLLoss: 0.5045 Acc@1: 85.76%

| Best Test Acc: Acc@1: 86.39% | Epoch [633/1000] Iter[450/ 41] Loss: 0.7417 SupLoss: 0.2837 UsupLoss: 0.4529 NLLLoss: 0.0304 Acc@1: 99.836%

| Validation Epoch #633 Loss: 0.5680 NLLLoss: 0.5680 Acc@1: 84.46%

| Best Test Acc: Acc@1: 86.39% | Epoch [634/1000] Iter[450/ 41] Loss: 0.7653 SupLoss: 0.3111 UsupLoss: 0.4490 NLLLoss: 0.0294 Acc@1: 99.827%

| Validation Epoch #634 Loss: 0.5946 NLLLoss: 0.5946 Acc@1: 83.36%

| Best Test Acc: Acc@1: 86.39% | Epoch [635/1000] Iter[450/ 41] Loss: 0.7278 SupLoss: 0.2851 UsupLoss: 0.4376 NLLLoss: 0.0308 Acc@1: 99.858%

| Validation Epoch #635 Loss: 0.5515 NLLLoss: 0.5515 Acc@1: 85.12%

| Best Test Acc: Acc@1: 86.39% | Epoch [636/1000] Iter[450/ 41] Loss: 0.7277 SupLoss: 0.2792 UsupLoss: 0.4432 NLLLoss: 0.0319 Acc@1: 99.811%

| Validation Epoch #636 Loss: 0.5623 NLLLoss: 0.5623 Acc@1: 84.82%

| Best Test Acc: Acc@1: 86.39% | Epoch [637/1000] Iter[450/ 41] Loss: 0.7625 SupLoss: 0.2884 UsupLoss: 0.4689 NLLLoss: 0.0328 Acc@1: 99.842%

| Validation Epoch #637 Loss: 0.5447 NLLLoss: 0.5447 Acc@1: 84.92%

| Best Test Acc: Acc@1: 86.39% | Epoch [638/1000] Iter[450/ 41] Loss: 0.7446 SupLoss: 0.2944 UsupLoss: 0.4451 NLLLoss: 0.0312 Acc@1: 99.831%

| Validation Epoch #638 Loss: 0.5186 NLLLoss: 0.5186 Acc@1: 84.74%

| Best Test Acc: Acc@1: 86.39% | Epoch [639/1000] Iter[450/ 41] Loss: 0.7308 SupLoss: 0.2747 UsupLoss: 0.4510 NLLLoss: 0.0313 Acc@1: 99.851%

| Validation Epoch #639 Loss: 0.6605 NLLLoss: 0.6605 Acc@1: 82.64%

| Best Test Acc: Acc@1: 86.39% | Epoch [640/1000] Iter[450/ 41] Loss: 0.7415 SupLoss: 0.2861 UsupLoss: 0.4501 NLLLoss: 0.0312 Acc@1: 99.798%

| Validation Epoch #640 Loss: 0.5256 NLLLoss: 0.5256 Acc@1: 85.48%

| Best Test Acc: Acc@1: 86.39% | Epoch [641/1000] Iter[450/ 41] Loss: 0.7183 SupLoss: 0.2585 UsupLoss: 0.4546 NLLLoss: 0.0316 Acc@1: 99.809%

| Validation Epoch #641 Loss: 0.4894 NLLLoss: 0.4894 Acc@1: 85.72%

| Best Test Acc: Acc@1: 86.39% | Epoch [642/1000] Iter[450/ 41] Loss: 0.7247 SupLoss: 0.2636 UsupLoss: 0.4558 NLLLoss: 0.0299 Acc@1: 99.838%

| Validation Epoch #642 Loss: 0.4843 NLLLoss: 0.4843 Acc@1: 86.04%

| Best Test Acc: Acc@1: 86.39% | Epoch [643/1000] Iter[450/ 41] Loss: 0.7253 SupLoss: 0.2731 UsupLoss: 0.4469 NLLLoss: 0.0300 Acc@1: 99.873%

| Validation Epoch #643 Loss: 0.5298 NLLLoss: 0.5298 Acc@1: 85.58%

| Best Test Acc: Acc@1: 86.39% | Epoch [644/1000] Iter[450/ 41] Loss: 0.7422 SupLoss: 0.2723 UsupLoss: 0.4647 NLLLoss: 0.0318 Acc@1: 99.840%

| Validation Epoch #644 Loss: 0.5821 NLLLoss: 0.5821 Acc@1: 84.94%

| Best Test Acc: Acc@1: 86.39% | Epoch [645/1000] Iter[450/ 41] Loss: 0.7205 SupLoss: 0.2628 UsupLoss: 0.4526 NLLLoss: 0.0286 Acc@1: 99.867%

| Validation Epoch #645 Loss: 0.5228 NLLLoss: 0.5228 Acc@1: 85.22%

| Best Test Acc: Acc@1: 86.39% | Epoch [646/1000] Iter[450/ 41] Loss: 0.6848 SupLoss: 0.2400 UsupLoss: 0.4397 NLLLoss: 0.0300 Acc@1: 99.827%

| Validation Epoch #646 Loss: 0.5550 NLLLoss: 0.5550 Acc@1: 85.64%

| Best Test Acc: Acc@1: 86.39% | Epoch [647/1000] Iter[450/ 41] Loss: 0.7141 SupLoss: 0.2477 UsupLoss: 0.4613 NLLLoss: 0.0294 Acc@1: 99.882%

| Validation Epoch #647 Loss: 0.5419 NLLLoss: 0.5419 Acc@1: 85.06%

| Best Test Acc: Acc@1: 86.39% | Epoch [648/1000] Iter[450/ 41] Loss: 0.7191 SupLoss: 0.2849 UsupLoss: 0.4291 NLLLoss: 0.0297 Acc@1: 99.849%

| Validation Epoch #648 Loss: 0.5514 NLLLoss: 0.5514 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.39% | Epoch [649/1000] Iter[450/ 41] Loss: 0.7343 SupLoss: 0.2925 UsupLoss: 0.4368 NLLLoss: 0.0305 Acc@1: 99.864%

| Validation Epoch #649 Loss: 0.4881 NLLLoss: 0.4881 Acc@1: 86.50%

| Best Test Acc: Acc@1: 86.39% | Epoch [650/1000] Iter[450/ 41] Loss: 0.7613 SupLoss: 0.2896 UsupLoss: 0.4666 NLLLoss: 0.0286 Acc@1: 99.838%

| Validation Epoch #650 Loss: 0.5303 NLLLoss: 0.5303 Acc@1: 85.84%

| Best Test Acc: Acc@1: 86.39% | Epoch [651/1000] Iter[450/ 41] Loss: 0.7529 SupLoss: 0.2985 UsupLoss: 0.4492 NLLLoss: 0.0300 Acc@1: 99.844%

| Validation Epoch #651 Loss: 0.5662 NLLLoss: 0.5662 Acc@1: 85.00%

| Best Test Acc: Acc@1: 86.39% | Epoch [652/1000] Iter[450/ 41] Loss: 0.7414 SupLoss: 0.2912 UsupLoss: 0.4450 NLLLoss: 0.0311 Acc@1: 99.864%

| Validation Epoch #652 Loss: 0.5299 NLLLoss: 0.5299 Acc@1: 85.14%

| Best Test Acc: Acc@1: 86.39% | Epoch [653/1000] Iter[450/ 41] Loss: 0.7175 SupLoss: 0.2529 UsupLoss: 0.4593 NLLLoss: 0.0282 Acc@1: 99.867%

| Validation Epoch #653 Loss: 0.5139 NLLLoss: 0.5139 Acc@1: 85.98%

| Best Test Acc: Acc@1: 86.39% | Epoch [654/1000] Iter[450/ 41] Loss: 0.6719 SupLoss: 0.2546 UsupLoss: 0.4120 NLLLoss: 0.0371 Acc@1: 99.847%

| Validation Epoch #654 Loss: 0.5276 NLLLoss: 0.5276 Acc@1: 85.52%

| Best Test Acc: Acc@1: 86.39% | Epoch [655/1000] Iter[450/ 41] Loss: 0.6908 SupLoss: 0.2659 UsupLoss: 0.4197 NLLLoss: 0.0310 Acc@1: 99.827%

| Validation Epoch #655 Loss: 0.5344 NLLLoss: 0.5344 Acc@1: 85.06%

| Best Test Acc: Acc@1: 86.39% | Epoch [656/1000] Iter[450/ 41] Loss: 0.7551 SupLoss: 0.3409 UsupLoss: 0.4091 NLLLoss: 0.0331 Acc@1: 99.820%

| Validation Epoch #656 Loss: 0.5495 NLLLoss: 0.5495 Acc@1: 84.94%

| Best Test Acc: Acc@1: 86.39% | Epoch [657/1000] Iter[450/ 41] Loss: 0.7250 SupLoss: 0.2984 UsupLoss: 0.4214 NLLLoss: 0.0317 Acc@1: 99.853%

| Validation Epoch #657 Loss: 0.5113 NLLLoss: 0.5113 Acc@1: 85.54%

| Best Test Acc: Acc@1: 86.39% | Epoch [658/1000] Iter[450/ 41] Loss: 0.7545 SupLoss: 0.3013 UsupLoss: 0.4479 NLLLoss: 0.0307 Acc@1: 99.864%

| Validation Epoch #658 Loss: 0.5297 NLLLoss: 0.5297 Acc@1: 85.44%

| Best Test Acc: Acc@1: 86.39% | Epoch [659/1000] Iter[450/ 41] Loss: 0.7628 SupLoss: 0.3165 UsupLoss: 0.4411 NLLLoss: 0.0297 Acc@1: 99.793%

| Validation Epoch #659 Loss: 0.5003 NLLLoss: 0.5003 Acc@1: 85.58%

| Best Test Acc: Acc@1: 86.39% | Epoch [660/1000] Iter[450/ 41] Loss: 0.7937 SupLoss: 0.3199 UsupLoss: 0.4686 NLLLoss: 0.0301 Acc@1: 99.809%

| Validation Epoch #660 Loss: 0.5388 NLLLoss: 0.5388 Acc@1: 85.38%

| Best Test Acc: Acc@1: 86.39% | Epoch [661/1000] Iter[450/ 41] Loss: 0.7254 SupLoss: 0.2410 UsupLoss: 0.4791 NLLLoss: 0.0291 Acc@1: 99.767%

| Validation Epoch #661 Loss: 0.5388 NLLLoss: 0.5388 Acc@1: 84.70%

| Best Test Acc: Acc@1: 86.39% | Epoch [662/1000] Iter[450/ 41] Loss: 0.7083 SupLoss: 0.2645 UsupLoss: 0.4386 NLLLoss: 0.0308 Acc@1: 99.858%

| Validation Epoch #662 Loss: 0.5113 NLLLoss: 0.5113 Acc@1: 85.54%

| Best Test Acc: Acc@1: 86.39% | Epoch [663/1000] Iter[450/ 41] Loss: 0.7404 SupLoss: 0.2830 UsupLoss: 0.4522 NLLLoss: 0.0288 Acc@1: 99.818%

| Validation Epoch #663 Loss: 0.5480 NLLLoss: 0.5480 Acc@1: 84.52%

| Best Test Acc: Acc@1: 86.39% | Epoch [664/1000] Iter[450/ 41] Loss: 0.7708 SupLoss: 0.3003 UsupLoss: 0.4653 NLLLoss: 0.0297 Acc@1: 99.802%

| Validation Epoch #664 Loss: 0.5316 NLLLoss: 0.5316 Acc@1: 85.46%

| Best Test Acc: Acc@1: 86.39% | Epoch [665/1000] Iter[450/ 41] Loss: 0.7480 SupLoss: 0.2923 UsupLoss: 0.4505 NLLLoss: 0.0330 Acc@1: 99.789%

| Validation Epoch #665 Loss: 0.5422 NLLLoss: 0.5422 Acc@1: 85.54%

| Best Test Acc: Acc@1: 86.39% | Epoch [666/1000] Iter[450/ 41] Loss: 0.7347 SupLoss: 0.2922 UsupLoss: 0.4372 NLLLoss: 0.0326 Acc@1: 99.807%

| Validation Epoch #666 Loss: 0.6106 NLLLoss: 0.6106 Acc@1: 84.24%

| Best Test Acc: Acc@1: 86.39% | Epoch [667/1000] Iter[450/ 41] Loss: 0.6965 SupLoss: 0.2635 UsupLoss: 0.4278 NLLLoss: 0.0322 Acc@1: 99.858%

| Validation Epoch #667 Loss: 0.5435 NLLLoss: 0.5435 Acc@1: 85.70%

| Best Test Acc: Acc@1: 86.39% | Epoch [668/1000] Iter[450/ 41] Loss: 0.7951 SupLoss: 0.3410 UsupLoss: 0.4489 NLLLoss: 0.0321 Acc@1: 99.842%

| Validation Epoch #668 Loss: 0.5520 NLLLoss: 0.5520 Acc@1: 85.12%

| Best Test Acc: Acc@1: 86.39% | Epoch [669/1000] Iter[450/ 41] Loss: 0.7371 SupLoss: 0.2985 UsupLoss: 0.4333 NLLLoss: 0.0317 Acc@1: 99.842%

| Validation Epoch #669 Loss: 0.5838 NLLLoss: 0.5838 Acc@1: 84.58%

| Best Test Acc: Acc@1: 86.39% | Epoch [670/1000] Iter[450/ 41] Loss: 0.7398 SupLoss: 0.2716 UsupLoss: 0.4629 NLLLoss: 0.0318 Acc@1: 99.822%

| Validation Epoch #670 Loss: 0.5658 NLLLoss: 0.5658 Acc@1: 84.36%

| Best Test Acc: Acc@1: 86.39% | Epoch [671/1000] Iter[450/ 41] Loss: 0.7224 SupLoss: 0.2543 UsupLoss: 0.4629 NLLLoss: 0.0296 Acc@1: 99.793%

| Validation Epoch #671 Loss: 0.5592 NLLLoss: 0.5592 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.39% | Epoch [672/1000] Iter[450/ 41] Loss: 0.7146 SupLoss: 0.2656 UsupLoss: 0.4437 NLLLoss: 0.0318 Acc@1: 99.796%

| Validation Epoch #672 Loss: 0.5676 NLLLoss: 0.5676 Acc@1: 84.40%

| Best Test Acc: Acc@1: 86.39% | Epoch [673/1000] Iter[450/ 41] Loss: 0.7399 SupLoss: 0.2798 UsupLoss: 0.4548 NLLLoss: 0.0346 Acc@1: 99.751%

| Validation Epoch #673 Loss: 0.6300 NLLLoss: 0.6300 Acc@1: 83.02%

| Best Test Acc: Acc@1: 86.39% | Epoch [674/1000] Iter[450/ 41] Loss: 0.7791 SupLoss: 0.3009 UsupLoss: 0.4729 NLLLoss: 0.0291 Acc@1: 99.831%

| Validation Epoch #674 Loss: 0.5094 NLLLoss: 0.5094 Acc@1: 85.76%

| Best Test Acc: Acc@1: 86.39% | Epoch [675/1000] Iter[450/ 41] Loss: 0.7455 SupLoss: 0.2748 UsupLoss: 0.4654 NLLLoss: 0.0289 Acc@1: 99.840%

| Validation Epoch #675 Loss: 0.5694 NLLLoss: 0.5694 Acc@1: 84.52%

| Best Test Acc: Acc@1: 86.39% | Epoch [676/1000] Iter[450/ 41] Loss: 0.7497 SupLoss: 0.2863 UsupLoss: 0.4582 NLLLoss: 0.0297 Acc@1: 99.869%

| Validation Epoch #676 Loss: 0.5459 NLLLoss: 0.5459 Acc@1: 85.02%

| Best Test Acc: Acc@1: 86.39% | Epoch [677/1000] Iter[450/ 41] Loss: 0.7553 SupLoss: 0.3183 UsupLoss: 0.4319 NLLLoss: 0.0344 Acc@1: 99.844%

| Validation Epoch #677 Loss: 0.4920 NLLLoss: 0.4920 Acc@1: 86.00%

| Best Test Acc: Acc@1: 86.39% | Epoch [678/1000] Iter[450/ 41] Loss: 0.7244 SupLoss: 0.2749 UsupLoss: 0.4444 NLLLoss: 0.0317 Acc@1: 99.822%

| Validation Epoch #678 Loss: 0.5580 NLLLoss: 0.5580 Acc@1: 85.40%

| Best Test Acc: Acc@1: 86.39% | Epoch [679/1000] Iter[450/ 41] Loss: 0.7563 SupLoss: 0.2839 UsupLoss: 0.4670 NLLLoss: 0.0313 Acc@1: 99.840%

| Validation Epoch #679 Loss: 0.6034 NLLLoss: 0.6034 Acc@1: 84.28%

| Best Test Acc: Acc@1: 86.39% | Epoch [680/1000] Iter[450/ 41] Loss: 0.7590 SupLoss: 0.2835 UsupLoss: 0.4701 NLLLoss: 0.0292 Acc@1: 99.780%

| Validation Epoch #680 Loss: 0.5246 NLLLoss: 0.5246 Acc@1: 85.72%

| Best Test Acc: Acc@1: 86.39% | Epoch [681/1000] Iter[450/ 41] Loss: 0.7377 SupLoss: 0.3007 UsupLoss: 0.4318 NLLLoss: 0.0403 Acc@1: 99.862%

| Validation Epoch #681 Loss: 0.5296 NLLLoss: 0.5296 Acc@1: 84.94%

| Best Test Acc: Acc@1: 86.39% | Epoch [682/1000] Iter[450/ 41] Loss: 0.7773 SupLoss: 0.2910 UsupLoss: 0.4810 NLLLoss: 0.0300 Acc@1: 99.818%

| Validation Epoch #682 Loss: 0.6063 NLLLoss: 0.6063 Acc@1: 83.34%

| Best Test Acc: Acc@1: 86.39% | Epoch [683/1000] Iter[450/ 41] Loss: 0.7423 SupLoss: 0.2846 UsupLoss: 0.4523 NLLLoss: 0.0350 Acc@1: 99.820%

| Validation Epoch #683 Loss: 0.5093 NLLLoss: 0.5093 Acc@1: 85.86%

| Best Test Acc: Acc@1: 86.39% | Epoch [684/1000] Iter[450/ 41] Loss: 0.7758 SupLoss: 0.2827 UsupLoss: 0.4877 NLLLoss: 0.0291 Acc@1: 99.796%

| Validation Epoch #684 Loss: 0.5475 NLLLoss: 0.5475 Acc@1: 84.18%

| Best Test Acc: Acc@1: 86.39% | Epoch [685/1000] Iter[450/ 41] Loss: 0.7353 SupLoss: 0.2888 UsupLoss: 0.4411 NLLLoss: 0.0302 Acc@1: 99.811%

| Validation Epoch #685 Loss: 0.5200 NLLLoss: 0.5200 Acc@1: 85.68%

| Best Test Acc: Acc@1: 86.39% | Epoch [686/1000] Iter[450/ 41] Loss: 0.7751 SupLoss: 0.3101 UsupLoss: 0.4597 NLLLoss: 0.0294 Acc@1: 99.782%

| Validation Epoch #686 Loss: 0.4731 NLLLoss: 0.4731 Acc@1: 86.62%

| Best Test Acc: Acc@1: 86.39% | Epoch [687/1000] Iter[450/ 41] Loss: 0.7611 SupLoss: 0.3001 UsupLoss: 0.4558 NLLLoss: 0.0291 Acc@1: 99.844%

| Validation Epoch #687 Loss: 0.5441 NLLLoss: 0.5441 Acc@1: 85.20%

| Best Test Acc: Acc@1: 86.39% | Epoch [688/1000] Iter[450/ 41] Loss: 0.7031 SupLoss: 0.2479 UsupLoss: 0.4500 NLLLoss: 0.0318 Acc@1: 99.844%

| Validation Epoch #688 Loss: 0.5611 NLLLoss: 0.5611 Acc@1: 85.58%

| Best Test Acc: Acc@1: 86.39% | Epoch [689/1000] Iter[450/ 41] Loss: 0.7525 SupLoss: 0.3046 UsupLoss: 0.4426 NLLLoss: 0.0298 Acc@1: 99.816%

| Validation Epoch #689 Loss: 0.5256 NLLLoss: 0.5256 Acc@1: 85.70%

| Best Test Acc: Acc@1: 86.39% | Epoch [690/1000] Iter[450/ 41] Loss: 0.7293 SupLoss: 0.2815 UsupLoss: 0.4426 NLLLoss: 0.0309 Acc@1: 99.849%

| Validation Epoch #690 Loss: 0.5452 NLLLoss: 0.5452 Acc@1: 84.74%

| Best Test Acc: Acc@1: 86.39% | Epoch [691/1000] Iter[450/ 41] Loss: 0.7208 SupLoss: 0.2619 UsupLoss: 0.4538 NLLLoss: 0.0298 Acc@1: 99.831%

| Validation Epoch #691 Loss: 0.5542 NLLLoss: 0.5542 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.39% | Epoch [692/1000] Iter[450/ 41] Loss: 0.7272 SupLoss: 0.2700 UsupLoss: 0.4520 NLLLoss: 0.0280 Acc@1: 99.869%

| Validation Epoch #692 Loss: 0.4865 NLLLoss: 0.4865 Acc@1: 86.54%

| Best Test Acc: Acc@1: 86.39% | Epoch [693/1000] Iter[450/ 41] Loss: 0.7439 SupLoss: 0.2826 UsupLoss: 0.4559 NLLLoss: 0.0311 Acc@1: 99.793%

| Validation Epoch #693 Loss: 0.5354 NLLLoss: 0.5354 Acc@1: 85.46%

| Best Test Acc: Acc@1: 86.39% | Epoch [694/1000] Iter[450/ 41] Loss: 0.7309 SupLoss: 0.2737 UsupLoss: 0.4520 NLLLoss: 0.0293 Acc@1: 99.842%

| Validation Epoch #694 Loss: 0.5013 NLLLoss: 0.5013 Acc@1: 85.80%

| Best Test Acc: Acc@1: 86.39% | Epoch [695/1000] Iter[450/ 41] Loss: 0.7253 SupLoss: 0.2711 UsupLoss: 0.4490 NLLLoss: 0.0305 Acc@1: 99.782%

| Validation Epoch #695 Loss: 0.5092 NLLLoss: 0.5092 Acc@1: 86.08%

| Best Test Acc: Acc@1: 86.39% | Epoch [696/1000] Iter[450/ 41] Loss: 0.7353 SupLoss: 0.2913 UsupLoss: 0.4387 NLLLoss: 0.0311 Acc@1: 99.811%

| Validation Epoch #696 Loss: 0.5311 NLLLoss: 0.5311 Acc@1: 85.02%

| Best Test Acc: Acc@1: 86.39% | Epoch [697/1000] Iter[450/ 41] Loss: 0.7435 SupLoss: 0.2985 UsupLoss: 0.4398 NLLLoss: 0.0294 Acc@1: 99.862%

| Validation Epoch #697 Loss: 0.5655 NLLLoss: 0.5655 Acc@1: 84.30%

| Best Test Acc: Acc@1: 86.39% | Epoch [698/1000] Iter[450/ 41] Loss: 0.7886 SupLoss: 0.3115 UsupLoss: 0.4720 NLLLoss: 0.0316 Acc@1: 99.802%

| Validation Epoch #698 Loss: 0.5694 NLLLoss: 0.5694 Acc@1: 84.68%

| Best Test Acc: Acc@1: 86.39% | Epoch [699/1000] Iter[450/ 41] Loss: 0.7043 SupLoss: 0.2683 UsupLoss: 0.4308 NLLLoss: 0.0296 Acc@1: 99.860%

| Validation Epoch #699 Loss: 0.5421 NLLLoss: 0.5421 Acc@1: 85.60%

| Best Test Acc: Acc@1: 86.39% | Epoch [700/1000] Iter[450/ 41] Loss: 0.7373 SupLoss: 0.2737 UsupLoss: 0.4585 NLLLoss: 0.0285 Acc@1: 99.887%

| Validation Epoch #700 Loss: 0.5173 NLLLoss: 0.5173 Acc@1: 86.10%

| Best Test Acc: Acc@1: 86.39% | Epoch [701/1000] Iter[450/ 41] Loss: 0.7411 SupLoss: 0.2680 UsupLoss: 0.4677 NLLLoss: 0.0279 Acc@1: 99.847%

| Validation Epoch #701 Loss: 0.4924 NLLLoss: 0.4924 Acc@1: 86.26%

| Best Test Acc: Acc@1: 86.39% | Epoch [702/1000] Iter[450/ 41] Loss: 0.7631 SupLoss: 0.3046 UsupLoss: 0.4533 NLLLoss: 0.0312 Acc@1: 99.782%

| Validation Epoch #702 Loss: 0.4813 NLLLoss: 0.4813 Acc@1: 86.68%

| Best Test Acc: Acc@1: 86.39% | Epoch [703/1000] Iter[450/ 41] Loss: 0.7776 SupLoss: 0.3114 UsupLoss: 0.4608 NLLLoss: 0.0307 Acc@1: 99.818%

| Validation Epoch #703 Loss: 0.5144 NLLLoss: 0.5144 Acc@1: 85.52%

| Best Test Acc: Acc@1: 86.39% | Epoch [704/1000] Iter[450/ 41] Loss: 0.7276 SupLoss: 0.2967 UsupLoss: 0.4256 NLLLoss: 0.0319 Acc@1: 99.853%

| Validation Epoch #704 Loss: 0.5436 NLLLoss: 0.5436 Acc@1: 84.74%

| Best Test Acc: Acc@1: 86.39% | Epoch [705/1000] Iter[450/ 41] Loss: 0.7365 SupLoss: 0.2775 UsupLoss: 0.4537 NLLLoss: 0.0311 Acc@1: 99.782%

| Validation Epoch #705 Loss: 0.4960 NLLLoss: 0.4960 Acc@1: 85.86%

| Best Test Acc: Acc@1: 86.39% | Epoch [706/1000] Iter[450/ 41] Loss: 0.7085 SupLoss: 0.2630 UsupLoss: 0.4402 NLLLoss: 0.0298 Acc@1: 99.800%

| Validation Epoch #706 Loss: 0.4968 NLLLoss: 0.4968 Acc@1: 85.82%

| Best Test Acc: Acc@1: 86.39% | Epoch [707/1000] Iter[450/ 41] Loss: 0.7548 SupLoss: 0.2685 UsupLoss: 0.4810 NLLLoss: 0.0301 Acc@1: 99.811%

| Validation Epoch #707 Loss: 0.4824 NLLLoss: 0.4824 Acc@1: 86.40%

| Best Test Acc: Acc@1: 86.39% | Epoch [708/1000] Iter[450/ 41] Loss: 0.7567 SupLoss: 0.2711 UsupLoss: 0.4803 NLLLoss: 0.0291 Acc@1: 99.822%

| Validation Epoch #708 Loss: 0.5150 NLLLoss: 0.5150 Acc@1: 85.76%

| Best Test Acc: Acc@1: 86.39% | Epoch [709/1000] Iter[450/ 41] Loss: 0.7278 SupLoss: 0.2660 UsupLoss: 0.4565 NLLLoss: 0.0331 Acc@1: 99.793%

| Validation Epoch #709 Loss: 0.6072 NLLLoss: 0.6072 Acc@1: 84.16%

| Best Test Acc: Acc@1: 86.39% | Epoch [710/1000] Iter[450/ 41] Loss: 0.7852 SupLoss: 0.3027 UsupLoss: 0.4771 NLLLoss: 0.0297 Acc@1: 99.789%

| Validation Epoch #710 Loss: 0.5423 NLLLoss: 0.5423 Acc@1: 84.96%

| Best Test Acc: Acc@1: 86.39% | Epoch [711/1000] Iter[450/ 41] Loss: 0.7200 SupLoss: 0.2472 UsupLoss: 0.4675 NLLLoss: 0.0298 Acc@1: 99.820%

| Validation Epoch #711 Loss: 0.5399 NLLLoss: 0.5399 Acc@1: 85.64%

| Best Test Acc: Acc@1: 86.39% | Epoch [712/1000] Iter[450/ 41] Loss: 0.7755 SupLoss: 0.3174 UsupLoss: 0.4529 NLLLoss: 0.0305 Acc@1: 99.836%

| Validation Epoch #712 Loss: 0.4697 NLLLoss: 0.4697 Acc@1: 86.60%

| Best Test Acc: Acc@1: 86.39% | Epoch [713/1000] Iter[450/ 41] Loss: 0.7675 SupLoss: 0.3162 UsupLoss: 0.4461 NLLLoss: 0.0302 Acc@1: 99.838%

| Validation Epoch #713 Loss: 0.4823 NLLLoss: 0.4823 Acc@1: 86.34%

| Best Test Acc: Acc@1: 86.39% | Epoch [714/1000] Iter[450/ 41] Loss: 0.7278 SupLoss: 0.2640 UsupLoss: 0.4587 NLLLoss: 0.0312 Acc@1: 99.796%

| Validation Epoch #714 Loss: 0.4698 NLLLoss: 0.4698 Acc@1: 87.04%

| Best Test Acc: Epoch #714 Loss: 0.4819 NLLLoss: 0.4819 Acc@1: 86.66%

| Best Test Acc: Acc@1: 86.66% | Epoch [715/1000] Iter[450/ 41] Loss: 0.7902 SupLoss: 0.3160 UsupLoss: 0.4690 NLLLoss: 0.0316 Acc@1: 99.822%

| Validation Epoch #715 Loss: 0.4776 NLLLoss: 0.4776 Acc@1: 86.36%

| Best Test Acc: Acc@1: 86.66% | Epoch [716/1000] Iter[450/ 41] Loss: 0.7305 SupLoss: 0.2817 UsupLoss: 0.4437 NLLLoss: 0.0315 Acc@1: 99.818%

| Validation Epoch #716 Loss: 0.5215 NLLLoss: 0.5215 Acc@1: 85.58%

| Best Test Acc: Acc@1: 86.66% | Epoch [717/1000] Iter[450/ 41] Loss: 0.6865 SupLoss: 0.2479 UsupLoss: 0.4334 NLLLoss: 0.0311 Acc@1: 99.831%

| Validation Epoch #717 Loss: 0.5299 NLLLoss: 0.5299 Acc@1: 85.68%

| Best Test Acc: Acc@1: 86.66% | Epoch [718/1000] Iter[450/ 41] Loss: 0.7515 SupLoss: 0.3199 UsupLoss: 0.4264 NLLLoss: 0.0307 Acc@1: 99.833%

| Validation Epoch #718 Loss: 0.5547 NLLLoss: 0.5547 Acc@1: 85.04%

| Best Test Acc: Acc@1: 86.66% | Epoch [719/1000] Iter[450/ 41] Loss: 0.7528 SupLoss: 0.2882 UsupLoss: 0.4594 NLLLoss: 0.0291 Acc@1: 99.847%

| Validation Epoch #719 Loss: 0.5432 NLLLoss: 0.5432 Acc@1: 85.20%

| Best Test Acc: Acc@1: 86.66% | Epoch [720/1000] Iter[450/ 41] Loss: 0.7506 SupLoss: 0.2772 UsupLoss: 0.4681 NLLLoss: 0.0289 Acc@1: 99.818%

| Validation Epoch #720 Loss: 0.4933 NLLLoss: 0.4933 Acc@1: 86.14%

| Best Test Acc: Acc@1: 86.66% | Epoch [721/1000] Iter[450/ 41] Loss: 0.7370 SupLoss: 0.2619 UsupLoss: 0.4700 NLLLoss: 0.0303 Acc@1: 99.840%

| Validation Epoch #721 Loss: 0.5332 NLLLoss: 0.5332 Acc@1: 85.54%

| Best Test Acc: Acc@1: 86.66% | Epoch [722/1000] Iter[450/ 41] Loss: 0.6828 SupLoss: 0.2421 UsupLoss: 0.4356 NLLLoss: 0.0301 Acc@1: 99.842%

| Validation Epoch #722 Loss: 0.5366 NLLLoss: 0.5366 Acc@1: 85.28%

| Best Test Acc: Acc@1: 86.66% | Epoch [723/1000] Iter[450/ 41] Loss: 0.7144 SupLoss: 0.2621 UsupLoss: 0.4471 NLLLoss: 0.0291 Acc@1: 99.827%

| Validation Epoch #723 Loss: 0.5173 NLLLoss: 0.5173 Acc@1: 85.26%

| Best Test Acc: Acc@1: 86.66% | Epoch [724/1000] Iter[450/ 41] Loss: 0.7634 SupLoss: 0.3181 UsupLoss: 0.4401 NLLLoss: 0.0291 Acc@1: 99.873%

| Validation Epoch #724 Loss: 0.5347 NLLLoss: 0.5347 Acc@1: 85.10%

| Best Test Acc: Acc@1: 86.66% | Epoch [725/1000] Iter[450/ 41] Loss: 0.7436 SupLoss: 0.2829 UsupLoss: 0.4555 NLLLoss: 0.0293 Acc@1: 99.798%

| Validation Epoch #725 Loss: 0.5489 NLLLoss: 0.5489 Acc@1: 85.32%

| Best Test Acc: Acc@1: 86.66% | Epoch [726/1000] Iter[450/ 41] Loss: 0.7026 SupLoss: 0.2695 UsupLoss: 0.4280 NLLLoss: 0.0306 Acc@1: 99.818%

| Validation Epoch #726 Loss: 0.5703 NLLLoss: 0.5703 Acc@1: 84.60%

| Best Test Acc: Acc@1: 86.66% | Epoch [727/1000] Iter[450/ 41] Loss: 0.7468 SupLoss: 0.3001 UsupLoss: 0.4415 NLLLoss: 0.0307 Acc@1: 99.849%

| Validation Epoch #727 Loss: 0.5102 NLLLoss: 0.5102 Acc@1: 86.26%

| Best Test Acc: Acc@1: 86.66% | Epoch [728/1000] Iter[450/ 41] Loss: 0.7462 SupLoss: 0.2862 UsupLoss: 0.4548 NLLLoss: 0.0304 Acc@1: 99.809%

| Validation Epoch #728 Loss: 0.5039 NLLLoss: 0.5039 Acc@1: 86.22%

| Best Test Acc: Acc@1: 86.66% | Epoch [729/1000] Iter[450/ 41] Loss: 0.7728 SupLoss: 0.2869 UsupLoss: 0.4806 NLLLoss: 0.0278 Acc@1: 99.831%

| Validation Epoch #729 Loss: 0.5459 NLLLoss: 0.5459 Acc@1: 85.62%

| Best Test Acc: Acc@1: 86.66% | Epoch [730/1000] Iter[450/ 41] Loss: 0.7015 SupLoss: 0.2555 UsupLoss: 0.4408 NLLLoss: 0.0311 Acc@1: 99.796%

| Validation Epoch #730 Loss: 0.5137 NLLLoss: 0.5137 Acc@1: 85.74%

| Best Test Acc: Acc@1: 86.66% | Epoch [731/1000] Iter[450/ 41] Loss: 0.8029 SupLoss: 0.3202 UsupLoss: 0.4776 NLLLoss: 0.0288 Acc@1: 99.822%

| Validation Epoch #731 Loss: 0.5207 NLLLoss: 0.5207 Acc@1: 85.76%

| Best Test Acc: Acc@1: 86.66% | Epoch [732/1000] Iter[450/ 41] Loss: 0.7050 SupLoss: 0.2661 UsupLoss: 0.4337 NLLLoss: 0.0401 Acc@1: 99.847%

| Validation Epoch #732 Loss: 0.5492 NLLLoss: 0.5492 Acc@1: 85.44%

| Best Test Acc: Acc@1: 86.66% | Epoch [733/1000] Iter[450/ 41] Loss: 0.7257 SupLoss: 0.3050 UsupLoss: 0.4155 NLLLoss: 0.0302 Acc@1: 99.851%

| Validation Epoch #733 Loss: 0.5222 NLLLoss: 0.5222 Acc@1: 85.32%

| Best Test Acc: Acc@1: 86.66% | Epoch [734/1000] Iter[450/ 41] Loss: 0.7431 SupLoss: 0.2806 UsupLoss: 0.4573 NLLLoss: 0.0298 Acc@1: 99.816%

| Validation Epoch #734 Loss: 0.4915 NLLLoss: 0.4915 Acc@1: 86.46%

| Best Test Acc: Acc@1: 86.66% | Epoch [735/1000] Iter[450/ 41] Loss: 0.7389 SupLoss: 0.2958 UsupLoss: 0.4381 NLLLoss: 0.0295 Acc@1: 99.871%

| Validation Epoch #735 Loss: 0.5182 NLLLoss: 0.5182 Acc@1: 86.62%

| Best Test Acc: Acc@1: 86.66% | Epoch [736/1000] Iter[450/ 41] Loss: 0.7262 SupLoss: 0.2703 UsupLoss: 0.4508 NLLLoss: 0.0284 Acc@1: 99.820%

| Validation Epoch #736 Loss: 0.5394 NLLLoss: 0.5394 Acc@1: 85.44%

| Best Test Acc: Acc@1: 86.66% | Epoch [737/1000] Iter[450/ 41] Loss: 0.7088 SupLoss: 0.2618 UsupLoss: 0.4419 NLLLoss: 0.0285 Acc@1: 99.856%

| Validation Epoch #737 Loss: 0.5707 NLLLoss: 0.5707 Acc@1: 85.22%

| Best Test Acc: Acc@1: 86.66% | Epoch [738/1000] Iter[450/ 41] Loss: 0.7487 SupLoss: 0.2956 UsupLoss: 0.4480 NLLLoss: 0.0324 Acc@1: 99.820%

| Validation Epoch #738 Loss: 0.4839 NLLLoss: 0.4839 Acc@1: 86.62%

| Best Test Acc: Acc@1: 86.66% | Epoch [739/1000] Iter[450/ 41] Loss: 0.7163 SupLoss: 0.2837 UsupLoss: 0.4276 NLLLoss: 0.0311 Acc@1: 99.827%

| Validation Epoch #739 Loss: 0.5509 NLLLoss: 0.5509 Acc@1: 84.46%

| Best Test Acc: Acc@1: 86.66% | Epoch [740/1000] Iter[450/ 41] Loss: 0.6934 SupLoss: 0.2593 UsupLoss: 0.4290 NLLLoss: 0.0320 Acc@1: 99.871%

| Validation Epoch #740 Loss: 0.4957 NLLLoss: 0.4957 Acc@1: 86.68%

| Best Test Acc: Acc@1: 86.66% | Epoch [741/1000] Iter[450/ 41] Loss: 0.7145 SupLoss: 0.2493 UsupLoss: 0.4600 NLLLoss: 0.0289 Acc@1: 99.829%

| Validation Epoch #741 Loss: 0.5348 NLLLoss: 0.5348 Acc@1: 85.66%

| Best Test Acc: Acc@1: 86.66% | Epoch [742/1000] Iter[450/ 41] Loss: 0.7664 SupLoss: 0.2943 UsupLoss: 0.4669 NLLLoss: 0.0295 Acc@1: 99.813%

| Validation Epoch #742 Loss: 0.5320 NLLLoss: 0.5320 Acc@1: 85.34%

| Best Test Acc: Acc@1: 86.66% | Epoch [743/1000] Iter[450/ 41] Loss: 0.7256 SupLoss: 0.2834 UsupLoss: 0.4370 NLLLoss: 0.0303 Acc@1: 99.836%

| Validation Epoch #743 Loss: 0.5597 NLLLoss: 0.5597 Acc@1: 84.42%

| Best Test Acc: Acc@1: 86.66% | Epoch [744/1000] Iter[450/ 41] Loss: 0.7173 SupLoss: 0.2570 UsupLoss: 0.4551 NLLLoss: 0.0275 Acc@1: 99.860%

| Validation Epoch #744 Loss: 0.5196 NLLLoss: 0.5196 Acc@1: 85.80%

| Best Test Acc: Acc@1: 86.66% | Epoch [745/1000] Iter[450/ 41] Loss: 0.7160 SupLoss: 0.2680 UsupLoss: 0.4429 NLLLoss: 0.0300 Acc@1: 99.853%

| Validation Epoch #745 Loss: 0.5020 NLLLoss: 0.5020 Acc@1: 86.46%

| Best Test Acc: Acc@1: 86.66% | Epoch [746/1000] Iter[450/ 41] Loss: 0.7598 SupLoss: 0.2972 UsupLoss: 0.4574 NLLLoss: 0.0316 Acc@1: 99.780%

| Validation Epoch #746 Loss: 0.5635 NLLLoss: 0.5635 Acc@1: 83.78%

| Best Test Acc: Acc@1: 86.66% | Epoch [747/1000] Iter[450/ 41] Loss: 0.7086 SupLoss: 0.2524 UsupLoss: 0.4510 NLLLoss: 0.0295 Acc@1: 99.816%

| Validation Epoch #747 Loss: 0.4757 NLLLoss: 0.4757 Acc@1: 86.18%

| Best Test Acc: Acc@1: 86.66% | Epoch [748/1000] Iter[450/ 41] Loss: 0.6983 SupLoss: 0.2629 UsupLoss: 0.4301 NLLLoss: 0.0309 Acc@1: 99.849%

| Validation Epoch #748 Loss: 0.5118 NLLLoss: 0.5118 Acc@1: 85.80%

| Best Test Acc: Acc@1: 86.66% | Epoch [749/1000] Iter[450/ 41] Loss: 0.6927 SupLoss: 0.2683 UsupLoss: 0.4193 NLLLoss: 0.0346 Acc@1: 99.827%

| Validation Epoch #749 Loss: 0.5546 NLLLoss: 0.5546 Acc@1: 85.08%

| Best Test Acc: Acc@1: 86.66% | Epoch [750/1000] Iter[450/ 41] Loss: 0.7267 SupLoss: 0.2683 UsupLoss: 0.4535 NLLLoss: 0.0218 Acc@1: 99.907%

| Validation Epoch #750 Loss: 0.5484 NLLLoss: 0.5484 Acc@1: 85.80%

| Best Test Acc: Acc@1: 86.66% | Epoch [751/1000] Iter[450/ 41] Loss: 0.7305 SupLoss: 0.2637 UsupLoss: 0.4624 NLLLoss: 0.0153 Acc@1: 99.971%

| Validation Epoch #751 Loss: 0.5169 NLLLoss: 0.5169 Acc@1: 86.80%

| Best Test Acc: Acc@1: 86.66% | Epoch [752/1000] Iter[450/ 41] Loss: 0.7326 SupLoss: 0.2671 UsupLoss: 0.4613 NLLLoss: 0.0146 Acc@1: 99.973%

| Validation Epoch #752 Loss: 0.4966 NLLLoss: 0.4966 Acc@1: 86.98%

| Best Test Acc: Acc@1: 86.66% | Epoch [753/1000] Iter[450/ 41] Loss: 0.7165 SupLoss: 0.2505 UsupLoss: 0.4619 NLLLoss: 0.0150 Acc@1: 99.978%

| Validation Epoch #753 Loss: 0.4659 NLLLoss: 0.4659 Acc@1: 87.20%

| Best Test Acc: Epoch #753 Loss: 0.4505 NLLLoss: 0.4505 Acc@1: 87.94%

| Best Test Acc: Acc@1: 87.94% | Epoch [754/1000] Iter[450/ 41] Loss: 0.7148 SupLoss: 0.2547 UsupLoss: 0.4562 NLLLoss: 0.0149 Acc@1: 99.969%

| Validation Epoch #754 Loss: 0.4511 NLLLoss: 0.4511 Acc@1: 88.30%

| Best Test Acc: Epoch #754 Loss: 0.4414 NLLLoss: 0.4414 Acc@1: 88.32%

| Best Test Acc: Acc@1: 88.32% | Epoch [755/1000] Iter[450/ 41] Loss: 0.7247 SupLoss: 0.2759 UsupLoss: 0.4449 NLLLoss: 0.0147 Acc@1: 99.996%

| Validation Epoch #755 Loss: 0.4690 NLLLoss: 0.4690 Acc@1: 88.08%

| Best Test Acc: Acc@1: 88.32% | Epoch [756/1000] Iter[450/ 41] Loss: 0.7170 SupLoss: 0.2705 UsupLoss: 0.4428 NLLLoss: 0.0154 Acc@1: 99.982%

| Validation Epoch #756 Loss: 0.4687 NLLLoss: 0.4687 Acc@1: 87.98%

| Best Test Acc: Acc@1: 88.32% | Epoch [757/1000] Iter[450/ 41] Loss: 0.6928 SupLoss: 0.2529 UsupLoss: 0.4362 NLLLoss: 0.0163 Acc@1: 99.976%

| Validation Epoch #757 Loss: 0.4684 NLLLoss: 0.4684 Acc@1: 87.66%

| Best Test Acc: Acc@1: 88.32% | Epoch [758/1000] Iter[450/ 41] Loss: 0.6941 SupLoss: 0.2576 UsupLoss: 0.4328 NLLLoss: 0.0150 Acc@1: 99.984%

| Validation Epoch #758 Loss: 0.4582 NLLLoss: 0.4582 Acc@1: 87.74%

| Best Test Acc: Acc@1: 88.32% | Epoch [759/1000] Iter[450/ 41] Loss: 0.7070 SupLoss: 0.2736 UsupLoss: 0.4297 NLLLoss: 0.0151 Acc@1: 99.980%

| Validation Epoch #759 Loss: 0.4221 NLLLoss: 0.4221 Acc@1: 88.72%

| Best Test Acc: Epoch #759 Loss: 0.4110 NLLLoss: 0.4110 Acc@1: 89.03%

| Best Test Acc: Acc@1: 89.03% | Epoch [760/1000] Iter[450/ 41] Loss: 0.6981 SupLoss: 0.2505 UsupLoss: 0.4439 NLLLoss: 0.0146 Acc@1: 99.982%

| Validation Epoch #760 Loss: 0.4646 NLLLoss: 0.4646 Acc@1: 87.82%

| Best Test Acc: Acc@1: 89.03% | Epoch [761/1000] Iter[450/ 41] Loss: 0.7314 SupLoss: 0.2765 UsupLoss: 0.4513 NLLLoss: 0.0136 Acc@1: 99.993%

| Validation Epoch #761 Loss: 0.4463 NLLLoss: 0.4463 Acc@1: 88.40%

| Best Test Acc: Acc@1: 89.03% | Epoch [762/1000] Iter[450/ 41] Loss: 0.7190 SupLoss: 0.2724 UsupLoss: 0.4430 NLLLoss: 0.0149 Acc@1: 99.984%

| Validation Epoch #762 Loss: 0.4245 NLLLoss: 0.4245 Acc@1: 88.56%

| Best Test Acc: Acc@1: 89.03% | Epoch [763/1000] Iter[450/ 41] Loss: 0.6935 SupLoss: 0.2473 UsupLoss: 0.4428 NLLLoss: 0.0143 Acc@1: 99.987%

| Validation Epoch #763 Loss: 0.4266 NLLLoss: 0.4266 Acc@1: 88.88%

| Best Test Acc: Epoch #763 Loss: 0.4202 NLLLoss: 0.4202 Acc@1: 89.06%

| Best Test Acc: Acc@1: 89.06% | Epoch [764/1000] Iter[450/ 41] Loss: 0.6977 SupLoss: 0.2561 UsupLoss: 0.4381 NLLLoss: 0.0141 Acc@1: 99.996%

| Validation Epoch #764 Loss: 0.4185 NLLLoss: 0.4185 Acc@1: 88.46%

| Best Test Acc: Acc@1: 89.06% | Epoch [765/1000] Iter[450/ 41] Loss: 0.6700 SupLoss: 0.2275 UsupLoss: 0.4390 NLLLoss: 0.0141 Acc@1: 99.996%

| Validation Epoch #765 Loss: 0.4249 NLLLoss: 0.4249 Acc@1: 88.60%

| Best Test Acc: Acc@1: 89.06% | Epoch [766/1000] Iter[450/ 41] Loss: 0.6779 SupLoss: 0.2333 UsupLoss: 0.4411 NLLLoss: 0.0152 Acc@1: 99.993%

| Validation Epoch #766 Loss: 0.4322 NLLLoss: 0.4322 Acc@1: 88.36%

| Best Test Acc: Acc@1: 89.06% | Epoch [767/1000] Iter[450/ 41] Loss: 0.6669 SupLoss: 0.2143 UsupLoss: 0.4491 NLLLoss: 0.0149 Acc@1: 99.973%

| Validation Epoch #767 Loss: 0.4484 NLLLoss: 0.4484 Acc@1: 87.96%

| Best Test Acc: Acc@1: 89.06% | Epoch [768/1000] Iter[450/ 41] Loss: 0.7152 SupLoss: 0.2857 UsupLoss: 0.4260 NLLLoss: 0.0140 Acc@1: 99.991%

| Validation Epoch #768 Loss: 0.4480 NLLLoss: 0.4480 Acc@1: 88.36%

| Best Test Acc: Acc@1: 89.06% | Epoch [769/1000] Iter[450/ 41] Loss: 0.6930 SupLoss: 0.2572 UsupLoss: 0.4324 NLLLoss: 0.0139 Acc@1: 100.000%

| Validation Epoch #769 Loss: 0.4486 NLLLoss: 0.4486 Acc@1: 88.60%

| Best Test Acc: Acc@1: 89.06% | Epoch [770/1000] Iter[450/ 41] Loss: 0.6588 SupLoss: 0.2416 UsupLoss: 0.4139 NLLLoss: 0.0148 Acc@1: 99.987%

| Validation Epoch #770 Loss: 0.4092 NLLLoss: 0.4092 Acc@1: 88.72%

| Best Test Acc: Acc@1: 89.06% | Epoch [771/1000] Iter[450/ 41] Loss: 0.7029 SupLoss: 0.2559 UsupLoss: 0.4436 NLLLoss: 0.0141 Acc@1: 99.991%

| Validation Epoch #771 Loss: 0.4364 NLLLoss: 0.4364 Acc@1: 88.48%

| Best Test Acc: Acc@1: 89.06% | Epoch [772/1000] Iter[450/ 41] Loss: 0.7081 SupLoss: 0.2637 UsupLoss: 0.4410 NLLLoss: 0.0142 Acc@1: 99.987%

| Validation Epoch #772 Loss: 0.4309 NLLLoss: 0.4309 Acc@1: 88.08%

| Best Test Acc: Acc@1: 89.06% | Epoch [773/1000] Iter[450/ 41] Loss: 0.7045 SupLoss: 0.2647 UsupLoss: 0.4365 NLLLoss: 0.0151 Acc@1: 99.996%

| Validation Epoch #773 Loss: 0.4469 NLLLoss: 0.4469 Acc@1: 88.28%

| Best Test Acc: Acc@1: 89.06% | Epoch [774/1000] Iter[450/ 41] Loss: 0.6711 SupLoss: 0.2443 UsupLoss: 0.4235 NLLLoss: 0.0149 Acc@1: 99.993%

| Validation Epoch #774 Loss: 0.4491 NLLLoss: 0.4491 Acc@1: 88.34%

| Best Test Acc: Acc@1: 89.06% | Epoch [775/1000] Iter[450/ 41] Loss: 0.7179 SupLoss: 0.2857 UsupLoss: 0.4290 NLLLoss: 0.0160 Acc@1: 99.989%

| Validation Epoch #775 Loss: 0.4617 NLLLoss: 0.4617 Acc@1: 87.92%

| Best Test Acc: Acc@1: 89.06% | Epoch [776/1000] Iter[450/ 41] Loss: 0.6952 SupLoss: 0.2494 UsupLoss: 0.4426 NLLLoss: 0.0155 Acc@1: 99.984%

| Validation Epoch #776 Loss: 0.4202 NLLLoss: 0.4202 Acc@1: 88.74%

| Best Test Acc: Acc@1: 89.06% | Epoch [777/1000] Iter[450/ 41] Loss: 0.7193 SupLoss: 0.2550 UsupLoss: 0.4611 NLLLoss: 0.0151 Acc@1: 99.998%

| Validation Epoch #777 Loss: 0.4855 NLLLoss: 0.4855 Acc@1: 87.98%

| Best Test Acc: Acc@1: 89.06% | Epoch [778/1000] Iter[450/ 41] Loss: 0.6917 SupLoss: 0.2525 UsupLoss: 0.4359 NLLLoss: 0.0157 Acc@1: 99.989%

| Validation Epoch #778 Loss: 0.4095 NLLLoss: 0.4095 Acc@1: 89.10%

| Best Test Acc: Epoch #778 Loss: 0.4037 NLLLoss: 0.4037 Acc@1: 89.12%

| Best Test Acc: Acc@1: 89.12% | Epoch [779/1000] Iter[450/ 41] Loss: 0.6591 SupLoss: 0.2077 UsupLoss: 0.4482 NLLLoss: 0.0149 Acc@1: 99.989%

| Validation Epoch #779 Loss: 0.4278 NLLLoss: 0.4278 Acc@1: 88.46%

| Best Test Acc: Acc@1: 89.12% | Epoch [780/1000] Iter[450/ 41] Loss: 0.7216 SupLoss: 0.2746 UsupLoss: 0.4438 NLLLoss: 0.0147 Acc@1: 99.991%

| Validation Epoch #780 Loss: 0.4288 NLLLoss: 0.4288 Acc@1: 88.72%

| Best Test Acc: Acc@1: 89.12% | Epoch [781/1000] Iter[450/ 41] Loss: 0.7004 SupLoss: 0.2779 UsupLoss: 0.4192 NLLLoss: 0.0149 Acc@1: 99.993%

| Validation Epoch #781 Loss: 0.4589 NLLLoss: 0.4589 Acc@1: 87.74%

| Best Test Acc: Acc@1: 89.12% | Epoch [782/1000] Iter[450/ 41] Loss: 0.6957 SupLoss: 0.2539 UsupLoss: 0.4385 NLLLoss: 0.0146 Acc@1: 99.996%

| Validation Epoch #782 Loss: 0.4443 NLLLoss: 0.4443 Acc@1: 88.28%

| Best Test Acc: Acc@1: 89.12% | Epoch [783/1000] Iter[450/ 41] Loss: 0.6891 SupLoss: 0.2543 UsupLoss: 0.4317 NLLLoss: 0.0155 Acc@1: 99.991%

| Validation Epoch #783 Loss: 0.4185 NLLLoss: 0.4185 Acc@1: 88.60%

| Best Test Acc: Acc@1: 89.12% | Epoch [784/1000] Iter[450/ 41] Loss: 0.6843 SupLoss: 0.2498 UsupLoss: 0.4313 NLLLoss: 0.0152 Acc@1: 99.991%

| Validation Epoch #784 Loss: 0.4083 NLLLoss: 0.4083 Acc@1: 89.34%

| Best Test Acc: Epoch #784 Loss: 0.4049 NLLLoss: 0.4049 Acc@1: 89.49%

| Best Test Acc: Acc@1: 89.49% | Epoch [785/1000] Iter[450/ 41] Loss: 0.6922 SupLoss: 0.2653 UsupLoss: 0.4237 NLLLoss: 0.0159 Acc@1: 99.993%

| Validation Epoch #785 Loss: 0.4282 NLLLoss: 0.4282 Acc@1: 88.66%

| Best Test Acc: Acc@1: 89.49% | Epoch [786/1000] Iter[450/ 41] Loss: 0.7055 SupLoss: 0.2697 UsupLoss: 0.4326 NLLLoss: 0.0151 Acc@1: 99.984%

| Validation Epoch #786 Loss: 0.4007 NLLLoss: 0.4007 Acc@1: 88.94%

| Best Test Acc: Acc@1: 89.49% | Epoch [787/1000] Iter[450/ 41] Loss: 0.6813 SupLoss: 0.2344 UsupLoss: 0.4437 NLLLoss: 0.0157 Acc@1: 99.996%

| Validation Epoch #787 Loss: 0.4213 NLLLoss: 0.4213 Acc@1: 88.70%

| Best Test Acc: Acc@1: 89.49% | Epoch [788/1000] Iter[450/ 41] Loss: 0.6572 SupLoss: 0.2552 UsupLoss: 0.3988 NLLLoss: 0.0158 Acc@1: 99.993%

| Validation Epoch #788 Loss: 0.4114 NLLLoss: 0.4114 Acc@1: 89.10%

| Best Test Acc: Acc@1: 89.49% | Epoch [789/1000] Iter[450/ 41] Loss: 0.7065 SupLoss: 0.2783 UsupLoss: 0.4250 NLLLoss: 0.0153 Acc@1: 99.991%

| Validation Epoch #789 Loss: 0.4433 NLLLoss: 0.4433 Acc@1: 87.88%

| Best Test Acc: Acc@1: 89.49% | Epoch [790/1000] Iter[450/ 41] Loss: 0.6951 SupLoss: 0.2664 UsupLoss: 0.4255 NLLLoss: 0.0156 Acc@1: 99.991%

| Validation Epoch #790 Loss: 0.4241 NLLLoss: 0.4241 Acc@1: 88.54%

| Best Test Acc: Acc@1: 89.49% | Epoch [791/1000] Iter[450/ 41] Loss: 0.6768 SupLoss: 0.2515 UsupLoss: 0.4221 NLLLoss: 0.0147 Acc@1: 99.998%

| Validation Epoch #791 Loss: 0.4246 NLLLoss: 0.4246 Acc@1: 88.68%

| Best Test Acc: Acc@1: 89.49% | Epoch [792/1000] Iter[450/ 41] Loss: 0.6787 SupLoss: 0.2317 UsupLoss: 0.4438 NLLLoss: 0.0150 Acc@1: 99.996%

| Validation Epoch #792 Loss: 0.4074 NLLLoss: 0.4074 Acc@1: 88.66%

| Best Test Acc: Acc@1: 89.49% | Epoch [793/1000] Iter[450/ 41] Loss: 0.6928 SupLoss: 0.2589 UsupLoss: 0.4308 NLLLoss: 0.0151 Acc@1: 99.989%

| Validation Epoch #793 Loss: 0.4103 NLLLoss: 0.4103 Acc@1: 88.78%

| Best Test Acc: Acc@1: 89.49% | Epoch [794/1000] Iter[450/ 41] Loss: 0.6983 SupLoss: 0.2620 UsupLoss: 0.4331 NLLLoss: 0.0146 Acc@1: 100.000%

| Validation Epoch #794 Loss: 0.4318 NLLLoss: 0.4318 Acc@1: 88.22%

| Best Test Acc: Acc@1: 89.49% | Epoch [795/1000] Iter[450/ 41] Loss: 0.6838 SupLoss: 0.2597 UsupLoss: 0.4209 NLLLoss: 0.0164 Acc@1: 99.996%

| Validation Epoch #795 Loss: 0.4311 NLLLoss: 0.4311 Acc@1: 88.60%

| Best Test Acc: Acc@1: 89.49% | Epoch [796/1000] Iter[450/ 41] Loss: 0.6716 SupLoss: 0.2560 UsupLoss: 0.4125 NLLLoss: 0.0162 Acc@1: 99.996%

| Validation Epoch #796 Loss: 0.3987 NLLLoss: 0.3987 Acc@1: 89.20%

| Best Test Acc: Acc@1: 89.49% | Epoch [797/1000] Iter[450/ 41] Loss: 0.6797 SupLoss: 0.2428 UsupLoss: 0.4337 NLLLoss: 0.0168 Acc@1: 99.978%

| Validation Epoch #797 Loss: 0.4596 NLLLoss: 0.4596 Acc@1: 88.26%

| Best Test Acc: Acc@1: 89.49% | Epoch [798/1000] Iter[450/ 41] Loss: 0.6902 SupLoss: 0.2518 UsupLoss: 0.4353 NLLLoss: 0.0160 Acc@1: 99.991%

| Validation Epoch #798 Loss: 0.4255 NLLLoss: 0.4255 Acc@1: 88.56%

| Best Test Acc: Acc@1: 89.49% | Epoch [799/1000] Iter[450/ 41] Loss: 0.6743 SupLoss: 0.2348 UsupLoss: 0.4363 NLLLoss: 0.0155 Acc@1: 99.989%

| Validation Epoch #799 Loss: 0.4244 NLLLoss: 0.4244 Acc@1: 88.90%

| Best Test Acc: Acc@1: 89.49% | Epoch [800/1000] Iter[450/ 41] Loss: 0.7094 SupLoss: 0.2692 UsupLoss: 0.4370 NLLLoss: 0.0165 Acc@1: 99.998%

| Validation Epoch #800 Loss: 0.4261 NLLLoss: 0.4261 Acc@1: 88.96%

| Best Test Acc: Acc@1: 89.49% | Epoch [801/1000] Iter[450/ 41] Loss: 0.6761 SupLoss: 0.2373 UsupLoss: 0.4356 NLLLoss: 0.0146 Acc@1: 99.987%

| Validation Epoch #801 Loss: 0.4240 NLLLoss: 0.4240 Acc@1: 88.76%

| Best Test Acc: Acc@1: 89.49% | Epoch [802/1000] Iter[450/ 41] Loss: 0.6865 SupLoss: 0.2542 UsupLoss: 0.4292 NLLLoss: 0.0159 Acc@1: 99.998%

| Validation Epoch #802 Loss: 0.4143 NLLLoss: 0.4143 Acc@1: 88.76%

| Best Test Acc: Acc@1: 89.49% | Epoch [803/1000] Iter[450/ 41] Loss: 0.7118 SupLoss: 0.2691 UsupLoss: 0.4394 NLLLoss: 0.0149 Acc@1: 99.991%

| Validation Epoch #803 Loss: 0.3861 NLLLoss: 0.3861 Acc@1: 89.38%

| Best Test Acc: Epoch #803 Loss: 0.3825 NLLLoss: 0.3825 Acc@1: 89.57%

| Best Test Acc: Acc@1: 89.57% | Epoch [804/1000] Iter[450/ 41] Loss: 0.6919 SupLoss: 0.2473 UsupLoss: 0.4414 NLLLoss: 0.0170 Acc@1: 99.978%

| Validation Epoch #804 Loss: 0.4659 NLLLoss: 0.4659 Acc@1: 87.72%

| Best Test Acc: Acc@1: 89.57% | Epoch [805/1000] Iter[450/ 41] Loss: 0.6690 SupLoss: 0.2453 UsupLoss: 0.4205 NLLLoss: 0.0151 Acc@1: 99.993%

| Validation Epoch #805 Loss: 0.4197 NLLLoss: 0.4197 Acc@1: 88.90%

| Best Test Acc: Acc@1: 89.57% | Epoch [806/1000] Iter[450/ 41] Loss: 0.6722 SupLoss: 0.2369 UsupLoss: 0.4321 NLLLoss: 0.0154 Acc@1: 99.991%

| Validation Epoch #806 Loss: 0.4170 NLLLoss: 0.4170 Acc@1: 88.22%

| Best Test Acc: Acc@1: 89.57% | Epoch [807/1000] Iter[450/ 41] Loss: 0.6900 SupLoss: 0.2562 UsupLoss: 0.4306 NLLLoss: 0.0159 Acc@1: 99.998%

| Validation Epoch #807 Loss: 0.4347 NLLLoss: 0.4347 Acc@1: 88.36%

| Best Test Acc: Acc@1: 89.57% | Epoch [808/1000] Iter[450/ 41] Loss: 0.6794 SupLoss: 0.2489 UsupLoss: 0.4274 NLLLoss: 0.0154 Acc@1: 99.993%

| Validation Epoch #808 Loss: 0.3854 NLLLoss: 0.3854 Acc@1: 89.16%

| Best Test Acc: Acc@1: 89.57% | Epoch [809/1000] Iter[450/ 41] Loss: 0.6814 SupLoss: 0.2391 UsupLoss: 0.4391 NLLLoss: 0.0149 Acc@1: 99.989%

| Validation Epoch #809 Loss: 0.3968 NLLLoss: 0.3968 Acc@1: 89.10%

| Best Test Acc: Acc@1: 89.57% | Epoch [810/1000] Iter[450/ 41] Loss: 0.7194 SupLoss: 0.2734 UsupLoss: 0.4429 NLLLoss: 0.0151 Acc@1: 99.991%

| Validation Epoch #810 Loss: 0.4359 NLLLoss: 0.4359 Acc@1: 88.24%

| Best Test Acc: Acc@1: 89.57% | Epoch [811/1000] Iter[450/ 41] Loss: 0.7045 SupLoss: 0.2642 UsupLoss: 0.4372 NLLLoss: 0.0153 Acc@1: 99.996%

| Validation Epoch #811 Loss: 0.4132 NLLLoss: 0.4132 Acc@1: 88.54%

| Best Test Acc: Acc@1: 89.57% | Epoch [812/1000] Iter[450/ 41] Loss: 0.6789 SupLoss: 0.2438 UsupLoss: 0.4318 NLLLoss: 0.0159 Acc@1: 99.991%

| Validation Epoch #812 Loss: 0.4031 NLLLoss: 0.4031 Acc@1: 89.02%

| Best Test Acc: Acc@1: 89.57% | Epoch [813/1000] Iter[450/ 41] Loss: 0.6555 SupLoss: 0.2261 UsupLoss: 0.4263 NLLLoss: 0.0159 Acc@1: 99.989%

| Validation Epoch #813 Loss: 0.4743 NLLLoss: 0.4743 Acc@1: 87.74%

| Best Test Acc: Acc@1: 89.57% | Epoch [814/1000] Iter[450/ 41] Loss: 0.6835 SupLoss: 0.2357 UsupLoss: 0.4447 NLLLoss: 0.0148 Acc@1: 99.993%

| Validation Epoch #814 Loss: 0.4215 NLLLoss: 0.4215 Acc@1: 88.42%

| Best Test Acc: Acc@1: 89.57% | Epoch [815/1000] Iter[450/ 41] Loss: 0.6929 SupLoss: 0.2556 UsupLoss: 0.4342 NLLLoss: 0.0165 Acc@1: 99.987%

| Validation Epoch #815 Loss: 0.4301 NLLLoss: 0.4301 Acc@1: 88.88%

| Best Test Acc: Acc@1: 89.57% | Epoch [816/1000] Iter[450/ 41] Loss: 0.7079 SupLoss: 0.2436 UsupLoss: 0.4612 NLLLoss: 0.0154 Acc@1: 99.978%

| Validation Epoch #816 Loss: 0.4333 NLLLoss: 0.4333 Acc@1: 88.42%

| Best Test Acc: Acc@1: 89.57% | Epoch [817/1000] Iter[450/ 41] Loss: 0.7221 SupLoss: 0.2572 UsupLoss: 0.4617 NLLLoss: 0.0155 Acc@1: 99.989%

| Validation Epoch #817 Loss: 0.4348 NLLLoss: 0.4348 Acc@1: 88.40%

| Best Test Acc: Acc@1: 89.57% | Epoch [818/1000] Iter[450/ 41] Loss: 0.7152 SupLoss: 0.2632 UsupLoss: 0.4489 NLLLoss: 0.0163 Acc@1: 99.980%

| Validation Epoch #818 Loss: 0.4199 NLLLoss: 0.4199 Acc@1: 88.56%

| Best Test Acc: Acc@1: 89.57% | Epoch [819/1000] Iter[450/ 41] Loss: 0.7175 SupLoss: 0.2634 UsupLoss: 0.4509 NLLLoss: 0.0172 Acc@1: 99.987%

| Validation Epoch #819 Loss: 0.4226 NLLLoss: 0.4226 Acc@1: 88.66%

| Best Test Acc: Acc@1: 89.57% | Epoch [820/1000] Iter[450/ 41] Loss: 0.7164 SupLoss: 0.2519 UsupLoss: 0.4613 NLLLoss: 0.0160 Acc@1: 99.991%

| Validation Epoch #820 Loss: 0.4600 NLLLoss: 0.4600 Acc@1: 88.24%

| Best Test Acc: Acc@1: 89.57% | Epoch [821/1000] Iter[450/ 41] Loss: 0.7269 SupLoss: 0.2602 UsupLoss: 0.4635 NLLLoss: 0.0154 Acc@1: 99.987%

| Validation Epoch #821 Loss: 0.4285 NLLLoss: 0.4285 Acc@1: 89.24%

| Best Test Acc: Acc@1: 89.57% | Epoch [822/1000] Iter[450/ 41] Loss: 0.7185 SupLoss: 0.2734 UsupLoss: 0.4419 NLLLoss: 0.0171 Acc@1: 99.989%

| Validation Epoch #822 Loss: 0.4112 NLLLoss: 0.4112 Acc@1: 89.18%

| Best Test Acc: Acc@1: 89.57% | Epoch [823/1000] Iter[450/ 41] Loss: 0.6825 SupLoss: 0.2225 UsupLoss: 0.4568 NLLLoss: 0.0172 Acc@1: 99.987%

| Validation Epoch #823 Loss: 0.4124 NLLLoss: 0.4124 Acc@1: 89.30%

| Best Test Acc: Acc@1: 89.57% | Epoch [824/1000] Iter[450/ 41] Loss: 0.7265 SupLoss: 0.2726 UsupLoss: 0.4507 NLLLoss: 0.0175 Acc@1: 99.971%

| Validation Epoch #824 Loss: 0.4333 NLLLoss: 0.4333 Acc@1: 88.22%

| Best Test Acc: Acc@1: 89.57% | Epoch [825/1000] Iter[450/ 41] Loss: 0.6887 SupLoss: 0.2272 UsupLoss: 0.4584 NLLLoss: 0.0164 Acc@1: 99.993%

| Validation Epoch #825 Loss: 0.4396 NLLLoss: 0.4396 Acc@1: 88.44%

| Best Test Acc: Acc@1: 89.57% | Epoch [826/1000] Iter[450/ 41] Loss: 0.7312 SupLoss: 0.2686 UsupLoss: 0.4593 NLLLoss: 0.0169 Acc@1: 99.989%

| Validation Epoch #826 Loss: 0.4383 NLLLoss: 0.4383 Acc@1: 88.34%

| Best Test Acc: Acc@1: 89.57% | Epoch [827/1000] Iter[450/ 41] Loss: 0.7325 SupLoss: 0.2631 UsupLoss: 0.4663 NLLLoss: 0.0170 Acc@1: 99.971%

| Validation Epoch #827 Loss: 0.4373 NLLLoss: 0.4373 Acc@1: 88.76%

| Best Test Acc: Acc@1: 89.57% | Epoch [828/1000] Iter[450/ 41] Loss: 0.7380 SupLoss: 0.2638 UsupLoss: 0.4710 NLLLoss: 0.0157 Acc@1: 99.987%

| Validation Epoch #828 Loss: 0.3994 NLLLoss: 0.3994 Acc@1: 89.14%

| Best Test Acc: Acc@1: 89.57% | Epoch [829/1000] Iter[450/ 41] Loss: 0.7232 SupLoss: 0.2525 UsupLoss: 0.4674 NLLLoss: 0.0157 Acc@1: 99.991%

| Validation Epoch #829 Loss: 0.4134 NLLLoss: 0.4134 Acc@1: 88.70%

| Best Test Acc: Acc@1: 89.57% | Epoch [830/1000] Iter[450/ 41] Loss: 0.7150 SupLoss: 0.2525 UsupLoss: 0.4593 NLLLoss: 0.0174 Acc@1: 99.980%

| Validation Epoch #830 Loss: 0.4475 NLLLoss: 0.4475 Acc@1: 88.58%

| Best Test Acc: Acc@1: 89.57% | Epoch [831/1000] Iter[450/ 41] Loss: 0.6992 SupLoss: 0.2432 UsupLoss: 0.4529 NLLLoss: 0.0161 Acc@1: 99.993%

| Validation Epoch #831 Loss: 0.4285 NLLLoss: 0.4285 Acc@1: 88.52%

| Best Test Acc: Acc@1: 89.57% | Epoch [832/1000] Iter[450/ 41] Loss: 0.7358 SupLoss: 0.2614 UsupLoss: 0.4712 NLLLoss: 0.0167 Acc@1: 99.980%

| Validation Epoch #832 Loss: 0.4015 NLLLoss: 0.4015 Acc@1: 89.00%

| Best Test Acc: Acc@1: 89.57% | Epoch [833/1000] Iter[450/ 41] Loss: 0.7076 SupLoss: 0.2481 UsupLoss: 0.4563 NLLLoss: 0.0168 Acc@1: 99.984%

| Validation Epoch #833 Loss: 0.4278 NLLLoss: 0.4278 Acc@1: 88.22%

| Best Test Acc: Acc@1: 89.57% | Epoch [834/1000] Iter[450/ 41] Loss: 0.6995 SupLoss: 0.2469 UsupLoss: 0.4494 NLLLoss: 0.0176 Acc@1: 99.987%

| Validation Epoch #834 Loss: 0.4134 NLLLoss: 0.4134 Acc@1: 89.10%

| Best Test Acc: Acc@1: 89.57% | Epoch [835/1000] Iter[450/ 41] Loss: 0.7204 SupLoss: 0.2653 UsupLoss: 0.4520 NLLLoss: 0.0165 Acc@1: 99.971%

| Validation Epoch #835 Loss: 0.4798 NLLLoss: 0.4798 Acc@1: 87.66%

| Best Test Acc: Acc@1: 89.57% | Epoch [836/1000] Iter[450/ 41] Loss: 0.7486 SupLoss: 0.2710 UsupLoss: 0.4744 NLLLoss: 0.0164 Acc@1: 99.989%

| Validation Epoch #836 Loss: 0.4254 NLLLoss: 0.4254 Acc@1: 88.40%

| Best Test Acc: Acc@1: 89.57% | Epoch [837/1000] Iter[450/ 41] Loss: 0.7185 SupLoss: 0.2512 UsupLoss: 0.4642 NLLLoss: 0.0167 Acc@1: 99.984%

| Validation Epoch #837 Loss: 0.4463 NLLLoss: 0.4463 Acc@1: 88.44%

| Best Test Acc: Acc@1: 89.57% | Epoch [838/1000] Iter[450/ 41] Loss: 0.6993 SupLoss: 0.2373 UsupLoss: 0.4589 NLLLoss: 0.0182 Acc@1: 99.991%

| Validation Epoch #838 Loss: 0.4262 NLLLoss: 0.4262 Acc@1: 88.42%

| Best Test Acc: Acc@1: 89.57% | Epoch [839/1000] Iter[450/ 41] Loss: 0.7211 SupLoss: 0.2736 UsupLoss: 0.4442 NLLLoss: 0.0163 Acc@1: 99.987%

| Validation Epoch #839 Loss: 0.4295 NLLLoss: 0.4295 Acc@1: 88.26%

| Best Test Acc: Acc@1: 89.57% | Epoch [840/1000] Iter[450/ 41] Loss: 0.7043 SupLoss: 0.2418 UsupLoss: 0.4594 NLLLoss: 0.0177 Acc@1: 99.982%

| Validation Epoch #840 Loss: 0.4490 NLLLoss: 0.4490 Acc@1: 88.16%

| Best Test Acc: Acc@1: 89.57% | Epoch [841/1000] Iter[450/ 41] Loss: 0.7106 SupLoss: 0.2451 UsupLoss: 0.4623 NLLLoss: 0.0189 Acc@1: 99.980%

| Validation Epoch #841 Loss: 0.4475 NLLLoss: 0.4475 Acc@1: 88.46%

| Best Test Acc: Acc@1: 89.57% | Epoch [842/1000] Iter[450/ 41] Loss: 0.7319 SupLoss: 0.2531 UsupLoss: 0.4756 NLLLoss: 0.0163 Acc@1: 99.984%

| Validation Epoch #842 Loss: 0.4221 NLLLoss: 0.4221 Acc@1: 88.70%

| Best Test Acc: Acc@1: 89.57% | Epoch [843/1000] Iter[450/ 41] Loss: 0.7442 SupLoss: 0.2847 UsupLoss: 0.4563 NLLLoss: 0.0169 Acc@1: 99.991%

| Validation Epoch #843 Loss: 0.4327 NLLLoss: 0.4327 Acc@1: 88.84%

| Best Test Acc: Acc@1: 89.57% | Epoch [844/1000] Iter[450/ 41] Loss: 0.7707 SupLoss: 0.2857 UsupLoss: 0.4818 NLLLoss: 0.0165 Acc@1: 99.982%

| Validation Epoch #844 Loss: 0.4169 NLLLoss: 0.4169 Acc@1: 88.62%

| Best Test Acc: Acc@1: 89.57% | Epoch [845/1000] Iter[450/ 41] Loss: 0.7019 SupLoss: 0.2344 UsupLoss: 0.4643 NLLLoss: 0.0168 Acc@1: 99.987%

| Validation Epoch #845 Loss: 0.4338 NLLLoss: 0.4338 Acc@1: 88.48%

| Best Test Acc: Acc@1: 89.57% | Epoch [846/1000] Iter[450/ 41] Loss: 0.7064 SupLoss: 0.2358 UsupLoss: 0.4674 NLLLoss: 0.0175 Acc@1: 99.976%

| Validation Epoch #846 Loss: 0.4442 NLLLoss: 0.4442 Acc@1: 88.98%

| Best Test Acc: Acc@1: 89.57% | Epoch [847/1000] Iter[450/ 41] Loss: 0.7272 SupLoss: 0.2659 UsupLoss: 0.4581 NLLLoss: 0.0163 Acc@1: 99.973%

| Validation Epoch #847 Loss: 0.4051 NLLLoss: 0.4051 Acc@1: 88.98%

| Best Test Acc: Acc@1: 89.57% | Epoch [848/1000] Iter[450/ 41] Loss: 0.7097 SupLoss: 0.2167 UsupLoss: 0.4898 NLLLoss: 0.0162 Acc@1: 99.982%

| Validation Epoch #848 Loss: 0.4181 NLLLoss: 0.4181 Acc@1: 89.16%

| Best Test Acc: Acc@1: 89.57% | Epoch [849/1000] Iter[450/ 41] Loss: 0.7148 SupLoss: 0.2521 UsupLoss: 0.4595 NLLLoss: 0.0173 Acc@1: 99.987%

| Validation Epoch #849 Loss: 0.4229 NLLLoss: 0.4229 Acc@1: 88.48%

| Best Test Acc: Acc@1: 89.57% | Epoch [850/1000] Iter[450/ 41] Loss: 0.6777 SupLoss: 0.2276 UsupLoss: 0.4469 NLLLoss: 0.0161 Acc@1: 99.987%

| Validation Epoch #850 Loss: 0.4448 NLLLoss: 0.4448 Acc@1: 88.32%

| Best Test Acc: Acc@1: 89.57% | Epoch [851/1000] Iter[450/ 41] Loss: 0.6988 SupLoss: 0.2413 UsupLoss: 0.4543 NLLLoss: 0.0175 Acc@1: 99.980%

| Validation Epoch #851 Loss: 0.3809 NLLLoss: 0.3809 Acc@1: 89.32%

| Best Test Acc: Acc@1: 89.57% | Epoch [852/1000] Iter[450/ 41] Loss: 0.6880 SupLoss: 0.2453 UsupLoss: 0.4396 NLLLoss: 0.0188 Acc@1: 99.969%

| Validation Epoch #852 Loss: 0.4487 NLLLoss: 0.4487 Acc@1: 88.00%

| Best Test Acc: Acc@1: 89.57% | Epoch [853/1000] Iter[450/ 41] Loss: 0.7357 SupLoss: 0.2472 UsupLoss: 0.4853 NLLLoss: 0.0166 Acc@1: 99.971%

| Validation Epoch #853 Loss: 0.4262 NLLLoss: 0.4262 Acc@1: 88.48%

| Best Test Acc: Acc@1: 89.57% | Epoch [854/1000] Iter[450/ 41] Loss: 0.7238 SupLoss: 0.2539 UsupLoss: 0.4666 NLLLoss: 0.0180 Acc@1: 99.989%

| Validation Epoch #854 Loss: 0.4293 NLLLoss: 0.4293 Acc@1: 88.68%

| Best Test Acc: Acc@1: 89.57% | Epoch [855/1000] Iter[450/ 41] Loss: 0.7609 SupLoss: 0.2933 UsupLoss: 0.4644 NLLLoss: 0.0178 Acc@1: 99.978%

| Validation Epoch #855 Loss: 0.4032 NLLLoss: 0.4032 Acc@1: 89.12%

| Best Test Acc: Acc@1: 89.57% | Epoch [856/1000] Iter[450/ 41] Loss: 0.7282 SupLoss: 0.2590 UsupLoss: 0.4661 NLLLoss: 0.0181 Acc@1: 99.989%

| Validation Epoch #856 Loss: 0.4397 NLLLoss: 0.4397 Acc@1: 88.54%

| Best Test Acc: Acc@1: 89.57% | Epoch [857/1000] Iter[450/ 41] Loss: 0.7133 SupLoss: 0.2335 UsupLoss: 0.4765 NLLLoss: 0.0169 Acc@1: 99.978%

| Validation Epoch #857 Loss: 0.4262 NLLLoss: 0.4262 Acc@1: 88.76%

| Best Test Acc: Acc@1: 89.57% | Epoch [858/1000] Iter[450/ 41] Loss: 0.7360 SupLoss: 0.2551 UsupLoss: 0.4777 NLLLoss: 0.0168 Acc@1: 99.982%

| Validation Epoch #858 Loss: 0.4140 NLLLoss: 0.4140 Acc@1: 89.12%

| Best Test Acc: Acc@1: 89.57% | Epoch [859/1000] Iter[450/ 41] Loss: 0.7079 SupLoss: 0.2288 UsupLoss: 0.4758 NLLLoss: 0.0174 Acc@1: 99.982%

| Validation Epoch #859 Loss: 0.4227 NLLLoss: 0.4227 Acc@1: 88.68%

| Best Test Acc: Acc@1: 89.57% | Epoch [860/1000] Iter[450/ 41] Loss: 0.7408 SupLoss: 0.2577 UsupLoss: 0.4798 NLLLoss: 0.0163 Acc@1: 99.980%

| Validation Epoch #860 Loss: 0.4321 NLLLoss: 0.4321 Acc@1: 88.32%

| Best Test Acc: Acc@1: 89.57% | Epoch [861/1000] Iter[450/ 41] Loss: 0.7690 SupLoss: 0.2809 UsupLoss: 0.4849 NLLLoss: 0.0161 Acc@1: 99.993%

| Validation Epoch #861 Loss: 0.4151 NLLLoss: 0.4151 Acc@1: 88.74%

| Best Test Acc: Acc@1: 89.57% | Epoch [862/1000] Iter[450/ 41] Loss: 0.7504 SupLoss: 0.2506 UsupLoss: 0.4966 NLLLoss: 0.0171 Acc@1: 99.982%

| Validation Epoch #862 Loss: 0.4686 NLLLoss: 0.4686 Acc@1: 87.82%

| Best Test Acc: Acc@1: 89.57% | Epoch [863/1000] Iter[450/ 41] Loss: 0.6899 SupLoss: 0.2293 UsupLoss: 0.4573 NLLLoss: 0.0174 Acc@1: 99.987%

| Validation Epoch #863 Loss: 0.4381 NLLLoss: 0.4381 Acc@1: 88.46%

| Best Test Acc: Acc@1: 89.57% | Epoch [864/1000] Iter[450/ 41] Loss: 0.7368 SupLoss: 0.2596 UsupLoss: 0.4740 NLLLoss: 0.0175 Acc@1: 99.984%

| Validation Epoch #864 Loss: 0.4377 NLLLoss: 0.4377 Acc@1: 88.54%

| Best Test Acc: Acc@1: 89.57% | Epoch [865/1000] Iter[450/ 41] Loss: 0.7790 SupLoss: 0.2847 UsupLoss: 0.4911 NLLLoss: 0.0174 Acc@1: 99.976%

| Validation Epoch #865 Loss: 0.4338 NLLLoss: 0.4338 Acc@1: 88.38%

| Best Test Acc: Acc@1: 89.57% | Epoch [866/1000] Iter[450/ 41] Loss: 0.7300 SupLoss: 0.2528 UsupLoss: 0.4740 NLLLoss: 0.0173 Acc@1: 99.980%

| Validation Epoch #866 Loss: 0.4534 NLLLoss: 0.4534 Acc@1: 88.04%

| Best Test Acc: Acc@1: 89.57% | Epoch [867/1000] Iter[450/ 41] Loss: 0.7490 SupLoss: 0.2639 UsupLoss: 0.4819 NLLLoss: 0.0167 Acc@1: 99.976%

| Validation Epoch #867 Loss: 0.4424 NLLLoss: 0.4424 Acc@1: 88.10%

| Best Test Acc: Acc@1: 89.57% | Epoch [868/1000] Iter[450/ 41] Loss: 0.7117 SupLoss: 0.2425 UsupLoss: 0.4659 NLLLoss: 0.0177 Acc@1: 99.964%

| Validation Epoch #868 Loss: 0.4464 NLLLoss: 0.4464 Acc@1: 88.44%

| Best Test Acc: Acc@1: 89.57% | Epoch [869/1000] Iter[450/ 41] Loss: 0.7266 SupLoss: 0.2393 UsupLoss: 0.4841 NLLLoss: 0.0167 Acc@1: 99.984%

| Validation Epoch #869 Loss: 0.4275 NLLLoss: 0.4275 Acc@1: 88.30%

| Best Test Acc: Acc@1: 89.57% | Epoch [870/1000] Iter[450/ 41] Loss: 0.7141 SupLoss: 0.2410 UsupLoss: 0.4699 NLLLoss: 0.0165 Acc@1: 99.976%

| Validation Epoch #870 Loss: 0.4265 NLLLoss: 0.4265 Acc@1: 88.70%

| Best Test Acc: Acc@1: 89.57% | Epoch [871/1000] Iter[450/ 41] Loss: 0.7419 SupLoss: 0.2662 UsupLoss: 0.4724 NLLLoss: 0.0178 Acc@1: 99.973%

| Validation Epoch #871 Loss: 0.4282 NLLLoss: 0.4282 Acc@1: 88.78%

| Best Test Acc: Acc@1: 89.57% | Epoch [872/1000] Iter[450/ 41] Loss: 0.7364 SupLoss: 0.2642 UsupLoss: 0.4690 NLLLoss: 0.0170 Acc@1: 99.967%

| Validation Epoch #872 Loss: 0.4274 NLLLoss: 0.4274 Acc@1: 88.70%

| Best Test Acc: Acc@1: 89.57% | Epoch [873/1000] Iter[450/ 41] Loss: 0.7646 SupLoss: 0.2787 UsupLoss: 0.4827 NLLLoss: 0.0165 Acc@1: 99.991%

| Validation Epoch #873 Loss: 0.4495 NLLLoss: 0.4495 Acc@1: 88.54%

| Best Test Acc: Acc@1: 89.57% | Epoch [874/1000] Iter[450/ 41] Loss: 0.7534 SupLoss: 0.2535 UsupLoss: 0.4967 NLLLoss: 0.0177 Acc@1: 99.953%

| Validation Epoch #874 Loss: 0.4394 NLLLoss: 0.4394 Acc@1: 88.44%

| Best Test Acc: Acc@1: 89.57% | Epoch [875/1000] Iter[450/ 41] Loss: 0.7730 SupLoss: 0.2829 UsupLoss: 0.4869 NLLLoss: 0.0163 Acc@1: 99.976%

| Validation Epoch #875 Loss: 0.4392 NLLLoss: 0.4392 Acc@1: 88.62%

| Best Test Acc: Acc@1: 89.57% | Epoch [876/1000] Iter[450/ 41] Loss: 0.7301 SupLoss: 0.2412 UsupLoss: 0.4859 NLLLoss: 0.0156 Acc@1: 99.984%

| Validation Epoch #876 Loss: 0.4226 NLLLoss: 0.4226 Acc@1: 88.72%

| Best Test Acc: Acc@1: 89.57% | Epoch [877/1000] Iter[450/ 41] Loss: 0.7194 SupLoss: 0.2249 UsupLoss: 0.4915 NLLLoss: 0.0142 Acc@1: 99.993%

| Validation Epoch #877 Loss: 0.3829 NLLLoss: 0.3829 Acc@1: 90.04%

| Best Test Acc: Epoch #877 Loss: 0.3820 NLLLoss: 0.3820 Acc@1: 89.96%

| Best Test Acc: Acc@1: 89.96% | Epoch [878/1000] Iter[450/ 41] Loss: 0.7143 SupLoss: 0.2458 UsupLoss: 0.4656 NLLLoss: 0.0154 Acc@1: 99.984%

| Validation Epoch #878 Loss: 0.4161 NLLLoss: 0.4161 Acc@1: 89.02%

| Best Test Acc: Acc@1: 89.96% | Epoch [879/1000] Iter[450/ 41] Loss: 0.7589 SupLoss: 0.2655 UsupLoss: 0.4904 NLLLoss: 0.0142 Acc@1: 99.991%

| Validation Epoch #879 Loss: 0.4123 NLLLoss: 0.4123 Acc@1: 88.94%

| Best Test Acc: Acc@1: 89.96% | Epoch [880/1000] Iter[450/ 41] Loss: 0.7207 SupLoss: 0.2510 UsupLoss: 0.4668 NLLLoss: 0.0146 Acc@1: 99.993%

| Validation Epoch #880 Loss: 0.4150 NLLLoss: 0.4150 Acc@1: 88.70%

| Best Test Acc: Acc@1: 89.96% | Epoch [881/1000] Iter[450/ 41] Loss: 0.7239 SupLoss: 0.2643 UsupLoss: 0.4567 NLLLoss: 0.0162 Acc@1: 99.993%

| Validation Epoch #881 Loss: 0.4015 NLLLoss: 0.4015 Acc@1: 89.30%

| Best Test Acc: Acc@1: 89.96% | Epoch [882/1000] Iter[450/ 41] Loss: 0.7071 SupLoss: 0.2290 UsupLoss: 0.4753 NLLLoss: 0.0141 Acc@1: 99.991%

| Validation Epoch #882 Loss: 0.3897 NLLLoss: 0.3897 Acc@1: 89.62%

| Best Test Acc: Acc@1: 89.96% | Epoch [883/1000] Iter[450/ 41] Loss: 0.7142 SupLoss: 0.2416 UsupLoss: 0.4698 NLLLoss: 0.0153 Acc@1: 99.991%

| Validation Epoch #883 Loss: 0.4198 NLLLoss: 0.4198 Acc@1: 89.10%

| Best Test Acc: Acc@1: 89.96% | Epoch [884/1000] Iter[450/ 41] Loss: 0.7047 SupLoss: 0.2497 UsupLoss: 0.4521 NLLLoss: 0.0150 Acc@1: 100.000%

| Validation Epoch #884 Loss: 0.4232 NLLLoss: 0.4232 Acc@1: 89.30%

| Best Test Acc: Acc@1: 89.96% | Epoch [885/1000] Iter[450/ 41] Loss: 0.7463 SupLoss: 0.2706 UsupLoss: 0.4728 NLLLoss: 0.0154 Acc@1: 99.991%

| Validation Epoch #885 Loss: 0.4160 NLLLoss: 0.4160 Acc@1: 88.94%

| Best Test Acc: Acc@1: 89.96% | Epoch [886/1000] Iter[450/ 41] Loss: 0.7262 SupLoss: 0.2442 UsupLoss: 0.4791 NLLLoss: 0.0147 Acc@1: 99.991%

| Validation Epoch #886 Loss: 0.3966 NLLLoss: 0.3966 Acc@1: 89.42%

| Best Test Acc: Acc@1: 89.96% | Epoch [887/1000] Iter[450/ 41] Loss: 0.7639 SupLoss: 0.2661 UsupLoss: 0.4950 NLLLoss: 0.0146 Acc@1: 99.993%

| Validation Epoch #887 Loss: 0.4365 NLLLoss: 0.4365 Acc@1: 89.00%

| Best Test Acc: Acc@1: 89.96% | Epoch [888/1000] Iter[450/ 41] Loss: 0.7091 SupLoss: 0.2414 UsupLoss: 0.4649 NLLLoss: 0.0150 Acc@1: 99.993%

| Validation Epoch #888 Loss: 0.4127 NLLLoss: 0.4127 Acc@1: 89.10%

| Best Test Acc: Acc@1: 89.96% | Epoch [889/1000] Iter[450/ 41] Loss: 0.7260 SupLoss: 0.2493 UsupLoss: 0.4740 NLLLoss: 0.0131 Acc@1: 99.998%

| Validation Epoch #889 Loss: 0.4381 NLLLoss: 0.4381 Acc@1: 89.18%

| Best Test Acc: Acc@1: 89.96% | Epoch [890/1000] Iter[450/ 41] Loss: 0.7027 SupLoss: 0.2458 UsupLoss: 0.4541 NLLLoss: 0.0154 Acc@1: 99.989%

| Validation Epoch #890 Loss: 0.4026 NLLLoss: 0.4026 Acc@1: 89.28%

| Best Test Acc: Acc@1: 89.96% | Epoch [891/1000] Iter[450/ 41] Loss: 0.7022 SupLoss: 0.2262 UsupLoss: 0.4732 NLLLoss: 0.0154 Acc@1: 99.989%

| Validation Epoch #891 Loss: 0.4186 NLLLoss: 0.4186 Acc@1: 89.02%

| Best Test Acc: Acc@1: 89.96% | Epoch [892/1000] Iter[450/ 41] Loss: 0.7762 SupLoss: 0.2846 UsupLoss: 0.4889 NLLLoss: 0.0136 Acc@1: 99.998%

| Validation Epoch #892 Loss: 0.3866 NLLLoss: 0.3866 Acc@1: 89.96%

| Best Test Acc: Acc@1: 89.96% | Epoch [893/1000] Iter[450/ 41] Loss: 0.7035 SupLoss: 0.2300 UsupLoss: 0.4707 NLLLoss: 0.0143 Acc@1: 99.993%

| Validation Epoch #893 Loss: 0.4140 NLLLoss: 0.4140 Acc@1: 89.06%

| Best Test Acc: Acc@1: 89.96% | Epoch [894/1000] Iter[450/ 41] Loss: 0.7261 SupLoss: 0.2522 UsupLoss: 0.4712 NLLLoss: 0.0131 Acc@1: 99.993%

| Validation Epoch #894 Loss: 0.3965 NLLLoss: 0.3965 Acc@1: 89.40%

| Best Test Acc: Acc@1: 89.96% | Epoch [895/1000] Iter[450/ 41] Loss: 0.7224 SupLoss: 0.2525 UsupLoss: 0.4671 NLLLoss: 0.0152 Acc@1: 99.980%

| Validation Epoch #895 Loss: 0.4012 NLLLoss: 0.4012 Acc@1: 89.08%

| Best Test Acc: Acc@1: 89.96% | Epoch [896/1000] Iter[450/ 41] Loss: 0.7632 SupLoss: 0.2798 UsupLoss: 0.4807 NLLLoss: 0.0145 Acc@1: 99.993%

| Validation Epoch #896 Loss: 0.4347 NLLLoss: 0.4347 Acc@1: 88.76%

| Best Test Acc: Acc@1: 89.96% | Epoch [897/1000] Iter[450/ 41] Loss: 0.7310 SupLoss: 0.2564 UsupLoss: 0.4719 NLLLoss: 0.0147 Acc@1: 99.996%

| Validation Epoch #897 Loss: 0.4146 NLLLoss: 0.4146 Acc@1: 88.82%

| Best Test Acc: Acc@1: 89.96% | Epoch [898/1000] Iter[450/ 41] Loss: 0.7324 SupLoss: 0.2520 UsupLoss: 0.4777 NLLLoss: 0.0139 Acc@1: 99.991%

| Validation Epoch #898 Loss: 0.4451 NLLLoss: 0.4451 Acc@1: 88.34%

| Best Test Acc: Acc@1: 89.96% | Epoch [899/1000] Iter[450/ 41] Loss: 0.7225 SupLoss: 0.2495 UsupLoss: 0.4704 NLLLoss: 0.0136 Acc@1: 99.998%

| Validation Epoch #899 Loss: 0.4209 NLLLoss: 0.4209 Acc@1: 89.14%

| Best Test Acc: Acc@1: 89.96% | Epoch [900/1000] Iter[450/ 41] Loss: 0.7549 SupLoss: 0.2846 UsupLoss: 0.4677 NLLLoss: 0.0141 Acc@1: 99.993%

| Validation Epoch #900 Loss: 0.3965 NLLLoss: 0.3965 Acc@1: 89.44%

| Best Test Acc: Acc@1: 89.96% | Epoch [901/1000] Iter[450/ 41] Loss: 0.7161 SupLoss: 0.2380 UsupLoss: 0.4754 NLLLoss: 0.0147 Acc@1: 99.976%

| Validation Epoch #901 Loss: 0.3816 NLLLoss: 0.3816 Acc@1: 89.48%

| Best Test Acc: Acc@1: 89.96% | Epoch [902/1000] Iter[450/ 41] Loss: 0.7198 SupLoss: 0.2418 UsupLoss: 0.4754 NLLLoss: 0.0148 Acc@1: 99.993%

| Validation Epoch #902 Loss: 0.4203 NLLLoss: 0.4203 Acc@1: 89.38%

| Best Test Acc: Acc@1: 89.96% | Epoch [903/1000] Iter[450/ 41] Loss: 0.7488 SupLoss: 0.2598 UsupLoss: 0.4863 NLLLoss: 0.0138 Acc@1: 99.993%

| Validation Epoch #903 Loss: 0.4010 NLLLoss: 0.4010 Acc@1: 89.72%

| Best Test Acc: Acc@1: 89.96% | Epoch [904/1000] Iter[450/ 41] Loss: 0.7098 SupLoss: 0.2417 UsupLoss: 0.4654 NLLLoss: 0.0137 Acc@1: 99.993%

| Validation Epoch #904 Loss: 0.3960 NLLLoss: 0.3960 Acc@1: 89.52%

| Best Test Acc: Acc@1: 89.96% | Epoch [905/1000] Iter[450/ 41] Loss: 0.7417 SupLoss: 0.2570 UsupLoss: 0.4821 NLLLoss: 0.0135 Acc@1: 99.984%

| Validation Epoch #905 Loss: 0.4084 NLLLoss: 0.4084 Acc@1: 89.30%

| Best Test Acc: Acc@1: 89.96% | Epoch [906/1000] Iter[450/ 41] Loss: 0.7304 SupLoss: 0.2578 UsupLoss: 0.4699 NLLLoss: 0.0145 Acc@1: 99.991%

| Validation Epoch #906 Loss: 0.3834 NLLLoss: 0.3834 Acc@1: 89.48%

| Best Test Acc: Acc@1: 89.96% | Epoch [907/1000] Iter[450/ 41] Loss: 0.7596 SupLoss: 0.2644 UsupLoss: 0.4925 NLLLoss: 0.0143 Acc@1: 99.996%

| Validation Epoch #907 Loss: 0.4046 NLLLoss: 0.4046 Acc@1: 89.28%

| Best Test Acc: Acc@1: 89.96% | Epoch [908/1000] Iter[450/ 41] Loss: 0.7396 SupLoss: 0.2625 UsupLoss: 0.4745 NLLLoss: 0.0140 Acc@1: 99.993%

| Validation Epoch #908 Loss: 0.4216 NLLLoss: 0.4216 Acc@1: 88.84%

| Best Test Acc: Acc@1: 89.96% | Epoch [909/1000] Iter[450/ 41] Loss: 0.7004 SupLoss: 0.2297 UsupLoss: 0.4681 NLLLoss: 0.0145 Acc@1: 99.987%

| Validation Epoch #909 Loss: 0.4054 NLLLoss: 0.4054 Acc@1: 89.26%

| Best Test Acc: Acc@1: 89.96% | Epoch [910/1000] Iter[450/ 41] Loss: 0.7415 SupLoss: 0.2531 UsupLoss: 0.4858 NLLLoss: 0.0149 Acc@1: 99.996%

| Validation Epoch #910 Loss: 0.4253 NLLLoss: 0.4253 Acc@1: 88.94%

| Best Test Acc: Acc@1: 89.96% | Epoch [911/1000] Iter[450/ 41] Loss: 0.7160 SupLoss: 0.2453 UsupLoss: 0.4681 NLLLoss: 0.0146 Acc@1: 99.998%

| Validation Epoch #911 Loss: 0.4027 NLLLoss: 0.4027 Acc@1: 89.40%

| Best Test Acc: Acc@1: 89.96% | Epoch [912/1000] Iter[450/ 41] Loss: 0.7468 SupLoss: 0.2645 UsupLoss: 0.4797 NLLLoss: 0.0147 Acc@1: 99.991%

| Validation Epoch #912 Loss: 0.3902 NLLLoss: 0.3902 Acc@1: 89.48%

| Best Test Acc: Acc@1: 89.96% | Epoch [913/1000] Iter[450/ 41] Loss: 0.7187 SupLoss: 0.2448 UsupLoss: 0.4713 NLLLoss: 0.0138 Acc@1: 99.993%

| Validation Epoch #913 Loss: 0.4026 NLLLoss: 0.4026 Acc@1: 89.38%

| Best Test Acc: Acc@1: 89.96% | Epoch [914/1000] Iter[450/ 41] Loss: 0.7244 SupLoss: 0.2478 UsupLoss: 0.4740 NLLLoss: 0.0136 Acc@1: 99.989%

| Validation Epoch #914 Loss: 0.4146 NLLLoss: 0.4146 Acc@1: 88.84%

| Best Test Acc: Acc@1: 89.96% | Epoch [915/1000] Iter[450/ 41] Loss: 0.7034 SupLoss: 0.2172 UsupLoss: 0.4837 NLLLoss: 0.0141 Acc@1: 99.991%

| Validation Epoch #915 Loss: 0.3853 NLLLoss: 0.3853 Acc@1: 89.74%

| Best Test Acc: Acc@1: 89.96% | Epoch [916/1000] Iter[450/ 41] Loss: 0.6939 SupLoss: 0.2296 UsupLoss: 0.4618 NLLLoss: 0.0140 Acc@1: 99.996%

| Validation Epoch #916 Loss: 0.4236 NLLLoss: 0.4236 Acc@1: 88.92%

| Best Test Acc: Acc@1: 89.96% | Epoch [917/1000] Iter[450/ 41] Loss: 0.7599 SupLoss: 0.2715 UsupLoss: 0.4859 NLLLoss: 0.0134 Acc@1: 99.996%

| Validation Epoch #917 Loss: 0.4365 NLLLoss: 0.4365 Acc@1: 89.24%

| Best Test Acc: Acc@1: 89.96% | Epoch [918/1000] Iter[450/ 41] Loss: 0.7402 SupLoss: 0.2528 UsupLoss: 0.4848 NLLLoss: 0.0135 Acc@1: 99.980%

| Validation Epoch #918 Loss: 0.3843 NLLLoss: 0.3843 Acc@1: 89.96%

| Best Test Acc: Acc@1: 89.96% | Epoch [919/1000] Iter[450/ 41] Loss: 0.7444 SupLoss: 0.2561 UsupLoss: 0.4858 NLLLoss: 0.0148 Acc@1: 99.996%

| Validation Epoch #919 Loss: 0.3900 NLLLoss: 0.3900 Acc@1: 89.38%

| Best Test Acc: Acc@1: 89.96% | Epoch [920/1000] Iter[450/ 41] Loss: 0.6892 SupLoss: 0.2119 UsupLoss: 0.4748 NLLLoss: 0.0147 Acc@1: 99.996%

| Validation Epoch #920 Loss: 0.4354 NLLLoss: 0.4354 Acc@1: 88.96%

| Best Test Acc: Acc@1: 89.96% | Epoch [921/1000] Iter[450/ 41] Loss: 0.7078 SupLoss: 0.2302 UsupLoss: 0.4752 NLLLoss: 0.0148 Acc@1: 99.991%

| Validation Epoch #921 Loss: 0.4172 NLLLoss: 0.4172 Acc@1: 89.38%

| Best Test Acc: Acc@1: 89.96% | Epoch [922/1000] Iter[450/ 41] Loss: 0.7492 SupLoss: 0.2597 UsupLoss: 0.4869 NLLLoss: 0.0147 Acc@1: 100.000%

| Validation Epoch #922 Loss: 0.4216 NLLLoss: 0.4216 Acc@1: 89.12%

| Best Test Acc: Acc@1: 89.96% | Epoch [923/1000] Iter[450/ 41] Loss: 0.7163 SupLoss: 0.2142 UsupLoss: 0.4996 NLLLoss: 0.0143 Acc@1: 100.000%

| Validation Epoch #923 Loss: 0.4297 NLLLoss: 0.4297 Acc@1: 89.12%

| Best Test Acc: Acc@1: 89.96% | Epoch [924/1000] Iter[450/ 41] Loss: 0.7384 SupLoss: 0.2568 UsupLoss: 0.4791 NLLLoss: 0.0153 Acc@1: 99.993%

| Validation Epoch #924 Loss: 0.4096 NLLLoss: 0.4096 Acc@1: 89.06%

| Best Test Acc: Acc@1: 89.96% | Epoch [925/1000] Iter[450/ 41] Loss: 0.7142 SupLoss: 0.2423 UsupLoss: 0.4694 NLLLoss: 0.0159 Acc@1: 99.989%

| Validation Epoch #925 Loss: 0.4124 NLLLoss: 0.4124 Acc@1: 89.80%

| Best Test Acc: Acc@1: 89.96% | Epoch [926/1000] Iter[450/ 41] Loss: 0.7222 SupLoss: 0.2459 UsupLoss: 0.4739 NLLLoss: 0.0151 Acc@1: 99.991%

| Validation Epoch #926 Loss: 0.3962 NLLLoss: 0.3962 Acc@1: 89.88%

| Best Test Acc: Acc@1: 89.96% | Epoch [927/1000] Iter[450/ 41] Loss: 0.7201 SupLoss: 0.2382 UsupLoss: 0.4794 NLLLoss: 0.0134 Acc@1: 99.998%

| Validation Epoch #927 Loss: 0.4275 NLLLoss: 0.4275 Acc@1: 89.10%

| Best Test Acc: Acc@1: 89.96% | Epoch [928/1000] Iter[450/ 41] Loss: 0.7581 SupLoss: 0.2845 UsupLoss: 0.4711 NLLLoss: 0.0151 Acc@1: 99.984%

| Validation Epoch #928 Loss: 0.3925 NLLLoss: 0.3925 Acc@1: 89.76%

| Best Test Acc: Acc@1: 89.96% | Epoch [929/1000] Iter[450/ 41] Loss: 0.7299 SupLoss: 0.2492 UsupLoss: 0.4782 NLLLoss: 0.0141 Acc@1: 99.996%

| Validation Epoch #929 Loss: 0.4361 NLLLoss: 0.4361 Acc@1: 89.18%

| Best Test Acc: Acc@1: 89.96% | Epoch [930/1000] Iter[450/ 41] Loss: 0.7113 SupLoss: 0.2432 UsupLoss: 0.4656 NLLLoss: 0.0151 Acc@1: 99.993%

| Validation Epoch #930 Loss: 0.4093 NLLLoss: 0.4093 Acc@1: 89.00%

| Best Test Acc: Acc@1: 89.96% | Epoch [931/1000] Iter[450/ 41] Loss: 0.7128 SupLoss: 0.2357 UsupLoss: 0.4746 NLLLoss: 0.0148 Acc@1: 99.993%

| Validation Epoch #931 Loss: 0.4148 NLLLoss: 0.4148 Acc@1: 89.46%

| Best Test Acc: Acc@1: 89.96% | Epoch [932/1000] Iter[450/ 41] Loss: 0.7057 SupLoss: 0.2337 UsupLoss: 0.4696 NLLLoss: 0.0143 Acc@1: 99.998%

| Validation Epoch #932 Loss: 0.4221 NLLLoss: 0.4221 Acc@1: 89.32%

| Best Test Acc: Acc@1: 89.96% | Epoch [933/1000] Iter[450/ 41] Loss: 0.7143 SupLoss: 0.2477 UsupLoss: 0.4642 NLLLoss: 0.0138 Acc@1: 99.996%

| Validation Epoch #933 Loss: 0.3938 NLLLoss: 0.3938 Acc@1: 89.80%

| Best Test Acc: Acc@1: 89.96% | Epoch [934/1000] Iter[450/ 41] Loss: 0.7199 SupLoss: 0.2545 UsupLoss: 0.4630 NLLLoss: 0.0137 Acc@1: 99.998%

| Validation Epoch #934 Loss: 0.3935 NLLLoss: 0.3935 Acc@1: 89.16%

| Best Test Acc: Acc@1: 89.96% | Epoch [935/1000] Iter[450/ 41] Loss: 0.7509 SupLoss: 0.2766 UsupLoss: 0.4718 NLLLoss: 0.0141 Acc@1: 99.996%

| Validation Epoch #935 Loss: 0.3846 NLLLoss: 0.3846 Acc@1: 89.76%

| Best Test Acc: Acc@1: 89.96% | Epoch [936/1000] Iter[450/ 41] Loss: 0.7485 SupLoss: 0.2457 UsupLoss: 0.5003 NLLLoss: 0.0138 Acc@1: 99.991%

| Validation Epoch #936 Loss: 0.3944 NLLLoss: 0.3944 Acc@1: 89.48%

| Best Test Acc: Acc@1: 89.96% | Epoch [937/1000] Iter[450/ 41] Loss: 0.7419 SupLoss: 0.2647 UsupLoss: 0.4748 NLLLoss: 0.0143 Acc@1: 99.991%

| Validation Epoch #937 Loss: 0.3876 NLLLoss: 0.3876 Acc@1: 89.66%

| Best Test Acc: Acc@1: 89.96% | Epoch [938/1000] Iter[450/ 41] Loss: 0.7060 SupLoss: 0.2379 UsupLoss: 0.4657 NLLLoss: 0.0138 Acc@1: 99.993%

| Validation Epoch #938 Loss: 0.4184 NLLLoss: 0.4184 Acc@1: 89.04%

| Best Test Acc: Acc@1: 89.96% | Epoch [939/1000] Iter[450/ 41] Loss: 0.7261 SupLoss: 0.2294 UsupLoss: 0.4942 NLLLoss: 0.0139 Acc@1: 99.993%

| Validation Epoch #939 Loss: 0.3822 NLLLoss: 0.3822 Acc@1: 89.64%

| Best Test Acc: Acc@1: 89.96% | Epoch [940/1000] Iter[450/ 41] Loss: 0.6963 SupLoss: 0.2122 UsupLoss: 0.4817 NLLLoss: 0.0140 Acc@1: 99.993%

| Validation Epoch #940 Loss: 0.3904 NLLLoss: 0.3904 Acc@1: 89.82%

| Best Test Acc: Acc@1: 89.96% | Epoch [941/1000] Iter[450/ 41] Loss: 0.7085 SupLoss: 0.2328 UsupLoss: 0.4732 NLLLoss: 0.0156 Acc@1: 99.996%

| Validation Epoch #941 Loss: 0.3748 NLLLoss: 0.3748 Acc@1: 89.84%

| Best Test Acc: Acc@1: 89.96% | Epoch [942/1000] Iter[450/ 41] Loss: 0.7886 SupLoss: 0.2661 UsupLoss: 0.5201 NLLLoss: 0.0141 Acc@1: 100.000%

| Validation Epoch #942 Loss: 0.3953 NLLLoss: 0.3953 Acc@1: 89.06%

| Best Test Acc: Acc@1: 89.96% | Epoch [943/1000] Iter[450/ 41] Loss: 0.7253 SupLoss: 0.2608 UsupLoss: 0.4621 NLLLoss: 0.0142 Acc@1: 99.996%

| Validation Epoch #943 Loss: 0.3820 NLLLoss: 0.3820 Acc@1: 89.82%

| Best Test Acc: Acc@1: 89.96% | Epoch [944/1000] Iter[450/ 41] Loss: 0.7402 SupLoss: 0.2753 UsupLoss: 0.4624 NLLLoss: 0.0139 Acc@1: 99.996%

| Validation Epoch #944 Loss: 0.4006 NLLLoss: 0.4006 Acc@1: 89.32%

| Best Test Acc: Acc@1: 89.96% | Epoch [945/1000] Iter[450/ 41] Loss: 0.7228 SupLoss: 0.2422 UsupLoss: 0.4782 NLLLoss: 0.0144 Acc@1: 99.998%

| Validation Epoch #945 Loss: 0.4126 NLLLoss: 0.4126 Acc@1: 89.26%

| Best Test Acc: Acc@1: 89.96% | Epoch [946/1000] Iter[450/ 41] Loss: 0.7211 SupLoss: 0.2333 UsupLoss: 0.4855 NLLLoss: 0.0139 Acc@1: 99.996%

| Validation Epoch #946 Loss: 0.3635 NLLLoss: 0.3635 Acc@1: 90.12%

| Best Test Acc: Epoch #946 Loss: 0.3556 NLLLoss: 0.3556 Acc@1: 90.61%

| Best Test Acc: Acc@1: 90.61% | Epoch [947/1000] Iter[450/ 41] Loss: 0.7547 SupLoss: 0.2613 UsupLoss: 0.4910 NLLLoss: 0.0140 Acc@1: 99.993%

| Validation Epoch #947 Loss: 0.4293 NLLLoss: 0.4293 Acc@1: 89.28%

| Best Test Acc: Acc@1: 90.61% | Epoch [948/1000] Iter[450/ 41] Loss: 0.7577 SupLoss: 0.2769 UsupLoss: 0.4783 NLLLoss: 0.0149 Acc@1: 99.996%

| Validation Epoch #948 Loss: 0.4097 NLLLoss: 0.4097 Acc@1: 89.38%

| Best Test Acc: Acc@1: 90.61% | Epoch [949/1000] Iter[450/ 41] Loss: 0.7128 SupLoss: 0.2464 UsupLoss: 0.4640 NLLLoss: 0.0147 Acc@1: 99.987%

| Validation Epoch #949 Loss: 0.4416 NLLLoss: 0.4416 Acc@1: 88.92%

| Best Test Acc: Acc@1: 90.61% | Epoch [950/1000] Iter[450/ 41] Loss: 0.7185 SupLoss: 0.2291 UsupLoss: 0.4870 NLLLoss: 0.0142 Acc@1: 100.000%

| Validation Epoch #950 Loss: 0.4028 NLLLoss: 0.4028 Acc@1: 89.20%

| Best Test Acc: Acc@1: 90.61% | Epoch [951/1000] Iter[450/ 41] Loss: 0.7250 SupLoss: 0.2593 UsupLoss: 0.4633 NLLLoss: 0.0140 Acc@1: 99.989%

| Validation Epoch #951 Loss: 0.4126 NLLLoss: 0.4126 Acc@1: 89.38%

| Best Test Acc: Acc@1: 90.61% | Epoch [952/1000] Iter[450/ 41] Loss: 0.7242 SupLoss: 0.2477 UsupLoss: 0.4741 NLLLoss: 0.0154 Acc@1: 99.989%

| Validation Epoch #952 Loss: 0.3954 NLLLoss: 0.3954 Acc@1: 89.48%

| Best Test Acc: Acc@1: 90.61% | Epoch [953/1000] Iter[450/ 41] Loss: 0.7388 SupLoss: 0.2553 UsupLoss: 0.4812 NLLLoss: 0.0148 Acc@1: 99.987%

| Validation Epoch #953 Loss: 0.3961 NLLLoss: 0.3961 Acc@1: 89.86%

| Best Test Acc: Acc@1: 90.61% | Epoch [954/1000] Iter[450/ 41] Loss: 0.7477 SupLoss: 0.2608 UsupLoss: 0.4845 NLLLoss: 0.0144 Acc@1: 99.991%

| Validation Epoch #954 Loss: 0.4328 NLLLoss: 0.4328 Acc@1: 88.68%

| Best Test Acc: Acc@1: 90.61% | Epoch [955/1000] Iter[450/ 41] Loss: 0.7598 SupLoss: 0.2663 UsupLoss: 0.4911 NLLLoss: 0.0146 Acc@1: 99.998%

| Validation Epoch #955 Loss: 0.4696 NLLLoss: 0.4696 Acc@1: 88.52%

| Best Test Acc: Acc@1: 90.61% | Epoch [956/1000] Iter[450/ 41] Loss: 0.7487 SupLoss: 0.2578 UsupLoss: 0.4885 NLLLoss: 0.0155 Acc@1: 99.998%

| Validation Epoch #956 Loss: 0.4037 NLLLoss: 0.4037 Acc@1: 89.26%

| Best Test Acc: Acc@1: 90.61% | Epoch [957/1000] Iter[450/ 41] Loss: 0.7651 SupLoss: 0.2614 UsupLoss: 0.5013 NLLLoss: 0.0144 Acc@1: 99.993%

| Validation Epoch #957 Loss: 0.4225 NLLLoss: 0.4225 Acc@1: 89.16%

| Best Test Acc: Acc@1: 90.61% | Epoch [958/1000] Iter[450/ 41] Loss: 0.7174 SupLoss: 0.2501 UsupLoss: 0.4648 NLLLoss: 0.0140 Acc@1: 99.993%

| Validation Epoch #958 Loss: 0.4015 NLLLoss: 0.4015 Acc@1: 89.16%

| Best Test Acc: Acc@1: 90.61% | Epoch [959/1000] Iter[450/ 41] Loss: 0.7721 SupLoss: 0.2733 UsupLoss: 0.4964 NLLLoss: 0.0149 Acc@1: 99.987%

| Validation Epoch #959 Loss: 0.4240 NLLLoss: 0.4240 Acc@1: 89.12%

| Best Test Acc: Acc@1: 90.61% | Epoch [960/1000] Iter[450/ 41] Loss: 0.7142 SupLoss: 0.2307 UsupLoss: 0.4811 NLLLoss: 0.0147 Acc@1: 99.996%

| Validation Epoch #960 Loss: 0.4014 NLLLoss: 0.4014 Acc@1: 89.52%

| Best Test Acc: Acc@1: 90.61% | Epoch [961/1000] Iter[450/ 41] Loss: 0.7285 SupLoss: 0.2471 UsupLoss: 0.4790 NLLLoss: 0.0140 Acc@1: 99.996%

| Validation Epoch #961 Loss: 0.3851 NLLLoss: 0.3851 Acc@1: 89.74%

| Best Test Acc: Acc@1: 90.61% | Epoch [962/1000] Iter[450/ 41] Loss: 0.7135 SupLoss: 0.2571 UsupLoss: 0.4540 NLLLoss: 0.0147 Acc@1: 99.993%

| Validation Epoch #962 Loss: 0.4026 NLLLoss: 0.4026 Acc@1: 89.50%

| Best Test Acc: Acc@1: 90.61% | Epoch [963/1000] Iter[450/ 41] Loss: 0.7113 SupLoss: 0.2452 UsupLoss: 0.4637 NLLLoss: 0.0139 Acc@1: 99.991%

| Validation Epoch #963 Loss: 0.4288 NLLLoss: 0.4288 Acc@1: 89.40%

| Best Test Acc: Acc@1: 90.61% | Epoch [964/1000] Iter[450/ 41] Loss: 0.7055 SupLoss: 0.2464 UsupLoss: 0.4568 NLLLoss: 0.0148 Acc@1: 99.993%

| Validation Epoch #964 Loss: 0.4348 NLLLoss: 0.4348 Acc@1: 89.12%

| Best Test Acc: Acc@1: 90.61% | Epoch [965/1000] Iter[450/ 41] Loss: 0.7449 SupLoss: 0.2669 UsupLoss: 0.4755 NLLLoss: 0.0151 Acc@1: 99.987%

| Validation Epoch #965 Loss: 0.4188 NLLLoss: 0.4188 Acc@1: 89.28%

| Best Test Acc: Acc@1: 90.61% | Epoch [966/1000] Iter[450/ 41] Loss: 0.7698 SupLoss: 0.2720 UsupLoss: 0.4954 NLLLoss: 0.0141 Acc@1: 99.998%

| Validation Epoch #966 Loss: 0.4436 NLLLoss: 0.4436 Acc@1: 88.66%

| Best Test Acc: Acc@1: 90.61% | Epoch [967/1000] Iter[450/ 41] Loss: 0.7532 SupLoss: 0.2607 UsupLoss: 0.4901 NLLLoss: 0.0149 Acc@1: 99.982%

| Validation Epoch #967 Loss: 0.4064 NLLLoss: 0.4064 Acc@1: 89.12%

| Best Test Acc: Acc@1: 90.61% | Epoch [968/1000] Iter[450/ 41] Loss: 0.7093 SupLoss: 0.2251 UsupLoss: 0.4819 NLLLoss: 0.0148 Acc@1: 99.989%

| Validation Epoch #968 Loss: 0.4062 NLLLoss: 0.4062 Acc@1: 89.20%

| Best Test Acc: Acc@1: 90.61% | Epoch [969/1000] Iter[450/ 41] Loss: 0.7364 SupLoss: 0.2678 UsupLoss: 0.4663 NLLLoss: 0.0144 Acc@1: 99.998%

| Validation Epoch #969 Loss: 0.4074 NLLLoss: 0.4074 Acc@1: 89.32%

| Best Test Acc: Acc@1: 90.61% | Epoch [970/1000] Iter[450/ 41] Loss: 0.7776 SupLoss: 0.2764 UsupLoss: 0.4988 NLLLoss: 0.0145 Acc@1: 99.984%

| Validation Epoch #970 Loss: 0.4198 NLLLoss: 0.4198 Acc@1: 89.08%

| Best Test Acc: Acc@1: 90.61% | Epoch [971/1000] Iter[450/ 41] Loss: 0.7338 SupLoss: 0.2579 UsupLoss: 0.4735 NLLLoss: 0.0139 Acc@1: 99.998%

| Validation Epoch #971 Loss: 0.4212 NLLLoss: 0.4212 Acc@1: 89.06%

| Best Test Acc: Acc@1: 90.61% | Epoch [972/1000] Iter[450/ 41] Loss: 0.7412 SupLoss: 0.2510 UsupLoss: 0.4878 NLLLoss: 0.0133 Acc@1: 99.993%

| Validation Epoch #972 Loss: 0.4211 NLLLoss: 0.4211 Acc@1: 88.72%

| Best Test Acc: Acc@1: 90.61% | Epoch [973/1000] Iter[450/ 41] Loss: 0.7421 SupLoss: 0.2417 UsupLoss: 0.4981 NLLLoss: 0.0153 Acc@1: 99.998%

| Validation Epoch #973 Loss: 0.3980 NLLLoss: 0.3980 Acc@1: 89.48%

| Best Test Acc: Acc@1: 90.61% | Epoch [974/1000] Iter[450/ 41] Loss: 0.7576 SupLoss: 0.2732 UsupLoss: 0.4820 NLLLoss: 0.0148 Acc@1: 100.000%

| Validation Epoch #974 Loss: 0.4231 NLLLoss: 0.4231 Acc@1: 89.12%

| Best Test Acc: Acc@1: 90.61% | Epoch [975/1000] Iter[450/ 41] Loss: 0.7539 SupLoss: 0.2759 UsupLoss: 0.4757 NLLLoss: 0.0145 Acc@1: 99.993%

| Validation Epoch #975 Loss: 0.4316 NLLLoss: 0.4316 Acc@1: 88.92%

| Best Test Acc: Acc@1: 90.61% | Epoch [976/1000] Iter[450/ 41] Loss: 0.6996 SupLoss: 0.2407 UsupLoss: 0.4566 NLLLoss: 0.0148 Acc@1: 99.982%

| Validation Epoch #976 Loss: 0.4280 NLLLoss: 0.4280 Acc@1: 89.10%

| Best Test Acc: Acc@1: 90.61% | Epoch [977/1000] Iter[450/ 41] Loss: 0.7108 SupLoss: 0.2223 UsupLoss: 0.4861 NLLLoss: 0.0160 Acc@1: 99.998%

| Validation Epoch #977 Loss: 0.4345 NLLLoss: 0.4345 Acc@1: 88.58%

| Best Test Acc: Acc@1: 90.61% | Epoch [978/1000] Iter[450/ 41] Loss: 0.7296 SupLoss: 0.2504 UsupLoss: 0.4768 NLLLoss: 0.0143 Acc@1: 99.991%

| Validation Epoch #978 Loss: 0.4102 NLLLoss: 0.4102 Acc@1: 89.42%

| Best Test Acc: Acc@1: 90.61% | Epoch [979/1000] Iter[450/ 41] Loss: 0.7167 SupLoss: 0.2515 UsupLoss: 0.4629 NLLLoss: 0.0142 Acc@1: 99.993%

| Validation Epoch #979 Loss: 0.4340 NLLLoss: 0.4340 Acc@1: 88.76%

| Best Test Acc: Acc@1: 90.61% | Epoch [980/1000] Iter[450/ 41] Loss: 0.7512 SupLoss: 0.2717 UsupLoss: 0.4771 NLLLoss: 0.0161 Acc@1: 99.993%

| Validation Epoch #980 Loss: 0.3992 NLLLoss: 0.3992 Acc@1: 89.52%

| Best Test Acc: Acc@1: 90.61% | Epoch [981/1000] Iter[450/ 41] Loss: 0.7511 SupLoss: 0.2455 UsupLoss: 0.5033 NLLLoss: 0.0146 Acc@1: 99.991%

| Validation Epoch #981 Loss: 0.4036 NLLLoss: 0.4036 Acc@1: 89.94%

| Best Test Acc: Acc@1: 90.61% | Epoch [982/1000] Iter[450/ 41] Loss: 0.7394 SupLoss: 0.2593 UsupLoss: 0.4778 NLLLoss: 0.0146 Acc@1: 99.989%

| Validation Epoch #982 Loss: 0.4160 NLLLoss: 0.4160 Acc@1: 89.28%

| Best Test Acc: Acc@1: 90.61% | Epoch [983/1000] Iter[450/ 41] Loss: 0.7250 SupLoss: 0.2338 UsupLoss: 0.4888 NLLLoss: 0.0136 Acc@1: 99.993%

| Validation Epoch #983 Loss: 0.4100 NLLLoss: 0.4100 Acc@1: 89.04%

| Best Test Acc: Acc@1: 90.61% | Epoch [984/1000] Iter[450/ 41] Loss: 0.7125 SupLoss: 0.2365 UsupLoss: 0.4737 NLLLoss: 0.0129 Acc@1: 99.998%

| Validation Epoch #984 Loss: 0.4276 NLLLoss: 0.4276 Acc@1: 88.84%

| Best Test Acc: Acc@1: 90.61% | Epoch [985/1000] Iter[450/ 41] Loss: 0.7357 SupLoss: 0.2448 UsupLoss: 0.4886 NLLLoss: 0.0146 Acc@1: 99.987%

| Validation Epoch #985 Loss: 0.3982 NLLLoss: 0.3982 Acc@1: 89.90%

| Best Test Acc: Acc@1: 90.61% | Epoch [986/1000] Iter[450/ 41] Loss: 0.7307 SupLoss: 0.2293 UsupLoss: 0.4990 NLLLoss: 0.0137 Acc@1: 99.991%

| Validation Epoch #986 Loss: 0.3859 NLLLoss: 0.3859 Acc@1: 89.98%

| Best Test Acc: Acc@1: 90.61% | Epoch [987/1000] Iter[450/ 41] Loss: 0.7828 SupLoss: 0.2949 UsupLoss: 0.4856 NLLLoss: 0.0145 Acc@1: 99.993%

| Validation Epoch #987 Loss: 0.4157 NLLLoss: 0.4157 Acc@1: 89.12%

| Best Test Acc: Acc@1: 90.61% | Epoch [988/1000] Iter[450/ 41] Loss: 0.7060 SupLoss: 0.2366 UsupLoss: 0.4670 NLLLoss: 0.0141 Acc@1: 99.998%

| Validation Epoch #988 Loss: 0.4518 NLLLoss: 0.4518 Acc@1: 88.50%

| Best Test Acc: Acc@1: 90.61% | Epoch [989/1000] Iter[450/ 41] Loss: 0.7215 SupLoss: 0.2570 UsupLoss: 0.4622 NLLLoss: 0.0149 Acc@1: 99.993%

| Validation Epoch #989 Loss: 0.4104 NLLLoss: 0.4104 Acc@1: 89.36%

| Best Test Acc: Acc@1: 90.61% | Epoch [990/1000] Iter[450/ 41] Loss: 0.7507 SupLoss: 0.2600 UsupLoss: 0.4884 NLLLoss: 0.0138 Acc@1: 99.993%

| Validation Epoch #990 Loss: 0.3883 NLLLoss: 0.3883 Acc@1: 89.58%

| Best Test Acc: Acc@1: 90.61% | Epoch [991/1000] Iter[450/ 41] Loss: 0.7291 SupLoss: 0.2548 UsupLoss: 0.4719 NLLLoss: 0.0141 Acc@1: 99.998%

| Validation Epoch #991 Loss: 0.4201 NLLLoss: 0.4201 Acc@1: 89.14%

| Best Test Acc: Acc@1: 90.61% | Epoch [992/1000] Iter[450/ 41] Loss: 0.7139 SupLoss: 0.2203 UsupLoss: 0.4914 NLLLoss: 0.0141 Acc@1: 99.991%

| Validation Epoch #992 Loss: 0.4141 NLLLoss: 0.4141 Acc@1: 89.38%

| Best Test Acc: Acc@1: 90.61% | Epoch [993/1000] Iter[450/ 41] Loss: 0.6953 SupLoss: 0.2394 UsupLoss: 0.4536 NLLLoss: 0.0152 Acc@1: 99.996%

| Validation Epoch #993 Loss: 0.4185 NLLLoss: 0.4185 Acc@1: 89.32%

| Best Test Acc: Acc@1: 90.61% | Epoch [994/1000] Iter[450/ 41] Loss: 0.7198 SupLoss: 0.2554 UsupLoss: 0.4622 NLLLoss: 0.0143 Acc@1: 100.000%

| Validation Epoch #994 Loss: 0.4119 NLLLoss: 0.4119 Acc@1: 89.38%

| Best Test Acc: Acc@1: 90.61% | Epoch [995/1000] Iter[450/ 41] Loss: 0.7084 SupLoss: 0.2586 UsupLoss: 0.4475 NLLLoss: 0.0157 Acc@1: 99.991%

| Validation Epoch #995 Loss: 0.4196 NLLLoss: 0.4196 Acc@1: 89.40%

| Best Test Acc: Acc@1: 90.61% | Epoch [996/1000] Iter[450/ 41] Loss: 0.7592 SupLoss: 0.2597 UsupLoss: 0.4972 NLLLoss: 0.0143 Acc@1: 99.993%

| Validation Epoch #996 Loss: 0.4031 NLLLoss: 0.4031 Acc@1: 89.58%

| Best Test Acc: Acc@1: 90.61% | Epoch [997/1000] Iter[450/ 41] Loss: 0.7336 SupLoss: 0.2523 UsupLoss: 0.4790 NLLLoss: 0.0139 Acc@1: 99.996%

| Validation Epoch #997 Loss: 0.3882 NLLLoss: 0.3882 Acc@1: 89.66%

| Best Test Acc: Acc@1: 90.61% | Epoch [998/1000] Iter[450/ 41] Loss: 0.7467 SupLoss: 0.2641 UsupLoss: 0.4802 NLLLoss: 0.0149 Acc@1: 99.996%

| Validation Epoch #998 Loss: 0.4102 NLLLoss: 0.4102 Acc@1: 89.28%

| Best Test Acc: Acc@1: 90.61% | Epoch [999/1000] Iter[450/ 41] Loss: 0.7044 SupLoss: 0.2156 UsupLoss: 0.4865 NLLLoss: 0.0152 Acc@1: 99.980%

| Validation Epoch #999 Loss: 0.4170 NLLLoss: 0.4170 Acc@1: 89.16%

| Best Test Acc: Acc@1: 90.61% | Epoch [1000/1000] Iter[450/ 41] Loss: 0.6945 SupLoss: 0.2247 UsupLoss: 0.4675 NLLLoss: 0.0149 Acc@1: 99.991%

| Validation Epoch #1000 Loss: 0.4031 NLLLoss: 0.4031 Acc@1: 89.66%

| Best Test Acc: Acc@1: 90.61%

alexmlamb commented 6 years ago

Hi there

I cloned the repo, pre-calced the ZCA matrix, and ran your command as follows on a single GPU using python 2.7, torch 0.3.1 and torchvision 0.2.0: python main_mixup_hidden_ssl.py --dataset cifar10 --optimizer sgd --lr 0.1 --l2 0.0005 --nesterov --epochs 1000 --batch_size 100 --mixup_sup 1 --mixup_usup 1 --mixup_sup_hidden --mixup_usup_hidden --mixup_alpha_sup 0.1 --mixup_alpha_usup 2.0 --alpha_max 1.0 --alpha_max_at_factor 0.4 --net_type WRN28_2 --schedule 500 750 875 --gammas 0.1 0.1 0.1 --exp_dir exp1 --data_dir ../data/cifar10/

However I get a final test error of around 18%, whereas in your paper you report around 10%.

Is there something I'm missing here?

Thanks in advance Liam

@nlml if you post your log too, maybe that will point us towards what the error is. Also, perhaps something is going wrong with the ZCA statistics. I'm not sure what else it could be.

nlml commented 6 years ago

Thanks for re-running. I didn't save my log but I'm re-running again now with logging so I'll let you know how it goes.

nlml commented 6 years ago

Here's a comparative plot of the best test acc in my log vs. yours after the 120 or so epochs mine has trained for...

So it seems like something's wrong with my setup.

Could you paste a pip freeze so I can make a virtualenv and maybe try and more closely mimic your environment?

nlml commented 6 years ago

Or maybe you could post your zca_components.npy and zca_mean.npy somewhere to see if I'm getting (roughly) the same?

My zca_mean.npy looks like this: np.load('zca_mean.npy') array([0.08588476, 0.2102438 , 0.27966717, ..., 0.02125524, 0.04589855, 0.00722429])

nlml commented 6 years ago

Here's my log (stopped at epoch 806) if that helps https://pastebin.com/rmR7Ga52

alexmlamb commented 6 years ago

I still don't know what's causing it, but even from the first epoch our NLL is like half your NLL, so something significant is different. One thing that might be notable is that our usup loss is much larger on the first epoch.

nlml commented 6 years ago

If you can post a pip freeze, then I can try and copy your environment. Perhaps there is a problem with me using a newer scipy or numpy (seems the only requirements are numpy, torch, torchvision and scipy so if you can post versions of those hopefully that solves it).

nlml commented 6 years ago

I can also try a different seed, maybe I'm just getting really unlucky.

vikasverma1077 commented 6 years ago

here is the pip freeze:

alabaster==0.7.9 anaconda-client==1.6.3 anaconda-navigator==1.4.3 appdirs==1.4.0 argcomplete==1.0.0 argh==0.26.2 asn1crypto==0.24.0 astroid==1.4.9 astropy==1.3 attrs==17.4.0 Automat==0.6.0 Babel==2.3.4 backports-abc==0.5 backports.shutil-get-terminal-size==1.0.0 backports.ssl-match-hostname==3.5.0.1 bcolz==1.0.0 bcrypt==3.1.4 beautifulsoup4==4.5.3 bitarray==0.8.1 blaze==0.10.1 bokeh==0.12.4 boto==2.45.0 Bottleneck==1.2.0 bsddb3==6.1.1 cdecimal==2.3 certifi==2018.1.18 cffi==1.11.4 chardet==3.0.4 chest==0.2.3 click==6.7 cloudpickle==0.2.2 clyent==1.2.2 colorama==0.3.7 conda==4.3.30 conda-build==3.0.15 conda-verify==2.0.0 configobj==5.0.6 configparser==3.5.0 constantly==15.1.0 contextlib2==0.5.4 cryptography==2.1.4 cycler==0.10.0 Cython==0.25.2 cytoolz==0.8.2 dask==0.13.0 datashape==0.5.4 decorator==4.0.11 dill==0.2.5 docker==2.7.0 docker-pycreds==0.2.1 dockerpty==0.4.1 docutils==0.13.1 dynd===f641248 enum34==1.1.6 epydoc==3.0.1 et-xmlfile==1.0.1 fastcache==1.0.2 feedparser==5.2.1 filelock==2.0.7 flake8==2.5.1 Flask==0.12 Flask-Cors==3.0.2 funcsigs==1.0.2 functools32==3.2.3.post2 futures==3.2.0 gevent==1.2.1 glob2==0.5 greenlet==0.4.11 grin==1.2.1 grpcio==1.7.3 h5py==2.6.0 HeapDict==1.0.0 hyperlink==18.0.0 idna==2.6 imagesize==0.7.1 incremental==17.5.0 ipaddress==1.0.19 ipdb==0.10.3 ipykernel==4.5.2 ipython==5.3.0 ipython-genutils==0.1.0 ipywidgets==5.2.2 isort==4.2.5 itsdangerous==0.24 jdcal==1.3 jedi==0.9.0 Jinja2==2.9.4 joblib==0.8.4 Jobman===git jsonschema==2.5.1 jupyter==1.0.0 jupyter-client==4.4.0 jupyter-console==5.0.0 jupyter-core==4.2.1 Keras==1.2.2 keyring==3.8 Lasagne==0.2.dev1 lazy-object-proxy==1.2.2 line-profiler==1.0 llvmlite==0.15.0 locket==0.2.0 logzero==1.5.0 lxml==3.7.2 Mako==1.0.2 MarkupSafe==0.23 matplotlib==2.0.0 mccabe==0.3.1 mercurial==3.7.1 mimir==0.6.3 mistune==0.7.3 mock==2.0.0 mpi4py==2.0.0 mpmath==0.19 multipledispatch==0.4.9 nbconvert==4.2.0 nbformat==4.2.0 networkx==1.11 ngc==0.1.2 nltk==3.2.2 nose==1.3.7 nose-exclude==0.5.0 nose-parameterized==0.5.0 nose-timer==0.6.0 notebook==4.3.1 numba==0.30.1+0.g8c1033f.dirty numexpr==2.6.1 numpy==1.11.3 numpydoc==0.6.0 odo==0.5.0 olefile==0.44 opencv-python==3.2.0.6 openpyxl==2.4.1 pandas==0.19.2 parameterized==0.6.1 parametrized==0.1 paramiko==2.4.0 partd==0.3.7 pathlib==1.0.1 pathlib2==2.2.0 patsy==0.4.1 pbr==1.3.0 pep8==1.7.0 pexpect==4.2.1 picklable-itertools==0.1.1 pickleshare==0.7.4 Pillow==5.0.0 pkginfo==1.4.1 ply==3.9 posix-ipc==1.0.0 prettytable==0.7.2 progressbar==2.3 progressbar2==3.6.2 prompt-toolkit==1.0.9 protobuf==3.4.0 psutil==5.0.1 ptyprocess==0.5.1 py==1.4.32 pyasn1==0.4.2 pycairo==1.10.0 pycosat==0.6.1 pycparser==2.18 pycrypto==2.6.1 pycuda==2016.1.2 pycurl==7.43.0 pydot-ng==1.0.1.dev0 pyflakes==1.5.0 pygame==1.9.2b8 Pygments==2.1.3 pygpu==0.6.9 pyhashxx==0.1.3 PyJWT==1.5.3 pylint==1.6.4 PyNaCl==1.2.1 pyOpenSSL==16.2.0 pyparsing==2.1.4 pytest==3.0.6 python-dateutil==2.6.0 pytools==2016.2.6 pytz==2016.10 PyYAML==3.12 pyzmq==16.0.2 QtAwesome==0.4.3 qtconsole==4.2.1 QtPy==1.2.1 redis==2.10.5 requests==2.18.4 requests-toolbelt==0.8.0 retrying==1.3.3 roman==2.0.0 rope==0.9.4 runipy==0.1.5 scandir==1.4 scikit-cuda==0.5.2 scikit-image==0.12.3 scikit-learn==0.18.1 scipy==0.18.1 seaborn==0.7.1 semver==2.7.9 simplegeneric==0.8.1 simplejson==3.13.2 singledispatch==3.4.0.3 six==1.11.0 snowballstemmer==1.2.1 sockjs-tornado==1.0.3 Sphinx==1.5.1 sphinx-rtd-theme==0.1.9 spyder==3.1.2 SQLAlchemy==1.1.5 statsmodels==0.6.1 stevedore==1.21.0 subprocess32==3.2.7 sympy==1.0 tables==3.3.0 tensorboardX==1.1 tensorflow-gpu==1.0.1 termcolor==1.1.0 terminado==0.6 Theano==0.10.0b1 toolz==0.8.2 torch==0.3.1 torchfile==0.1.0 torchnet==0.0.1 torchvision==0.2.0 tornado==4.4.2 tqdm==4.11.2 traitlets==4.3.1 Twisted==17.9.0 ujson==1.35 unicodecsv==0.14.1 urllib3==1.22 virtualenv==15.1.0 virtualenv-clone==0.2.6 virtualenvwrapper==4.7.2 visdom==0.1.7 wcwidth==0.1.7 websocket-client==0.46.0 Werkzeug==0.11.15 widgetsnbextension==1.2.6 wokkel==0.7.1 wrapt==1.10.8 xlrd==1.0.0 XlsxWriter==0.9.6 xlwt==1.2.0 zope.interface==4.4.3

nlml commented 6 years ago

Changing seed didn't help.

Thanks for the pip freeze, I'm running again with the same versions as you now, but the ZCA looks exactly the same so I don't think it's that.

Early indications are that I'm still getting much worse results. Really wonder what else this could be.

Would it be possible to get you to re-run the code in some sort of docker environment, then I can replicate exactly?

Could use, e.g. docker pull ufoym/deepo:py27 from https://github.com/ufoym/deepo

nlml commented 6 years ago

I killed this run - after 153 epochs my best test acc was still a full 10 percentage points behind yours. Might try running it in the abovementioned docker instance later - if you get a chance to do the same that would be great!

vikasverma1077 commented 6 years ago

Hi Liam, I added the zca files in the data folder. could you use that and try again.

nlml commented 6 years ago

Thanks for that. Your ZCA results are very different to mine. And using yours I'm getting much closer results (only up to 11 epochs though). I'll let it finish and see where it gets to, but it looks like this was the problem. I'll see if I can figure out how my ZCA could be coming out so different...

alexmlamb commented 6 years ago

In the cifar10_zca.py method, are all the imports the same version? If not, maybe the data is different.

nlml commented 6 years ago

They should be. My virtualenv requirements looks like this: numpy==1.11.3 torch==0.3.1 torchvision==0.2.0 scipy==0.18.1

Those seem to be all the dependencies, and those versions all match those you pasted above.

I'll re-download the data and see if I can get the same ZCA results as you.

nlml commented 6 years ago

Hmm so I re-downloaded the data and the md5sum matches that here https://www.cs.toronto.edu/~kriz/cifar.html

But the ZCA components I estimate by running python cifar10_zca.py are still the same as my old ones, not the ones you uploaded.

Here's the md5sums of the zipped data and the first batch, maybe see if that matches yours?

(venv) neo@matrix:~/Liam/manimix/manifold_mixup/data/cifar10$ md5sum cifar-10-python.tar.gz 
c58f30108f718f92721af3b95e74349a  cifar-10-python.tar.gz
(venv) neo@matrix:~/Liam/manimix/manifold_mixup/data/cifar10/cifar-10-batches-py$ md5sum cifar-10-batches-py/data_batch_1
c99cafc152244af753f735de768cd75f  data_batch_1

If so, then I guess the discrepancy is in the ZCA calculation. Could you run that part again and see if you get the same matrix/vector? Maybe something changed in your script since you first calculated the ZCA but you left the old ZCA matrix/vector lying around so they were never re-calculated?

vikasverma1077 commented 6 years ago

were you able to reproduce the results with the zca files I uploaded?

nlml commented 6 years ago

Yes with your ZCA files I got basically the same performance as you (slightly worse)

On Tue, 2 Oct 2018 at 00:48, vikasverma1077 notifications@github.com wrote:

were you able to reproduce the results with the zca files I uploaded?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/vikasverma1077/manifold_mixup/issues/3#issuecomment-426089572, or mute the thread https://github.com/notifications/unsubscribe-auth/AMOFkVrOyTTHvM4ICppeKmrbwFEjqRfJks5ugpuzgaJpZM4WWvOL .

alexmlamb commented 6 years ago

I see. That's still good progress. How close is it now?

We should still figure out what happened with the ZCA.

nlml commented 6 years ago

From my run with your ZCA:

Best Test Acc: Acc@1: 88.46%

So almost as good. I think that's solved.

The issue is: how to reproduce your ZCA matrix/vector. Could you try re-running your ZCA creation script to see if it produces the same result as those you uploaded?

On Tue, 2 Oct 2018 at 14:20, Alex Lamb notifications@github.com wrote:

I see. That's still good progress. How close is it now?

We should still figure out what happened with the ZCA.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/vikasverma1077/manifold_mixup/issues/3#issuecomment-426252019, or mute the thread https://github.com/notifications/unsubscribe-auth/AMOFkVsZj8YS-eU0UZLkIYy_Ez0wQ91Gks5ug1nvgaJpZM4WWvOL .

vikasverma1077 commented 6 years ago

yes, I will do that as a priority.

nlml commented 6 years ago

Great, thanks.

nlml commented 5 years ago

Hi, did you ever get around to re-running the ZCA creation on your end prior to retraining?

vikasverma1077 commented 5 years ago

@nlml Hi there! we spotted the problem. the problem was with the ordering of the dimension while computing the ZCA. You can also check-out our new detailed work on Semi-supervised learning https://github.com/vikasverma1077/ICT

nlml commented 5 years ago

Ah ok great - thanks for the update! I'll close the issue.

vikasverma1077 / manifold_mixup

Cannot reproduce CIFAR10 semi-supervised results #3