cpracticer commented 2 years ago

This is my quantize code

def quantize(build_dir,quant_mode,batchsize):

dset_dir = build_dir + '/dataset' float_model = build_dir + '/float_model' quant_model = build_dir + '/quant_model'

use GPU if available

if (torch.cuda.device_count() > 0): print('You have',torch.cuda.device_count(),'CUDA devices available') for i in range(torch.cuda.device_count()): print(' Device',str(i),': ',torch.cuda.get_device_name(i)) print('Selecting device 0..') device = torch.device('cuda:0') else: print('No CUDA devices available..selecting CPU') device = torch.device('cpu')

load trained model

model = YoloBody([[6, 7, 8], [3, 4, 5], [0, 1, 2]],20,pretrained = False).to(torch.device('cpu')) pre=torch.load('epoch_weights.pth',map_location=torch.device('cpu')) model.load_state_dict(pre)

device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")

weigths = torch.load('epoch_weights.pth',map_location='cpu')

model = weigths['model']

model = model.half().to(device)

force to merge BN with CONV for better quantization accuracy

optimize = 1

override batchsize if in test mode

if (quant_mode=='test'): batchsize = 1

rand_in = torch.randn([batchsize, 3, 416, 416]) quantizer = torch_quantizer(quant_mode, model, (rand_in), output_dir=quant_model) quantized_model = quantizer.quant_model

data loader

train_set = val_dataset

train_loader = torch.utils.data.DataLoader(train_set, batch_size=1, shuffle=False) # , num_workers=8

test_loader = torch.utils.data.DataLoader(train_set, batch_size=batchsize, shuffle=False,collate_fn=yolo_dataset_collate)

test_loader = torch.utils.data.DataLoader(train_set, shuffle = False, batch_size = batchsize, num_workers = 8, pin_memory=True,drop_last=True, collate_fn=yolo_dataset_collate, sampler=None)

evaluate

test(quantized_model, device, test_loader)

export config

if quant_mode == 'calib': quantizer.export_quant_config() if quant_mode == 'test': quantizer.export_xmodel(deploy_check=False, output_dir=quant_model)

return #

This is my log file

PyTorch version : 1.10.1 3.7.12 | packaged by conda-forge | (default, Oct 26 2021, 06:08:53) [GCC 9.4.0]

Command line options: --build_dir : ./build --quant_mode : calib --batchsize : 100

No CUDA devices available..selecting CPU

[VAIQ_WARN]: CUDA is not available, change device to CPU

[VAIQ_NOTE]: Quant config file is empty, use default quant configuration

[VAIQ_NOTE]: Quantization calibration process start up...

[VAIQ_NOTE]: =>Quant Module is in 'cpu'.

[VAIQ_NOTE]: =>Parsing YoloBody...

[VAIQ_NOTE]: Start to trace model...

[VAIQ_NOTE]: Finish tracing.

[VAIQ_NOTE]: Processing ops... ▏ | 1/248 [00:00<00:00, 11554.56it/s, OpInfo: name = YoloBody/DarkNet[backbone]/▍ | 2/248 [00:00<00:00, 3044.87it/s, OpInfo: name = YoloBody/DarkNet[backbone]/B▌ | 3/248 [00:00<00:00, 2932.40it/s, OpInfo: name = YoloBody/DarkNet[backbone]/L▊ | 4/248 [00:00<00:00, 2942.85it/s, OpInfo: name = YoloBody/DarkNet[backbone]/S█ | 5/248 [00:00<00:00, 2965.85it/s, OpInfo: name = YoloBody/DarkNet[backbone]/S█▏ | 6/248 [00:00<00:00, 3052.25it/s, OpInfo: name = YoloBody/DarkNet[backbone]/S█▍ | 7/248 [00:00<00:00, 3282.29it/s, OpInfo: name = YoloBody/DarkNet[backbone]/S█▌ | 8/248 [00:00<00:00, 3171.80it/s, OpInfo: name = YoloBody/DarkNet[backbone]/S█▊ | 9/248 [00:00<00:00, 3224.73it/s, OpInfo: name = YoloBody/DarkNet[backbone]/S██ | 10/248 [00:00<00:00, 3374.88it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██▏ | 11/248 [00:00<00:00, 3364.25it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██▍ | 12/248 [00:00<00:00, 3389.79it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██▌ | 13/248 [00:00<00:00, 3499.29it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██▊ | 14/248 [00:00<00:00, 3398.75it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███ | 15/248 [00:00<00:00, 3376.33it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███▏ | 16/248 [00:00<00:00, 3401.53it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███▍ | 17/248 [00:00<00:00, 3490.80it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███▋ | 18/248 [00:00<00:00, 3479.79it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███▊ | 19/248 [00:00<00:00, 3499.55it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████ | 20/248 [00:00<00:00, 3572.36it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████▏ | 21/248 [00:00<00:00, 3536.51it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████▍ | 22/248 [00:00<00:00, 3544.94it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████▋ | 23/248 [00:00<00:00, 3608.88it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████▊ | 24/248 [00:00<00:00, 3669.56it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████ | 25/248 [00:00<00:00, 3657.27it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████▏ | 26/248 [00:00<00:00, 3667.21it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████▍ | 27/248 [00:00<00:00, 3721.90it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████▋ | 28/248 [00:00<00:00, 3708.37it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████▊ | 29/248 [00:00<00:00, 3695.53it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████ | 30/248 [00:00<00:00, 3739.46it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████▎ | 31/248 [00:00<00:00, 3782.50it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████▍ | 32/248 [00:00<00:00, 3764.35it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████▋ | 33/248 [00:00<00:00, 3768.16it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████▊ | 34/248 [00:00<00:00, 3794.84it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████ | 35/248 [00:00<00:00, 3776.42it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████▎ | 36/248 [00:00<00:00, 3779.41it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████▍ | 37/248 [00:00<00:00, 3818.26it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████▋ | 38/248 [00:00<00:00, 3805.08it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████▊ | 39/248 [00:00<00:00, 3807.32it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████ | 40/248 [00:00<00:00, 3842.61it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████▎ | 41/248 [00:00<00:00, 3878.27it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████▍ | 42/248 [00:00<00:00, 3863.43it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████▋ | 43/248 [00:00<00:00, 3863.56it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████▊ | 44/248 [00:00<00:00, 3895.17it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████ | 45/248 [00:00<00:00, 3881.38it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████▎ | 46/248 [00:00<00:00, 3865.49it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████▍ | 47/248 [00:00<00:00, 3889.98it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████▋ | 48/248 [00:00<00:00, 3918.69it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████▉ | 49/248 [00:00<00:00, 3904.64it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████ | 50/248 [00:00<00:00, 3904.51it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████▎ | 51/248 [00:00<00:00, 3931.29it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████▍ | 52/248 [00:00<00:00, 3917.94it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████▋ | 53/248 [00:00<00:00, 3917.01it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████▉ | 54/248 [00:00<00:00, 3939.41it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████ | 55/248 [00:00<00:00, 3960.36it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████▎ | 56/248 [00:00<00:00, 3946.78it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████▍ | 57/248 [00:00<00:00, 3945.20it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████▋ | 58/248 [00:00<00:00, 3967.34it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████▉ | 59/248 [00:00<00:00, 3944.78it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████ | 60/248 [00:00<00:00, 3940.23it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████▎ | 61/248 [00:00<00:00, 3961.06it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████▌ | 62/248 [00:00<00:00, 3982.89it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████▋ | 63/248 [00:00<00:00, 3969.31it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████▉ | 64/248 [00:00<00:00, 3967.12it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████ | 65/248 [00:00<00:00, 3986.40it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████▎ | 66/248 [00:00<00:00, 3974.62it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████▌ | 67/248 [00:00<00:00, 3973.62it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████▋ | 68/248 [00:00<00:00, 3993.23it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████▉ | 69/248 [00:00<00:00, 4012.85it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████ | 70/248 [00:00<00:00, 4000.84it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████▎ | 71/248 [00:00<00:00, 3989.65it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████▌ | 72/248 [00:00<00:00, 4005.86it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████▋ | 73/248 [00:00<00:00, 3993.12it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████▉ | 74/248 [00:00<00:00, 3979.31it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████ | 75/248 [00:00<00:00, 3993.21it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████▎ | 76/248 [00:00<00:00, 4007.73it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████▌ | 77/248 [00:00<00:00, 3992.01it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████▋ | 78/248 [00:00<00:00, 3985.18it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████▉ | 79/248 [00:00<00:00, 3996.50it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████████▏ | 80/248 [00:00<00:00, 3980.60it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████████▎ | 81/248 [00:00<00:00, 3976.11it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████████▌ | 82/248 [00:00<00:00, 3990.45it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████████▋ | 83/248 [00:00<00:00, 4005.56it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████████▉ | 84/248 [00:00<00:00, 3928.17it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████████▏ | 85/248 [00:00<00:00, 3920.34it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████████▎ | 86/248 [00:00<00:00, 3933.07it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████████▌ | 87/248 [00:00<00:00, 3921.26it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████████▋ | 88/248 [00:00<00:00, 3918.62it/s, OpInfo: name = YoloBody/DarkNet[backbone]/█████████████████▉ | 89/248 [00:00<00:00, 3931.59it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████████▏ | 90/248 [00:00<00:00, 3944.16it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████████▎ | 91/248 [00:00<00:00, 3934.29it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████████▌ | 92/248 [00:00<00:00, 3932.33it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████████▊ | 93/248 [00:00<00:00, 3945.76it/s, OpInfo: name = YoloBody/DarkNet[backbone]/██████████████████▉ | 94/248 [00:00<00:00, 3933.76it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████████▏ | 95/248 [00:00<00:00, 3930.54it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████████▎ | 96/248 [00:00<00:00, 3943.33it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████████▌ | 97/248 [00:00<00:00, 3923.24it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████████▊ | 98/248 [00:00<00:00, 3917.93it/s, OpInfo: name = YoloBody/DarkNet[backbone]/███████████████████▉ | 99/248 [00:00<00:00, 3929.48it/s, OpInfo: name = YoloBody/DarkNet[backbone]/████████████████████▏ | 100/248 [00:00<00:00, 3941.01it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████▎ | 101/248 [00:00<00:00, 3932.10it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████▌ | 102/248 [00:00<00:00, 3927.14it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████▊ | 103/248 [00:00<00:00, 3938.89it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████▉ | 104/248 [00:00<00:00, 3930.12it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████▏ | 105/248 [00:00<00:00, 3926.76it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████▎ | 106/248 [00:00<00:00, 3937.51it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████▌ | 107/248 [00:00<00:00, 3949.72it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████▊ | 108/248 [00:00<00:00, 3941.81it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████▉ | 109/248 [00:00<00:00, 3933.13it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████▏ | 110/248 [00:00<00:00, 3942.59it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████▍ | 111/248 [00:00<00:00, 3933.92it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████▌ | 112/248 [00:00<00:00, 3931.26it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████▊ | 113/248 [00:00<00:00, 3941.26it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████▉ | 114/248 [00:00<00:00, 3951.72it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████▏ | 115/248 [00:00<00:00, 3944.53it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████▍ | 116/248 [00:00<00:00, 3943.52it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████▌ | 117/248 [00:00<00:00, 3955.39it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████▊ | 118/248 [00:00<00:00, 3949.19it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████▉ | 119/248 [00:00<00:00, 3947.69it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████▏ | 120/248 [00:00<00:00, 3959.29it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████▍ | 121/248 [00:00<00:00, 3967.04it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████▌ | 122/248 [00:00<00:00, 3954.54it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████▊ | 123/248 [00:00<00:00, 3951.31it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████ | 124/248 [00:00<00:00, 3961.41it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████▏ | 125/248 [00:00<00:00, 3954.06it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████▍ | 126/248 [00:00<00:00, 3950.94it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████▌ | 127/248 [00:00<00:00, 3961.13it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████▊ | 128/248 [00:00<00:00, 3971.50it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████ | 129/248 [00:00<00:00, 3964.57it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████▏ | 130/248 [00:00<00:00, 3963.05it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████▍ | 131/248 [00:00<00:00, 3973.46it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████▌ | 132/248 [00:00<00:00, 3967.47it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████▊ | 133/248 [00:00<00:00, 3962.17it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████ | 134/248 [00:00<00:00, 3971.57it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████▏ | 135/248 [00:00<00:00, 3981.37it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████▍ | 136/248 [00:00<00:00, 3975.06it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████▌ | 137/248 [00:00<00:00, 3972.35it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████▊ | 138/248 [00:00<00:00, 3979.94it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████ | 139/248 [00:00<00:00, 3968.63it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████▏ | 140/248 [00:00<00:00, 3964.77it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████▍ | 141/248 [00:00<00:00, 3971.43it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████▋ | 142/248 [00:00<00:00, 3978.72it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████▊ | 143/248 [00:00<00:00, 3970.91it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████ | 144/248 [00:00<00:00, 3964.16it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████▏ | 145/248 [00:00<00:00, 3971.70it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████▍ | 146/248 [00:00<00:00, 3959.60it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████▋ | 147/248 [00:00<00:00, 3955.55it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████▊ | 148/248 [00:00<00:00, 3962.32it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████ | 149/248 [00:00<00:00, 3969.66it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████▏ | 150/248 [00:00<00:00, 3962.72it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████▍ | 151/248 [00:00<00:00, 3959.88it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████▋ | 152/248 [00:00<00:00, 3967.23it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████▊ | 153/248 [00:00<00:00, 3957.50it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████ | 154/248 [00:00<00:00, 3954.37it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████▎ | 155/248 [00:00<00:00, 3961.62it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████▍ | 156/248 [00:00<00:00, 3953.26it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████▋ | 157/248 [00:00<00:00, 3949.46it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████▊ | 158/248 [00:00<00:00, 3956.23it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████████ | 159/248 [00:00<00:00, 3959.64it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████████▎ | 160/248 [00:00<00:00, 3948.25it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████████▍ | 161/248 [00:00<00:00, 3944.71it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████████▋ | 162/248 [00:00<00:00, 3951.23it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████████▊ | 163/248 [00:00<00:00, 3944.29it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████████ | 164/248 [00:00<00:00, 3939.87it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████████▎ | 165/248 [00:00<00:00, 3945.97it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████████▍ | 166/248 [00:00<00:00, 3951.95it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████████▋ | 167/248 [00:00<00:00, 3945.21it/s, OpInfo: name = YoloBody/DarkNet[backbone]█████████████████████████████████▊ | 168/248 [00:00<00:00, 3941.90it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████████ | 169/248 [00:00<00:00, 3948.32it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████████▎ | 170/248 [00:00<00:00, 3940.90it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████████▍ | 171/248 [00:00<00:00, 3931.97it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████████▋ | 172/248 [00:00<00:00, 3936.90it/s, OpInfo: name = YoloBody/DarkNet[backbone]██████████████████████████████████▉ | 173/248 [00:00<00:00, 3942.27it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████████ | 174/248 [00:00<00:00, 3935.19it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████████▎ | 175/248 [00:00<00:00, 3932.53it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████████▍ | 176/248 [00:00<00:00, 3938.82it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████████▋ | 177/248 [00:00<00:00, 3929.70it/s, OpInfo: name = YoloBody/DarkNet[backbone]███████████████████████████████████▉ | 178/248 [00:00<00:00, 3926.26it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████████████ | 179/248 [00:00<00:00, 3932.19it/s, OpInfo: name = YoloBody/DarkNet[backbone]████████████████████████████████████▎ | 180/248 [00:00<00:00, 3937.98it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████▍ | 181/248 [00:00<00:00, 3931.20it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████▋ | 182/248 [00:00<00:00, 3929.33it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████▉ | 183/248 [00:00<00:00, 3936.39it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████ | 184/248 [00:00<00:00, 3927.81it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████▎ | 185/248 [00:00<00:00, 3925.38it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████▌ | 186/248 [00:00<00:00, 3929.05it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████▋ | 187/248 [00:00<00:00, 3924.09it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████▉ | 188/248 [00:00<00:00, 3921.61it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████ | 189/248 [00:00<00:00, 3927.23it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████▎ | 190/248 [00:00<00:00, 3922.32it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████▌ | 191/248 [00:00<00:00, 3919.68it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████▋ | 192/248 [00:00<00:00, 3925.85it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████▉ | 193/248 [00:00<00:00, 3920.69it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████ | 194/248 [00:00<00:00, 3919.10it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████▎ | 195/248 [00:00<00:00, 3925.55it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████▌ | 196/248 [00:00<00:00, 3916.94it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████▋ | 197/248 [00:00<00:00, 3913.82it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████▉ | 198/248 [00:00<00:00, 3917.78it/s, OpInfo: name = YoloBody/Conv2d[last_layer████████████████████████████████████████ | 199/248 [00:00<00:00, 3912.63it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████▎ | 200/248 [00:00<00:00, 3907.53it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████▌ | 201/248 [00:00<00:00, 3904.84it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████▋ | 202/248 [00:00<00:00, 3910.23it/s, OpInfo: name = YoloBody/Upsample[last_lay████████████████████████████████████████▉ | 203/248 [00:00<00:00, 3897.61it/s, OpInfo: name = YoloBody/input.357, type =█████████████████████████████████████████▏ | 204/248 [00:00<00:00, 3885.33it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████▎ | 205/248 [00:00<00:00, 3879.22it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████▌ | 206/248 [00:00<00:00, 3876.64it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████▋ | 207/248 [00:00<00:00, 3878.24it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████▉ | 208/248 [00:00<00:00, 3873.49it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████▏ | 209/248 [00:00<00:00, 3871.93it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████▎ | 210/248 [00:00<00:00, 3878.16it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████▌ | 211/248 [00:00<00:00, 3873.70it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████▋ | 212/248 [00:00<00:00, 3871.49it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████▉ | 213/248 [00:00<00:00, 3877.46it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████▏ | 214/248 [00:00<00:00, 3873.37it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████▎ | 215/248 [00:00<00:00, 3871.94it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████▌ | 216/248 [00:00<00:00, 3877.40it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████▊ | 217/248 [00:00<00:00, 3872.28it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████▉ | 218/248 [00:00<00:00, 3868.02it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████▏ | 219/248 [00:00<00:00, 3873.07it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████▎ | 220/248 [00:00<00:00, 3867.01it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████▌ | 221/248 [00:00<00:00, 3864.88it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████▊ | 222/248 [00:00<00:00, 3870.02it/s, OpInfo: name = YoloBody/Conv2d[last_layer████████████████████████████████████████████▉ | 223/248 [00:00<00:00, 3865.83it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████████▏ | 224/248 [00:00<00:00, 3861.76it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████████▎ | 225/248 [00:00<00:00, 3858.68it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████████▌ | 226/248 [00:00<00:00, 3863.80it/s, OpInfo: name = YoloBody/Upsample[last_lay█████████████████████████████████████████████▊ | 227/248 [00:00<00:00, 3865.18it/s, OpInfo: name = YoloBody/input.401, type =█████████████████████████████████████████████▉ | 228/248 [00:00<00:00, 3869.46it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████████▏ | 229/248 [00:00<00:00, 3865.14it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████████▎ | 230/248 [00:00<00:00, 3839.32it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████████▌ | 231/248 [00:00<00:00, 3842.95it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████████▊ | 232/248 [00:00<00:00, 3838.51it/s, OpInfo: name = YoloBody/Sequential[last_l██████████████████████████████████████████████▉ | 233/248 [00:00<00:00, 3835.98it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████████▏ | 234/248 [00:00<00:00, 3840.76it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████████▍ | 235/248 [00:00<00:00, 3836.86it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████████▌ | 236/248 [00:00<00:00, 3835.36it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████████▊ | 237/248 [00:00<00:00, 3840.31it/s, OpInfo: name = YoloBody/Sequential[last_l███████████████████████████████████████████████▉ | 238/248 [00:00<00:00, 3836.79it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████████▏ | 239/248 [00:00<00:00, 3835.07it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████████▍ | 240/248 [00:00<00:00, 3840.01it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████████▌ | 241/248 [00:00<00:00, 3834.28it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████████▊ | 242/248 [00:00<00:00, 3832.37it/s, OpInfo: name = YoloBody/Sequential[last_l████████████████████████████████████████████████▉ | 243/248 [00:00<00:00, 3837.02it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████████████▏| 244/248 [00:00<00:00, 3833.23it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████████████▍| 245/248 [00:00<00:00, 3831.40it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████████████▌| 246/248 [00:00<00:00, 3835.94it/s, OpInfo: name = YoloBody/Sequential[last_l█████████████████████████████████████████████████▊| 247/248 [00:00<00:00, 3832.53it/s, OpInfo: name = return_0, type = Return] ██████████████████████████████████████████████████| 248/248 [00:00<00:00, 3841.77it/s, OpInfo: name = return_0, type = Return]

[VAIQ_NOTE]: =>Doing weights equalization...

[VAIQ_NOTE]: =>Quantizable module is generated.(./build/quant_model/YoloBody.py)

[VAIQ_NOTE]: =>Get module with quantization.

[VAIQ_NOTE]: =>Exporting quant config.(./build/quant_model/quant_info.json)

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::input_0 type: input

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Conv2d[conv1]/input.3 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer1]/Conv2d[ds_conv]/input.9 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer1]/BasicBlock[residual_0]/Conv2d[conv1]/input.15 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer1]/BasicBlock[residual_0]/Conv2d[conv2]/input.21 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer1]/BasicBlock[residual_0]/input.25 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer2]/Conv2d[ds_conv]/input.27 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer2]/BasicBlock[residual_0]/Conv2d[conv1]/input.33 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer2]/BasicBlock[residual_0]/Conv2d[conv2]/input.39 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer2]/BasicBlock[residual_0]/input.43 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer2]/BasicBlock[residual_1]/Conv2d[conv1]/input.45 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer2]/BasicBlock[residual_1]/Conv2d[conv2]/input.51 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer2]/BasicBlock[residual_1]/input.55 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/Conv2d[ds_conv]/input.57 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_0]/Conv2d[conv1]/input.63 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_0]/Conv2d[conv2]/input.69 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_0]/input.73 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_1]/Conv2d[conv1]/input.75 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_1]/Conv2d[conv2]/input.81 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_1]/input.85 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_2]/Conv2d[conv1]/input.87 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_2]/Conv2d[conv2]/input.93 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_2]/input.97 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_3]/Conv2d[conv1]/input.99 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_3]/Conv2d[conv2]/input.105 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_3]/input.109 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_4]/Conv2d[conv1]/input.111 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_4]/Conv2d[conv2]/input.117 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_4]/input.121 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_5]/Conv2d[conv1]/input.123 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_5]/Conv2d[conv2]/input.129 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_5]/input.133 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_6]/Conv2d[conv1]/input.135 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_6]/Conv2d[conv2]/input.141 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_6]/input.145 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_7]/Conv2d[conv1]/input.147 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_7]/Conv2d[conv2]/input.153 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer3]/BasicBlock[residual_7]/input.157 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/Conv2d[ds_conv]/input.159 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_0]/Conv2d[conv1]/input.165 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_0]/Conv2d[conv2]/input.171 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_0]/input.175 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_1]/Conv2d[conv1]/input.177 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_1]/Conv2d[conv2]/input.183 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_1]/input.187 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_2]/Conv2d[conv1]/input.189 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_2]/Conv2d[conv2]/input.195 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_2]/input.199 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_3]/Conv2d[conv1]/input.201 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_3]/Conv2d[conv2]/input.207 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_3]/input.211 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_4]/Conv2d[conv1]/input.213 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_4]/Conv2d[conv2]/input.219 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_4]/input.223 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_5]/Conv2d[conv1]/input.225 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_5]/Conv2d[conv2]/input.231 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_5]/input.235 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_6]/Conv2d[conv1]/input.237 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_6]/Conv2d[conv2]/input.243 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_6]/input.247 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_7]/Conv2d[conv1]/input.249 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_7]/Conv2d[conv2]/input.255 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer4]/BasicBlock[residual_7]/input.259 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/Conv2d[ds_conv]/input.261 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_0]/Conv2d[conv1]/input.267 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_0]/Conv2d[conv2]/input.273 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_0]/input.277 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_1]/Conv2d[conv1]/input.279 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_1]/Conv2d[conv2]/input.285 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_1]/input.289 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_2]/Conv2d[conv1]/input.291 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_2]/Conv2d[conv2]/input.297 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_2]/input.301 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_3]/Conv2d[conv1]/input.303 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_3]/Conv2d[conv2]/input.309 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/DarkNet[backbone]/Sequential[layer5]/BasicBlock[residual_3]/input.313 type: elemwise_add

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer0]/Sequential[0]/Conv2d[conv]/input.315 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer0]/Sequential[1]/Conv2d[conv]/input.321 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer0]/Sequential[2]/Conv2d[conv]/input.327 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer0]/Sequential[3]/Conv2d[conv]/input.333 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer0]/Sequential[4]/Conv2d[conv]/input.339 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer0]/Sequential[5]/Conv2d[conv]/input.345 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Conv2d[last_layer0]/Conv2d[6]/12195 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer1_conv]/Conv2d[conv]/input.351 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Upsample[last_layer1_upsample]/12227 type: resize

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/input.357 type: concat

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer1]/Sequential[0]/Conv2d[conv]/input.359 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer1]/Sequential[1]/Conv2d[conv]/input.365 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer1]/Sequential[2]/Conv2d[conv]/input.371 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer1]/Sequential[3]/Conv2d[conv]/input.377 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer1]/Sequential[4]/Conv2d[conv]/input.383 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer1]/Sequential[5]/Conv2d[conv]/input.389 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Conv2d[last_layer1]/Conv2d[6]/12411 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2_conv]/Conv2d[conv]/input.395 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Upsample[last_layer2_upsample]/12443 type: resize

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/input.401 type: concat

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2]/Sequential[0]/Conv2d[conv]/input.403 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2]/Sequential[1]/Conv2d[conv]/input.409 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2]/Sequential[2]/Conv2d[conv]/input.415 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2]/Sequential[3]/Conv2d[conv]/input.421 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2]/Sequential[4]/Conv2d[conv]/input.427 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2]/Sequential[5]/Conv2d[conv]/input.433 type: conv2d

[VAIQ_WARN]: Node ouptut tensor is not quantized: YoloBody::YoloBody/Sequential[last_layer2]/Conv2d[6]/12627 type: conv2d

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer1.ds_conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer1.ds_conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer1.residual_0.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer1.residual_0.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer1.residual_0.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer1.residual_0.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.ds_conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.ds_conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_0.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_0.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_0.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_0.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_1.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_1.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_1.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer2.residual_1.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.ds_conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.ds_conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_0.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_0.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_0.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_0.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_1.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_1.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_1.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_1.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_2.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_2.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_2.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_2.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_3.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_3.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_3.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_3.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_4.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_4.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_4.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_4.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_5.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_5.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_5.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_5.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_6.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_6.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_6.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_6.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_7.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_7.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_7.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer3.residual_7.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.ds_conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.ds_conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_0.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_0.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_0.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_0.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_1.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_1.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_1.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_1.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_2.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_2.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_2.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_2.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_3.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_3.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_3.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_3.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_4.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_4.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_4.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_4.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_5.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_5.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_5.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_5.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_6.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_6.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_6.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_6.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_7.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_7.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_7.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer4.residual_7.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.ds_conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.ds_conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_0.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_0.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_0.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_0.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_1.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_1.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_1.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_1.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_2.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_2.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_2.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_2.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_3.conv1.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_3.conv1.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_3.conv2.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::backbone.layer5.residual_3.conv2.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.0.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.0.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.1.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.1.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.2.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.2.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.3.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.3.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.4.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.4.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.5.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.5.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.6.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer0.6.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1_conv.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1_conv.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.0.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.0.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.1.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.1.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.2.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.2.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.3.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.3.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.4.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.4.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.5.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.5.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.6.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer1.6.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2_conv.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2_conv.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.0.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.0.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.1.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.1.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.2.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.2.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.3.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.3.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.4.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.4.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.5.conv.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.5.conv.bias

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.6.weight

[VAIQ_WARN]: Parameter tensor is not quantized: YoloBody::last_layer2.6.bias

[VAIQ_WARN]: Quantization is not performed completely, check if model inference function is called!!!

How to slove it? Thanks for all

cpracticer commented 2 years ago

this code was modified by code of https://github.com/Xilinx/Vitis-AI-Tutorials/tree/1.4/Design_Tutorials/09-mnist_pyt it's calib quant_mode

niuxjxlnx commented 2 years ago

@cpracticer ,

The reason to report this message is the quantizer.quant_model was not inferenced with your dataloader. Without inference, quantizer.quant_model is not a quantized model in which all tensors are quantized.

You should inference quantizer.quant_model with code: test(quantizer.quant_model, device, test_loader)

cpracticer commented 2 years ago

Thanks!As you said，I need to do like use model=quantizer output=model(testloader), It will quantize my model. I have solved it! Thanks again

gaoxinghua951 commented 1 year ago

Hello, how did you solve it? I had the same problem as you when quantifying yolox

cpracticer commented 1 year ago

hello,dear gaoxinghua951,the main reason for this problem is that you didn't do 'test'.Please refer Vitis-AI-tutorials-->09 minit_pyt-->common.py--> test

def test(model, device, test_loader): ''' test the model ''' model.eval() test_loss = 0 correct = 0 with torch.no_grad(): for data, target in test_loader: data, target = data.to(device), target.to(device) output = model(data) pred = output.argmax(dim=1, keepdim=True) correct += pred.eq(target.view_as(pred)).sum().item()

acc = 100. * correct / len(test_loader.dataset)
print('\nTest set: Accuracy: {}/{} ({:.2f}%)\n'.format(correct, len(test_loader.dataset), acc))

return

there is a step "output=model(data)" is critical. Best

gaoxinghua951 commented 1 year ago

Thank you for your reply! I am using the official 2.5 version of yolox quantization code, is there a problem with the official code?

cpracticer commented 1 year ago

The steps of Vitis AI Quantization is similar,but different Vitis AI version is incompatible, you can have a try.I didn't use Vitis AI 2.5. Best

gaoxinghua951 commented 1 year ago

Vitis AI 量化的步骤类似，但不同的 Vitis AI 版本不兼容，可以试一试。我没有使用Vitis AI 2.5。最好

Thank you very much for your reply. I think I have found a solution according to your prompt!

Xilinx / Vitis-AI

Quantinized with VITIS AI for yolov3 model generated quant_info with all null #1071

This is my quantize code

use GPU if available

load trained model

device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")

weigths = torch.load('epoch_weights.pth',map_location='cpu')

model = weigths['model']

model = model.half().to(device)

force to merge BN with CONV for better quantization accuracy

override batchsize if in test mode

data loader

train_loader = torch.utils.data.DataLoader(train_set, batch_size=1, shuffle=False) # , num_workers=8

test_loader = torch.utils.data.DataLoader(train_set, batch_size=batchsize, shuffle=False,collate_fn=yolo_dataset_collate)

evaluate

test(quantized_model, device, test_loader)

export config

This is my log file

PyTorch version : 1.10.1 3.7.12 | packaged by conda-forge | (default, Oct 26 2021, 06:08:53) [GCC 9.4.0]

Command line options: --build_dir : ./build --quant_mode : calib --batchsize : 100

How to slove it? Thanks for all