I use RTMDet-s as teacher and RTMDet-tiny as student to reproduce the giving distillation algorithm. But the RTMDet distillation algorithm cannot reproduce the accuracy of coco/bbox_mAP: 0.41 on coco dataset , I can only achieve coco/bbox_mAP: 0.40 , which is 1 percentage points different from the official result. The only modification I made was to change the batch from 32 to 20, what is the reason?
Environment
NVCC: Cuda compilation tools, release 11.0, V11.0.221
GCC: gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-44)
PyTorch: 1.12.0
PyTorch compiling details: PyTorch built with:
GCC 7.3
C++ Version: 201402
Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
Prerequisite
🐞 Describe the bug
I use RTMDet-s as teacher and RTMDet-tiny as student to reproduce the giving distillation algorithm. But the RTMDet distillation algorithm cannot reproduce the accuracy of coco/bbox_mAP: 0.41 on coco dataset , I can only achieve coco/bbox_mAP: 0.40 , which is 1 percentage points different from the official result. The only modification I made was to change the batch from 32 to 20, what is the reason?
Environment
NVCC: Cuda compilation tools, release 11.0, V11.0.221 GCC: gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-44) PyTorch: 1.12.0 PyTorch compiling details: PyTorch built with:
TorchVision: 0.13.0 OpenCV: 4.7.0 MMEngine: 0.7.2 MMCV: 2.0.0 MMDetection: 3.0.0 MMYOLO: 0.5.0+dc85144
Additional information
No response