Closed andreivicol closed 2 months ago
You've chosen to report an unexpected problem or bug. Unless you already know the root cause of it, please include details about it by filling the issue template. The following information is missing: "Instructions To Reproduce the Issue and Full Logs";
Requested information was not provided in 7 days, so we're closing this issue.
Please open new issue if information becomes available. Otherwise, use github discussions for free-form discussions.
I'm trying to train detectron2 for object detection on a custom dataset consisting of 2000 480 x 352 plant images. The dataset is in COCO format. I've run object detection training on YOLOv8 using the same dataset with a time of 7 minutes per epoch on CPU and about 2 minutes per epoch using MPS.
However, on detectron2 I'm seeing incredibly long training times on CPU and cannot get it to work on GPU. Any advice would be welcome. I'd really like to not have to switch to a Windows machine for this, if possible.
I suspect this might be a configuration issue.
Full runnable code or full changes you made:
I'm training in PyCharm.
[04/17 13:23:04 d2.utils.events]: eta: 7 days, 6:13:20 iter: 19 total_loss: 1.87 loss_cls: 0.7303 loss_box_reg: 0.8469 loss_rpn_cls: 0.2471 loss_rpn_loc: 0.03693 time: 7.0937 last_time: 6.1614 data_time: 0.1178 last_data_time: 0.0017 lr: 3.8962e-06
[04/17 13:25:31 d2.utils.events]: eta: 7 days, 22:27:45 iter: 39 total_loss: 1.832 loss_cls: 0.6939 loss_box_reg: 0.8942 loss_rpn_cls: 0.2154 loss_rpn_loc: 0.03777 time: 7.2422 last_time: 8.3476 data_time: 0.0015 last_data_time: 0.0014 lr: 7.8922e-06
Name Version Build Channel
absl-py 2.1.0 pypi_0 pypi antlr4-python3-runtime 4.9.3 pypi_0 pypi black 24.4.0 pypi_0 pypi blas 1.0 openblas
brotli-python 1.0.9 py312h313beb8_7
bzip2 1.0.8 h80987f9_5
ca-certificates 2024.3.11 hca03da5_0
certifi 2024.2.2 py312hca03da5_0
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 8.1.7 pypi_0 pypi cloudpickle 3.0.0 pypi_0 pypi contourpy 1.2.1 pypi_0 pypi cycler 0.12.1 pypi_0 pypi detectron2 0.6 pypi_0 pypi expat 2.5.0 h313beb8_0
filelock 3.13.1 py312hca03da5_0
fonttools 4.51.0 pypi_0 pypi freetype 2.12.1 h1192e45_0
fvcore 0.1.5.post20221221 pypi_0 pypi grpcio 1.62.1 pypi_0 pypi hydra-core 1.3.2 pypi_0 pypi idna 3.4 py312hca03da5_0
iopath 0.1.9 pypi_0 pypi jinja2 3.1.3 py312hca03da5_0
jpeg 9e h80987f9_1
kiwisolver 1.4.5 pypi_0 pypi lcms2 2.12 hba8e193_0
lerc 3.0 hc377ac9_0
libcxx 14.0.6 h848a8c0_0
libdeflate 1.17 h80987f9_1
libffi 3.4.4 hca03da5_0
libgfortran 5.0.0 11_3_0_hca03da5_28
libgfortran5 11.3.0 h009349e_28
libjpeg-turbo 2.0.0 h1a28f6b_0
libopenblas 0.3.21 h269037a_0
libpng 1.6.39 h80987f9_0
libtiff 4.5.1 h313beb8_0
libwebp-base 1.3.2 h80987f9_0
llvm-openmp 14.0.6 hc6e5704_0
lz4-c 1.9.4 h313beb8_0
markdown 3.6 pypi_0 pypi markupsafe 2.1.3 py312h80987f9_0
matplotlib 3.8.4 pypi_0 pypi mpmath 1.3.0 py312hca03da5_0
mypy-extensions 1.0.0 pypi_0 pypi ncurses 6.4 h313beb8_0
networkx 3.1 py312hca03da5_0
numpy 1.26.4 py312h7f4fdc5_0
numpy-base 1.26.4 py312he047099_0
omegaconf 2.3.0 pypi_0 pypi opencv-python 4.9.0.80 pypi_0 pypi openjpeg 2.3.0 h7a6adac_2
openssl 3.0.13 h1a28f6b_0
packaging 24.0 pypi_0 pypi pathspec 0.12.1 pypi_0 pypi pillow 10.2.0 py312h80987f9_0
pip 23.3.1 py312hca03da5_0
platformdirs 4.2.0 pypi_0 pypi portalocker 2.8.2 pypi_0 pypi protobuf 5.26.1 pypi_0 pypi pycocotools 2.0.7 pypi_0 pypi pyparsing 3.1.2 pypi_0 pypi pysocks 1.7.1 py312hca03da5_0
python 3.12.2 h99e199e_0
python-dateutil 2.9.0.post0 pypi_0 pypi pytorch 2.2.2 py3.12_0 pytorch pyyaml 6.0.1 py312h80987f9_0
readline 8.2 h1a28f6b_0
requests 2.31.0 py312hca03da5_1
setuptools 68.2.2 py312hca03da5_0
six 1.16.0 pypi_0 pypi sqlite 3.41.2 h80987f9_0
sympy 1.12 py312hca03da5_0
tabulate 0.9.0 pypi_0 pypi tensorboard 2.16.2 pypi_0 pypi tensorboard-data-server 0.7.2 pypi_0 pypi termcolor 2.4.0 pypi_0 pypi tk 8.6.12 hb8d0fd4_0
torchaudio 2.2.2 py312_cpu pytorch torchvision 0.17.2 py312_cpu pytorch tqdm 4.66.2 pypi_0 pypi typing_extensions 4.9.0 py312hca03da5_1
tzdata 2024a h04d1e81_0
urllib3 2.1.0 py312hca03da5_1
werkzeug 3.0.2 pypi_0 pypi wheel 0.41.2 py312hca03da5_0
xz 5.4.6 h80987f9_0
yacs 0.1.8 pypi_0 pypi yaml 0.2.5 h1a28f6b_0
zlib 1.2.13 h5a0b063_0
zstd 1.5.5 hd90d995_0