search

timmeinhardt / trackformer

Implementation of "TrackFormer: Multi-Object Tracking with Transformers”. [Conference on Computer Vision and Pattern Recognition (CVPR), 2022]
https://arxiv.org/abs/2101.02702
Apache License 2.0
487 stars 113 forks source link

ERROR : ValueError: numpy.ndarray has the wrong size, try recompiling. Expected 80, got 88 #77

Closed GodIsBoom closed 1 year ago

GodIsBoom commented 1 year ago

my environment:

# packages in environment at /fastdeploy/my_soft/anaconda3/envs/tformer:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
_openmp_mutex             5.1                       1_gnu  
argon2-cffi               20.1.0                   pypi_0    pypi
astroid                   2.4.2                    pypi_0    pypi
async-generator           1.10                     pypi_0    pypi
attrs                     19.3.0                   pypi_0    pypi
backcall                  0.2.0                    pypi_0    pypi
blas                      1.0                    openblas  
bleach                    3.2.3                    pypi_0    pypi
bzip2                     1.0.8                h7f98852_4    conda-forge
ca-certificates           2023.01.10           h06a4308_0  
certifi                   2020.4.5.2               pypi_0    pypi
cffi                      1.14.4                   pypi_0    pypi
chardet                   3.0.4                    pypi_0    pypi
cloudpickle               1.6.0                    pypi_0    pypi
cmake                     3.25.2                   pypi_0    pypi
colorama                  0.4.3                    pypi_0    pypi
cpuonly                   1.0                           0    pytorch
cudatoolkit               11.3.1              h9edb442_10    conda-forge
cycler                    0.10.0                   pypi_0    pypi
cython                    0.29.20                  pypi_0    pypi
decorator                 4.4.2                    pypi_0    pypi
defusedxml                0.6.0                    pypi_0    pypi
docopt                    0.6.2                    pypi_0    pypi
entrypoints               0.3                      pypi_0    pypi
ffmpeg                    4.0.2                ha0c5888_2    conda-forge
filelock                  3.0.12                   pypi_0    pypi
flake8                    3.8.3                    pypi_0    pypi
flake8-import-order       0.18.1                   pypi_0    pypi
fonttools                 4.38.0                   pypi_0    pypi
freetype                  2.10.4               h0708190_1    conda-forge
future                    0.18.2                   pypi_0    pypi
gdown                     3.12.2                   pypi_0    pypi
gitdb                     4.0.5                    pypi_0    pypi
gitpython                 3.1.3                    pypi_0    pypi
gmp                       6.1.2             hf484d3e_1000    conda-forge
gnutls                    3.5.19               h2a4e5f8_1    conda-forge
idna                      2.9                      pypi_0    pypi
imageio                   2.8.0                    pypi_0    pypi
importlib-metadata        1.6.1                    pypi_0    pypi
intel-openmp              2021.4.0          h06a4308_3561  
ipykernel                 5.4.3                    pypi_0    pypi
ipython                   7.19.0                   pypi_0    pypi
ipython-genutils          0.2.0                    pypi_0    pypi
ipywidgets                7.6.3                    pypi_0    pypi
isort                     5.6.4                    pypi_0    pypi
jedi                      0.18.0                   pypi_0    pypi
jinja2                    2.11.2                   pypi_0    pypi
jpeg                      9b                   h024ee3a_2  
jsonpatch                 1.25                     pypi_0    pypi
jsonpickle                1.4.1                    pypi_0    pypi
jsonpointer               2.0                      pypi_0    pypi
jsonschema                3.2.0                    pypi_0    pypi
jupyter                   1.0.0                    pypi_0    pypi
jupyter-client            6.1.11                   pypi_0    pypi
jupyter-console           6.2.0                    pypi_0    pypi
jupyter-core              4.7.0                    pypi_0    pypi
jupyterlab-pygments       0.1.2                    pypi_0    pypi
jupyterlab-widgets        1.0.0                    pypi_0    pypi
kiwisolver                1.2.0                    pypi_0    pypi
lame                      3.100             h7f98852_1001    conda-forge
lap                       0.4.0                    pypi_0    pypi
lapsolver                 1.1.0                    pypi_0    pypi
lazy-object-proxy         1.4.3                    pypi_0    pypi
ld_impl_linux-64          2.38                 h1181459_1  
libffi                    3.4.2                h6a678d5_6  
libgcc-ng                 11.2.0               h1234567_1  
libgfortran-ng            7.5.0               ha8ba4b0_17  
libgfortran4              7.5.0               ha8ba4b0_17  
libgomp                   11.2.0               h1234567_1  
libiconv                  1.17                 h166bdaf_0    conda-forge
libopenblas               0.3.18               hf726d26_0  
libopus                   1.3.1                h7b6447c_0  
libpng                    1.6.37               h21135ba_2    conda-forge
libstdcxx-ng              11.2.0               h1234567_1  
libtiff                   4.0.9                he6b73bb_1    conda-forge
libuv                     1.43.0               h7f98852_0    conda-forge
libvpx                    1.7.0                h439df22_0  
markupsafe                1.1.1                    pypi_0    pypi
matplotlib                3.2.1                    pypi_0    pypi
mccabe                    0.6.1                    pypi_0    pypi
mistune                   0.8.4                    pypi_0    pypi
mkl                       2021.4.0           h06a4308_640  
mkl-service               2.4.0            py37h402132d_0    conda-forge
more-itertools            8.4.0                    pypi_0    pypi
motmetrics                1.2.0                    pypi_0    pypi
multiscaledeformableattention 1.0                      pypi_0    pypi
munch                     2.5.0                    pypi_0    pypi
nbclient                  0.5.1                    pypi_0    pypi
nbconvert                 6.0.7                    pypi_0    pypi
nbformat                  5.1.2                    pypi_0    pypi
ncurses                   6.4                  h6a678d5_0  
nest-asyncio              1.5.1                    pypi_0    pypi
nettle                    3.3                           0    conda-forge
networkx                  2.4                      pypi_0    pypi
ninja                     1.10.0.post2             pypi_0    pypi
notebook                  6.2.0                    pypi_0    pypi
numpy                     1.18.5           py37h7130bb8_0  
numpy-base                1.18.5           py37h2f8d375_0  
olefile                   0.46               pyh9f0ad1d_1    conda-forge
opencv-python             4.2.0.34                 pypi_0    pypi
openh264                  1.8.0             hdbcaa40_1000    conda-forge
openssl                   1.1.1s               h7f8727e_0  
packaging                 20.4                     pypi_0    pypi
pandas                    1.0.5                    pypi_0    pypi
pandocfilters             1.4.3                    pypi_0    pypi
parso                     0.8.1                    pypi_0    pypi
pexpect                   4.8.0                    pypi_0    pypi
pickleshare               0.7.5                    pypi_0    pypi
pillow                    7.1.2                    pypi_0    pypi
pip                       22.3.1           py37h06a4308_0  
pluggy                    0.13.1                   pypi_0    pypi
prometheus-client         0.9.0                    pypi_0    pypi
prompt-toolkit            3.0.14                   pypi_0    pypi
ptyprocess                0.7.0                    pypi_0    pypi
py                        1.8.2                    pypi_0    pypi
py-cpuinfo                6.0.0                    pypi_0    pypi
pyaml                     20.4.0                   pypi_0    pypi
pycocotools               2.0.6                    pypi_0    pypi
pycodestyle               2.6.0                    pypi_0    pypi
pycparser                 2.20                     pypi_0    pypi
pyflakes                  2.2.0                    pypi_0    pypi
pygments                  2.7.4                    pypi_0    pypi
pylint                    2.6.0                    pypi_0    pypi
pyparsing                 2.4.7                    pypi_0    pypi
pyrsistent                0.17.3                   pypi_0    pypi
pysocks                   1.7.1                    pypi_0    pypi
pytest                    5.4.3                    pypi_0    pypi
pytest-benchmark          3.2.3                    pypi_0    pypi
python                    3.7.16               h7a1cb2a_0  
python-dateutil           2.8.1                    pypi_0    pypi
python_abi                3.7                     2_cp37m    conda-forge
pytz                      2020.1                   pypi_0    pypi
pywavelets                1.1.1                    pypi_0    pypi
pyyaml                    5.3.1                    pypi_0    pypi
pyzmq                     19.0.1                   pypi_0    pypi
qtconsole                 5.0.2                    pypi_0    pypi
qtpy                      1.9.0                    pypi_0    pypi
readline                  8.2                  h5eee18b_0  
requests                  2.23.0                   pypi_0    pypi
sacred                    0.8.1                    pypi_0    pypi
scikit-image              0.17.2                   pypi_0    pypi
scipy                     1.4.1                    pypi_0    pypi
seaborn                   0.10.1                   pypi_0    pypi
send2trash                1.5.0                    pypi_0    pypi
setuptools                65.6.3           py37h06a4308_0  
six                       1.15.0                   pypi_0    pypi
smmap                     3.0.4                    pypi_0    pypi
sqlite                    3.40.1               h5082296_0  
submitit                  1.1.5                    pypi_0    pypi
terminado                 0.9.2                    pypi_0    pypi
testpath                  0.4.4                    pypi_0    pypi
tifffile                  2020.6.3                 pypi_0    pypi
tk                        8.6.12               h1ccaba5_0  
toml                      0.10.2                   pypi_0    pypi
torch                     1.7.1+cu110              pypi_0    pypi
torchaudio                0.7.2                    pypi_0    pypi
torchfile                 0.1.0                    pypi_0    pypi
torchvision               0.8.2+cu110              pypi_0    pypi
tornado                   6.1                      pypi_0    pypi
tqdm                      4.46.1                   pypi_0    pypi
traitlets                 5.0.5                    pypi_0    pypi
typed-ast                 1.4.1                    pypi_0    pypi
typing-extensions         3.7.4.3                  pypi_0    pypi
urllib3                   1.25.9                   pypi_0    pypi
visdom                    0.1.8.9                  pypi_0    pypi
wcwidth                   0.2.5                    pypi_0    pypi
webencodings              0.5.1                    pypi_0    pypi
websocket-client          0.57.0                   pypi_0    pypi
wheel                     0.37.1             pyhd3eb1b0_0  
widgetsnbextension        3.5.1                    pypi_0    pypi
wrapt                     1.12.1                   pypi_0    pypi
x264                      1!152.20180806       h14c3975_0    conda-forge
xmltodict                 0.12.0                   pypi_0    pypi
xz                        5.2.10               h5eee18b_1  
zipp                      3.1.0                    pypi_0    pypi
zlib                      1.2.13               h5eee18b_0

I download MOT17 and runpython src/track.py with reid, then i got this error: 

WARNING - track - No observers have been added to this run
INFO - track - Running command 'main'
INFO - track - Started
Configuration (modified, added, typechanged, doc):
  data_root_dir = 'data'
  dataset_name = 'MOT17-ALL-ALL'
  generate_attention_maps = False
  interpolate = False
  load_results_dir = None
  obj_detect_checkpoint_file = 'models/mot17_crowdhuman_deformable_multi_frame/checkpoint_epoch_40.pth'
  output_dir = None
  seed = 666
  verbose = False
  write_images = False
  frame_range:
    end = 1.0
    start = 0.0
  tracker_cfg:
    detection_nms_thresh = 0.9
    detection_obj_score_thresh = 0.4
    inactive_patience = 5
    prev_frame_dist = 1
    public_detections = False
    reid_greedy_matching = False
    reid_score_thresh = 0.4
    reid_sim_only = False
    reid_sim_threshold = 0.0
    steps_termination = 1
    track_nms_thresh = 0.9
    track_obj_score_thresh = 0.4
INFO - main - INIT object detector [EPOCH: 40]
INFO - main - ------------------
INFO - main - TRACK SEQ: MOT17-01-DPM
  0%|                                                                                                                 | 0/450 [00:00<?, ?it/s]/fastdeploy/ict/trackformer/src/trackformer/models/tracker.py:431: UserWarning: This overload of nonzero is deprecated:
        nonzero()
Consider using one of the following signatures instead:
        nonzero(*, bool as_tuple) (Triggered internally at  /pytorch/torch/csrc/utils/python_arg_parser.cpp:882.)
  new_det_indices = new_det_keep.float().nonzero()
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 450/450 [03:06<00:00,  2.41it/s]^[[A
INFO - main - NUM TRACKS: 99 ReIDs: 44
INFO - main - RUNTIME: 186.69 s
INFO - main - NO GT AVAILBLE
INFO - main - ------------------
INFO - main - TRACK SEQ: MOT17-01-FRCNN
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 450/450 [03:07<00:00,  2.40it/s]
INFO - main - NUM TRACKS: 99 ReIDs: 44
INFO - main - RUNTIME: 187.43 s
INFO - main - NO GT AVAILBLE
INFO - main - ------------------
INFO - main - TRACK SEQ: MOT17-01-SDP
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 450/450 [03:07<00:00,  2.40it/s]
INFO - main - NUM TRACKS: 99 ReIDs: 44
INFO - main - RUNTIME: 187.41 s
INFO - main - NO GT AVAILBLE
INFO - main - ------------------
INFO - main - TRACK SEQ: MOT17-02-DPM
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 600/600 [04:11<00:00,  2.39it/s]
INFO - main - NUM TRACKS: 133 ReIDs: 25
INFO - main - RUNTIME: 251.10 s
ERROR - track - Failed after 0:13:43!
Traceback (most recent calls WITHOUT Sacred internals):
  File "src/track.py", line 153, in main
    mot_accum = get_mot_accum(results, seq_loader)
  File "/fastdeploy/ict/trackformer/src/trackformer/util/track_utils.py", line 400, in get_mot_accum
    distance)
  File "/fastdeploy/my_soft/anaconda3/envs/tformer/lib/python3.7/site-packages/motmetrics/mot.py", line 252, in update
    rids, cids = linear_sum_assignment(dists)
  File "/fastdeploy/my_soft/anaconda3/envs/tformer/lib/python3.7/site-packages/motmetrics/lap.py", line 73, in linear_sum_assignment
    rids, cids = solver(costs)
  File "/fastdeploy/my_soft/anaconda3/envs/tformer/lib/python3.7/site-packages/motmetrics/lap.py", line 288, in lsa_solve_lapjv
    from lap import lapjv
  File "/fastdeploy/my_soft/anaconda3/envs/tformer/lib/python3.7/site-packages/lap/__init__.py", line 25, in <module>
    from ._lapjv import (
  File "__init__.pxd", line 199, in init lap._lapjv
ValueError: numpy.ndarray has the wrong size, try recompiling. Expected 80, got 88
timmeinhardt commented 1 year ago

Since the first sequence runs through without errors It is hard to say what causes this bug. Did you follow the install instructions carefully? Your environment lists PyTorch 1.7 instead of 1.5.

GodIsBoom commented 1 year ago

Thank you, I replaced (CUDA11.2, Pytorch1.7) with (CUDA10.2, Pytorch1.5), then i successfully run

taxy commented 1 year ago

I use it with pytorch1.12.1 and cuda11.3, although really without mot metrics.

tostenzel commented 1 year ago

I guess the real problem was #40 .