evaluation problem

[flynnamy]

Hi，when I do evaluation by using your model but could not get your results. Have you checked the shared model ? @BrianG13

[BrianG13]

Hi @flynnamy , I am glad you are trying to use our model :) Could you post the command line you used?

[flynnamy]

Hi, I use command like this: python3 evaluate_multiview.py --resume=./4_views_mha64_gt.pth --device=0 @BrianG13

[BrianG13]

I run the repo on a clean machine and it works as expected. Can you please copy&paste here the entire logs that are printed on terminal?

[flynnamy]

Please check this file: @BrianG13 test.log

[BrianG13]

Could you please log your conda list output ?

I tried on 3 different machines and the results I am getting are as expected. I will update the code with an option to run over cpu later this week (Which GPU are you using?)

[cvlzw]

same problem using RTX3090 torch=1.8 cuda 11.1

[BrianG13]

@tbcvContributor did you created your conda env with the environment file? Could you please log your conda list output ?

[cvlzw]

@tbcvContributor did you created your conda env with the environment file? Could you please log your conda list output ? conda-list.txt

[BrianG13]

@tbcvContributor I see we are using different tensor versions and also different cuda drivers. Yours: torch=1.8.0+cu111 Mine: pytorch=1.4.0=py3.6_cuda10.0.130_cudnn7.6.3_0

Maybe this is the root for the differences, in the next days I will try to run with your pkgs and see if this is the reason for different results

[BrianG13]

Could you try to create a conda list from the requirements file published in this repo and retry the experiment?

[haolyuan]

same question.

[BrianG13]

@Yamato-01 Could you please log your conda list output ?

[haolyuan]

conda_list.txt here~

[nixsui]

same problem

[ghost]

I'm having a similar problem evaluating the model.

+--------------+------------+---------------------+
|    Action    | MPJPE (mm) | Acc. Error (mm/s^2) |
+--------------+------------+---------------------+
|  Directions  |   59.38    |         0.83        |
|  Discussion  |   94.65    |         1.18        |
|    Eating    |   84.15    |         0.93        |
|   Greeting   |   82.13    |         1.38        |
|   Phoning    |   84.43    |         0.94        |
|    Photo     |   111.49   |         0.95        |
|    Posing    |   77.40    |         0.88        |
|  Purchases   |   105.69   |         1.66        |
|   Sitting    |   99.25    |         0.60        |
| SittingDown  |   106.31   |         1.03        |
|   Smoking    |   89.77    |         0.83        |
|   Waiting    |   87.34    |         0.82        |
|   WalkDog    |   141.06   |         2.94        |
| WalkTogether |   97.24    |         2.66        |
|   Walking    |   92.90    |         2.57        |
|              |            |                     |
|   Average    |   94.80    |         1.35        |
+--------------+------------+---------------------+

Environment:

• Windows 11 (21H2)
• PyTorch v1.12.1
• CUDA v11.7

[BrianG13]

Did u guys installed the environment as specified?

[wkailiu]

same problem conda list.txt

[aryan-f]

Did u guys installed the environment as specified?

I tried recreating the environment, both with pip and conda. I'm installing the exact same version of libraries (with the same CPython version). The conda environment works fine and produces the expected results, but the pip environment is outputting incorrect outputs.

Any guesses as to what might be the issue?