qianqianwang68 / omnimotion

Apache License 2.0
2.07k stars 121 forks source link

Evaluate the trained checkpoints and the provided checkpoints, and the results of the metrics are inconsistent #51

Open Guo-1212 opened 4 months ago

Guo-1212 commented 4 months ago

Hello! I made a modification to the default configuration as this comment(https://github.com/qianqianwang68/omnimotion/issues/37#issuecomment-1856324840),There is a discrepancy between the metrics evaluated by the trained checkpoints and those provided.Take the blackswan dataset as an example,this is the metric measured with the checkpoints provided: 屏幕截图 2024-02-22 170855 This is the metric measured by the trained checkpoint: 屏幕截图 2024-02-22 171544 In addition, the loss function of the training process also showed a downward trend and then an upward trend: 屏幕截图 2024-02-22 171902 I would like to ask if there are any other configurations that need to be modified to present the results in the paper in addition to the changes involved in the above comment?