voldemortX / pytorch-auto-drive

PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help
BSD 3-Clause "New" or "Revised" License
837 stars 137 forks source link

About CULane official evaluation function #106

Closed huanFigure closed 2 years ago

huanFigure commented 2 years ago

Hello, I have run the enet_baseline model,and I have gotten the result 'checkpoints/enetbaseline/culane/model.pt'.And then I the test enetmodel ,and got the output 'output/driverframe/.MP4/*.lines.txt'.But when I run './tools/culane_evaluation/eval.sh' to evaluate the output files, I got the number 0 or -1

1657105465103

Have you ever encountered such a situation? And the configuration in eval.sh: data_dir is the original CULane data which download from website detect_dir is the output of the test 'python main_landet.py --test --config=configs/lane_detection/baseline/enet_culane.py --mixed-precision' Is there anything wrong with my configuation?

huanFigure commented 2 years ago

And the eval class configuration 'output/out*.txt' ,I copy the downloaded from website CULane to this directory and renamed them 1657106195351

voldemortX commented 2 years ago

@huanFigure I only encounter this when the model really have 0 accuracy. Did you train the model yourself? Perhaps try testing one of the uploaded checkpoints and verify if the issue is in evaluation script?

Also could you check if the predicted lines.txt have normal contents?

huanFigure commented 2 years ago

Thanks for your replay. I have solved this problem. The reason is that the file name generated by the test end with '.jpg.lines.txt' which doesn't match the original file name '.lines.txt'