VisualComputingInstitute / TrackR-CNN

TrackR-CNN baseline method for Multi-Object Tracking and Segmentation (MOTS)
MIT License
520 stars 109 forks source link

AssertionError #40

Closed josheligoldman closed 4 years ago

josheligoldman commented 5 years ago

When I run the command:

python main.py configs/conv3d_sep2

I get the following error:

Traceback (most recent call last): File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/main.py", line 32, in tf.compat.v1.app.run(main) File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/venv/lib/python3.7/site-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/venv/lib/python3.7/site-packages/absl/app.py", line 299, in run _run_main(main, args) File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/venv/lib/python3.7/site-packages/absl/app.py", line 250, in _run_main sys.exit(main(argv)) File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/main.py", line 27, in main engine = Engine(config) File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/core/Engine.py", line 41, in init name="trainnet") File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/network/Network.py", line 16, in init self.input_tensors_dict = dataset.create_input_tensors_dict(self.batch_size) File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/datasets/Dataset.py", line 278, in create_input_tensors_dict self._load_inputfile_lists() File "/Users/joshgoldman/PycharmProjects/MultiObjectTrackingAndSegmentation/datasets/Dataset.py", line 260, in _load_inputfile_lists assert len(l) > 0 AssertionError

pvoigtlaender commented 5 years ago

It's some problem with the paths, the data is not found. Please try to set the paths explicitly or you can do some debugging into load_inputfile_lists and see which path it tries to load

EchoAmor commented 4 years ago

Hello ,I have met the same problem when I use the command to train on MOTS dataset.

python main.py configs/conv3d_sep2

The error is like this

Screenshot from 2019-11-11 14-24-26

After I debug,I found the problem is in the Dataset.py, can u tell me how the _read_inputfilelists() work in the class FileListDataset(), I can't find where it is . Screenshot from 2019-11-11 14-27-34

Thanks very much!!! @pvoigtlaender @josheligoldman

ahnonay commented 4 years ago

read_inputfile_lists is implemented in the subclasses of FileListDataset To train on MOTS Challenge, use the MotsChallengeDataset and make sure all the paths are working right. For example, you could use a debugger to step through read_inputfile_lists in MotsChallengeDataset and see where self.data_dir points to and whether it finds any files

EchoAmor commented 4 years ago

Thanks! I'll try!

EchoAmor commented 4 years ago

Sorry,I have a question, u said we couldn't train on MOTS chanllenge in another question right? But here you say we can , I got a little confused @ahnonay

pvoigtlaender commented 4 years ago

Sorry,I have a question, u said we couldn't train on MOTS chanllenge in another question right? But here you say we can , I got a little confused @ahnonay

It is possible to train on MOTS Challenge. To what comment do you refer specifically?

EchoAmor commented 4 years ago

this one #42 @pvoigtlaender

ahnonay commented 4 years ago

Apologies for the confusion. It is of course possible to train on sequences 2, 5, 9 and 11 of MOT. These four sequnces are part of MOTSChallenge, so we have segmentation annotations for them. It is not possible to train on the rest of the sequences of MOT, because there, only bounding box annotations exist (this is what I meant in the other comment).

EchoAmor commented 4 years ago

Got it,but If only trained on these four sequences, will the generalization ability of this network be weak?Do u have any idea to solve this problem please? Thanks a lot for replying. @ahnonay

ahnonay commented 4 years ago

As an estimate for the generalization ability when training on MOTS Challenge you can look at Table 5 of the paper. Our results there were obtained with cross-validation and thus should roughly give an idea how good performance will be on the other sequences of MOT Challenge. Generalization to out-of-domain data (i.e. other videos than MOT Challenge) will probably not be great, since the dataset is rather small, as you noted.

pvoigtlaender commented 4 years ago

Seems the issue has been resolved. Feel free to re-open if necessary.

SamihaSara commented 4 years ago

@EchoAmor I am having the same error while trining on KITTI_MOTS. Did you solve this issue? Could you please share the steps?

Hello ,I have met the same problem when I use the command to train on MOTS dataset.

python main.py configs/conv3d_sep2

The error is like this

Screenshot from 2019-11-11 14-24-26

After I debug,I found the problem is in the Dataset.py, can u tell me how the _read_inputfilelists() work in the class FileListDataset(), I can't find where it is . Screenshot from 2019-11-11 14-27-34

Thanks very much!!! @pvoigtlaender @josheligoldman

EchoAmor commented 4 years ago

@SamihaSara I run this half a year ago, can't remember so clearly, just know it's the problem with your path, u can see

42 ,make sure your file is like 0000,0001....And make sure the path in _configs/conv3dsep2 is your absolute path

SamihaSara commented 4 years ago

@EchoAmor Thanks for helping. I checked #42 and file format, tested with absolute path also. But could not solve. Now, Can you remember, when you trained this model, did you need all 3 datasets(MOTS, KITTI_MOTS, Mapillary)?

EchoAmor commented 4 years ago

@EchoAmor Thanks for helping. I checked #42 and file format, tested with absolute path also. But could not solve. Now, Can you remember, when you trained this model, did you need all 3 datasets(MOTS, KITTI_MOTS, Mapillary)?

no,no need for 3 datasets. I still think it's your path problem ,check it more seriously

SamihaSara commented 4 years ago

@EchoAmor Do you mean I have put datasets path wrong? Should I put paths like this-- ~/TrackRCNN/data/KITTI_MOTS/train/images/ ?

EchoAmor commented 4 years ago

emmm,I don't remember,you need to check by yourself. I wasted a lot of time on this too at that time, you need to check very carefully , try to check your path with the error hint , may know where the problem lies,good luck

@EchoAmor Do you mean I have put datasets path wrong? Should I put paths like this-- ~/TrackRCNN/data/KITTI_MOTS/train/images/ ?

SamihaSara commented 4 years ago

@EchoAmor yes, just went through other related issues. Now will try again. Thanks for the prompt reply.