search

neptune-ai / open-solution-mapping-challenge

Open solution to the Mapping Challenge :earth_americas:
https://www.crowdai.org/challenges/mapping-challenge
MIT License
378 stars 96 forks source link

pandas.errors.EmptyDataError: No columns to parse from file #177

Closed carbonox-infernox closed 5 years ago

carbonox-infernox commented 5 years ago

When I used the command python main.py -- train --pipeline_name, I got the error: Traceback (most recent call last): File "main.py", line 93, in main() File "/home/derose/anaconda3/lib/python3.6/site-packages/click/core.py", line 722, in call return self.main(args, kwargs) File "/home/derose/anaconda3/lib/python3.6/site-packages/click/core.py", line 697, in main rv = self.invoke(ctx) File "/home/derose/anaconda3/lib/python3.6/site-packages/click/core.py", line 1066, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/home/derose/anaconda3/lib/python3.6/site-packages/click/core.py", line 895, in invoke return ctx.invoke(self.callback, ctx.params) File "/home/derose/anaconda3/lib/python3.6/site-packages/click/core.py", line 535, in invoke return callback(args, **kwargs) File "main.py", line 15, in prepare_masks pipeline_manager.prepare_masks(dev_mode) File "/home/derose/open-solution-mapping-challenge/src/pipeline_manager.py", line 26, in prepare_masks prepare_masks(dev_mode, self.logger, self.params) File "/home/derose/open-solution-mapping-challenge/src/pipeline_manager.py", line 61, in prepare_masks small_annotations_size=params.small_annotations_size) File "/home/derose/open-solution-mapping-challenge/src/preparation.py", line 28, in overlay_masks coco = COCO(annotation_file_path) File "/home/derose/anaconda3/lib/python3.6/site-packages/pycocotools/coco.py", line 79, in init dataset = json.load(open(annotation_file, 'r')) FileNotFoundError: [Errno 2] No such file or directory: '~/crowdai-mapping-challenge-mask-rcnn/data/train/annotation.json'

How can I fix this?

taraspiotr commented 5 years ago

Did you create the metadata.csv file with prepare_metadata() method and have the correct filepath to it and to the data directory? And if so could you check how the metadata.csv file looks like?

carbonox-infernox commented 5 years ago

I'm not sure what you mean by prepare_metadata() method, but I earlier used the command:

python main.py -- prepare_metadata --train_data --valid_data --test_data

And i got

neptune: Error: No value provided for parameter 'test_data'

the stage1_metadata.csv is empty

carbonox-infernox commented 5 years ago

@taraspiotr I fixed an issue with my data path and updated the error message above. it is mostly the same, but it now includes No such file or directory: '~/crowdai-mapping-challenge-mask-rcnn/data/train/annotation.json' I don't know what to do about this, because the file is there.