search

neptune-ai / open-solution-mapping-challenge

Open solution to the Mapping Challenge :earth_americas:
https://www.crowdai.org/challenges/mapping-challenge
MIT License
377 stars 96 forks source link

UnicodeDecodeError: 'gbk' codec can't decode byte 0xa5 in position 404: illegal multibyte sequence #202

Open pnzsl opened 5 years ago

pnzsl commented 5 years ago

Hi, I'm sorry to bother you. There are some problems in the replication experiment, and the description of the problem is

reader.py，line 178, in update_raw data = self.stream.read(size) UnicodeDecodeError: 'gbk' codec can't decode byte 0xa5 in position 404: illegal multibyte sequence

i don't know how to deal with this problem,would you mind giving me some advices?

jakubczakon commented 5 years ago

Hi there @pnzsl and sorry for late reply. It looks like something is wrong with the files that are stored on your storage.

Hmm, could you check that you can read the images with no problems in a notebook or something?

pnzsl commented 5 years ago

Hi there @pnzsl and sorry for late reply. It looks like something is wrong with the files that are stored on your storage.

Hmm, could you check that you can read the images with no problems in a notebook or something?

I have solved this problem.thanks!

pnzsl commented 5 years ago

Hi，sorry to occupy your rest time again. hmm，I have completed the steps of mask and metadata. I have encountered some troubles when training the train data to obtain the model.

well， I can’t adjust the parameter of a. According to my understanding, a is a parameter in the setup function. How can I adjust it？please look at the following question. 0 G2IC2IY4K Z36%1W))J53 looking forward to your reply！

jakubczakon commented 5 years ago

@pnzsl where do you adjust/change the a? I cannot find it in the neptune.yaml config file.

pnzsl commented 5 years ago

As shown in the figure, the a is in the generic. py file. It's just a formal parameter in a function. The computer is not with me for the time being. I will provide you with specific information tomorrow. thank you sir.

jakubczakon commented 5 years ago

It may be that your training/validation data is of 0 size.

Hmm, I suggest that you go to the https://github.com/neptune-ml/open-solution-mapping-challenge/blob/master/src/pipeline_manager.py#L98 and print the shapes of train/valid just to make sure that those make sense.

I think we need to make sure that the data which goes into the:

    pipeline.fit_transform(data)

actually makes sense first.

I suspect that there is something fishy going on here.

pnzsl commented 5 years ago

Haha..I see what you mean.I will try. Thank you! Have a nice day.

jakubczakon commented 5 years ago

u2 @pnzsl and please let me know when you fix it!