The result of the data load is inconsistent with the disk

KaiyangZhou / Dassl.pytorch

A PyTorch toolbox for domain generalization, domain adaptation and semi-supervised learning.

MIT License

1.23k stars 171 forks source link

Closed siaimes closed 2 years ago

siaimes commented 2 years ago

As you can see from the figure, the number of lines read into memory is 50416, but the painting_train.txt file has 52867 lines.

I haven't figured out what the reason is, but it may affect the accuracy of the experiment.

siaimes commented 2 years ago

The problem was solved after I replaced the line endings from Unix (LF) to Windows (CR LF).

siaimes commented 2 years ago

Weird thing, since my code is running in a container, it should be able to handle Unix (LF) line endings.

siaimes commented 2 years ago

Sorry, it was my fault, I opened the original version with notepad and loaded the cleaned version with code.