Open coljac opened 1 year ago
Hey, This shouldn't be happening. But you can take a look at urls.py if you want to figure out the name generation specially the url2path function.
Also this could arise due to threading. So you should try running the job without threading. Hope this helps.
When spidering a website I have found that pywebcopy saves the images like this:
domain.com/dir/image_1.jpg.jpeg
But the source contains
<img src="./image_1.jpg">
In other words, it's appending a .jpeg extension where it oughtn't.