search

mvabdi / vsco-scraper

Easily allows for scraping a VSCO
MIT License
133 stars 25 forks source link

Videos no longer downloading #51

Closed Tyen3 closed 3 weeks ago

Tyen3 commented 3 weeks ago

It seems that VSCO has been migrating their site to sit behind Cloudflare, as I've encountered various issues these past few weeks where Cloudflare was blocking content. Starting this past Friday, I noticed that the content of .mp4 files that vsco-scraper downloaded were actually Cloudflare 404 Object Not Found HTML files. Investigating further, it appears that the VSCO API returns video links that point to objects that are no longer accessible. This can be observed visiting VSCO with a web browser and viewing network traffic with browser tools; the site attempts to retrieve these objects, but fails due to the 404s.

It appears that VSCO may have recently turned video uploading/hosting into a "premium" feature, resulting in existing videos to turn into still frame previews for non-premium accounts.

With video objects now being inaccessible, the only "fix" to this might be to modify the scraper to download the still frame preview of the video as a .jpg instead of an .mp4. I may attempt to write a patch for this if I have time.

timbo0o1 commented 3 weeks ago

Hey could you show me an example where you experience this issue?

Tyen3 commented 3 weeks ago

Hey could you show me an example where you experience this issue?

Account "leahfactor" is a decent example. There are four .mp4 files downloaded:

1553396042.mp4 1554592255.mp4 1555422046.mp4 1576460004.mp4

All of which are actually Cloudflare 404 HTML.

Tyen3 commented 3 weeks ago

While the above example is still valid, I did come across an account that I am able to pull mp4's from: aleeman53. So perhaps VSCO is in the process of moving stuff around, and this will eventually work again. I guess time will tell.

timbo0o1 commented 3 weeks ago

While the above example is still valid, I did come across an account that I am able to pull mp4's from: aleeman53. So perhaps VSCO is in the process of moving stuff around, and this will eventually work again. I guess time will tell.

Was about to say that it works on other profiles. We will see where this goes or if it's a rare occurrence.

Tyen3 commented 3 weeks ago

It appears VSCO has completed whatever backend work they were doing, and I am now able to download mp4s again. Closing this ticket out.