search

tharyckgusmao / Skill-Share-Crawler---DL

Download Videos Skill Share per ID or per Class
125 stars 33 forks source link

Stopped downloading, completelly #30

Open snowman81 opened 5 years ago

snowman81 commented 5 years ago

I used it to download about 100 GB from one category, and then it stopped working. I think, they figured out that they are being mass-leeched, so they changed something in the back end, to block the crawlers. Rate limiting, with NetLimiter does not help. Suppose to work on 10 Mbit/s, but its not. UPD: with higher UL limit its worked longer, while checking already downloaded videos, but later it stopped with the same error. UPD2: works with 5 Mbit/s limit on Netlimiter, and I only have tested single class DL by ID, so far.

`Downloading 2 ... UI/UX Design-Streamline your workflow: The efficient UI/UX design process in Figma undefined:1 undefined ^

SyntaxError: Unexpected token u in JSON at position 0 at JSON.parse () at Request.request [as _callback] (U:__VIDEO__Skillshare__CRAWLER\Skill-Share-Crawler---DL-master\app\components\GetAllVideos.js:107:38) at self.callback (U:__VIDEO__Skillshare__CRAWLER\Skill-Share-Crawler---DL-master\node_modules\request\request.js:188:22) at Request.emit (events.js:180:13) Downloading 4 ... UI/UX Design-Sketch Course - UI Design undefined:1 undefined ^

SyntaxError: Unexpected token u in JSON at position 0 Downloading 7 ... UI/UX Design-How to Pursue a Career in UX undefined:1 <!DOCTYPE html> ^

SyntaxError: Unexpected token < in JSON at position 0 at JSON.parse () at Request.request [as _callback] (U:__VIDEO__Skillshare__CRAWLER\Skill-Share-Crawler---DL-master\app\components\GetAllVideos.js:107:38) at Request.self.callback (U:__VIDEO__Skillshare__CRAWLER\Skill-Share-Crawler---DL-master\node_modules\request\request.js:188:22) at Request.emit (events.js:180:13) at Request.emit (domain.js:422:20) at Request. (U:__VIDEO__Skillshare__CRAWLER\Skill-Share-Crawler---DL-master\node_modules\request\request.js:1171:10) at Request.emit (events.js:180:13) at Request.emit (domain.js:422:20) at IncomingMessage. (U:__VIDEO__Skillshare__CRAWLER\Skill-Share-Crawler---DL-master\node_modules\request\request.js:1091:12) at Object.onceWrapper (events.js:272:13) npm ERR! code ELIFECYCLE npm ERR! errno 1 npm ERR! skillshare_dl@1.0.0 start: node index.js npm ERR! Exit status 1 npm ERR! npm ERR! Failed at the skillshare_dl@1.0.0 start script. npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in: npm ERR! C:\Users\snowman\AppData\Roaming\npm-cache_logs\2019-01-22T22_26_45_887Z-debug.log`

SAMBILI commented 4 years ago

same case here. any solutions