search

nzsakib / frontendmasters

Downloader for frontendmasters in python 3
MIT License
0 stars 1 forks source link

Issue with new site. #1

Open nalayakengineer opened 4 years ago

nalayakengineer commented 4 years ago

spider.py needs few modificatons.

line 86: titles are now closed under h2 tag. titles = soup_page.find('section', {'class': 'CourseToc'}).find_all('h2', {'class', 'lessongroup'})

--highresolution is not required by default it download 1080p which is highest resolution.

Update Readme.md as it doesn't specify where to keep gecko/chromedriver. Download the driver to /usr/local/bin

rackyman commented 4 years ago

@nalayakengineer Hey, just wanted to know if this script works. Did you download any course successfully?

nalayakengineer commented 4 years ago

I was able to download 2 courses after making above changes. Before I got blocked.

Definitely, they are looking for bots.If you run it continuously. they'll block your account. ;)

one a day doesn't hurt I guess.

rackyman commented 4 years ago

Any idea how they are detecting script usages ? And how to counter that?

nalayakengineer commented 4 years ago

I haven't got time to check, was stuck in a pile of work due to this COVID-19. I am sure there will be a workaround.