Open abhinavm24 opened 1 day ago
nvm, worked with clean install
dumping all the things that I found useful while scrapping this time
To scrape all course list- scroll through the course list on https://www.educative.io/search?tab=courses and execute on console `const courseUrls = Array.from(document.querySelectorAll('.rounded a')) .map(a => a.href) .filter(url => url.includes('/courses/') || url.includes('/path/') || url.includes('/assessments/'));
const csvContent = "data:text/csv;charset=utf-8," + courseUrls.join("\n"); const encodedUri = encodeURI(csvContent); const link = document.createElement("a"); link.setAttribute("href", encodedUri); link.setAttribute("download", "course_urls.csv"); document.body.appendChild(link); link.click();`
first page of most courses is course url/about-the-course
nvm, scrape all course url does the same, but slow
is it possible to run multiple instances of scapper on same machine?
To fix this you could try to:
Facing this on mac M1, latest available python-tk