-
Faire une classe qui attribut un scraper dédié à un site web donné
-
## why?
```
INFO:scrape_multi:=== scraping video_raw:(done=271, skipped=10, total=1528) ===
INFO:_scrape_video_info:loading video_info...
WARNING: video doesn't have subtitles
INFO:_scrape_main_h…
-
Implement password protected scrapers for:
POCP
COMITHydro
Paid Wits
EMS(?)
-
How do I contribute by adding additional scrapers?
Is there any guidance regarding the objects to be created?
-
-
From initial testing, the amount of scrapers we hit is not enough for older music. Add the following scrapers (if doesn't require javascript)
- genius.com
- songlyrics.com
- www.lyricsbox.com
- …
-
Some scrapers are outdated; meaning their sites have changed and now they can't scrape them.
The scrapers are:
- Cerberus
- Co-op
- Zol Begadol
- Eden (not sure if still relevant)
-
Log https://jitpack.io/com/github/cpp-hci/scrapers/6964ff47ae/build.log
-
**Following websites can be scraped**
1. http://bookboon.com
-
### Description
With 4 new webscrapers, we need to connect them to our site block out walmart for now. Potential blocker for database functions at this point in time, but the frontend can at the very…