search

DoctorD1501 / JAVMovieScraper

Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent
GNU General Public License v2.0
751 stars 161 forks source link

Scraping DMM fails because age check is not bypassed when scraping actress page #337

Open redraiderj opened 3 years ago

redraiderj commented 3 years ago

Describe the bug The cookies age_check_done is not set in DmmParsingProfile.scrapeActors() function, before "Document actressPage = Jsoup.connect(actressPageURL)..."

I changed the code as below and rebuild the project then it works.

            Map<String, String> cookies = new HashMap<String, String>();
            cookies.put("age_check_done", "1");
            Document actressPage = Jsoup.connect(actressPageURL).cookies(cookies).userAgent("Mozilla").ignoreHttpErrors(true).timeout(SiteParsingProfile.CONNECTION_TIMEOUT_VALUE).get();