search

DoctorD1501 / JAVMovieScraper

Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent
GNU General Public License v2.0
751 stars 161 forks source link

Javlibrary isn't being scraped #239

Closed javsat closed 5 years ago

javsat commented 6 years ago

When I try to scrape from Javlibrary, it just cycles through but doesn't actually grab any data or images. I noticed they have implemented cloudflare and I'm wondering if that might be preventing it. Any solution?

DarkMask100 commented 6 years ago

JavLibrary moved to Cloudflare so either an existing solution will need to be incorporated or the devs will have to come up with their own to bypass it.

standing100 commented 6 years ago

Wasn't JavLib not for long time using cloudflare?

JavLib has the most completed actor names, using the other scrapers / the JAV censored group it often returns "" as actor (nothing because its not filled or filled as "amateur")

Maybe adding acount support for JavLib can bye-pass cloudflare problems?

eckozen84 commented 6 years ago

+1 for hoping this gets a fix. Much appreciated.

zeldatp151 commented 6 years ago

I'm not sure if this is of any help, but iambluedev1 here on gh has a java library called cfscrape-java that is supposed to bypass CF's anti-bot protection.

fidofido300 commented 6 years ago

:+1:

Wizell commented 5 years ago

I do have a working code now. I will merge it for the next release

zeldatp151 commented 5 years ago

Awesome!

eckozen84 commented 5 years ago

@Wizell thanks for the work. Is there an ETA when the next release will be available? Completely understand if you're busy because of the holiday season and all.

Wizell commented 5 years ago

The 0.3.5 release contains code that should make javlibrary scraper works again.