search

DoctorD1501 / JAVMovieScraper

Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent
GNU General Public License v2.0
748 stars 162 forks source link

IAFD no longer working #347

Open slappy2 opened 3 years ago

slappy2 commented 3 years ago

IAFD only return the Year all others field are left blank. as of April 03 2021.

CodyBerenson commented 3 years ago

IAFD implemented CloudFlare, which broke all scraping "robots". Their FAQ is extremely aggressive. From their terms of service:

Use of robots (Teleport Pro, WGet, etc.) that do not comply with our robots.txt (and cloak themselves to boot) will result in the blocking of your IP address or possibly your entire subnet. If we catch you, we will ruin it for you :-). Use the database online... please don't archive it for your personal use.

Doubt the Java scraper will ever work with IAFD again. :(

lukewoodau commented 2 years ago

If anyone was able to help create a alternate version to iafd happy to help and have it open so can then add as a scraping option on here

CodyBerenson commented 2 years ago

@lukewoodau Our developer was able to get around CloudFlare. Here is our IAFD Plex Agent. Hope this helps. https://github.com/CodyBerenson/PGMA-Modernized/tree/master/IAFD.bundle