Scrapper for DMM Seems to be Broken

DoctorD1501 / JAVMovieScraper

Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent

GNU General Public License v2.0

748 stars 162 forks source link

Scrapper for DMM Seems to be Broken #325

Open rickytor81 opened 3 years ago

rickytor81 commented 3 years ago

The scrapper for DMM appears to be broken. Would be great if it can be fixed.

Thanks

zuko7177 commented 3 years ago

Broken due to age check on DMM.jo.co site.

Pull request to handle the age check: #326

huihuijordan commented 3 years ago

The scrapper for DMM appears to be broken. Would be great if it can be fixed.

Thanks

I have the same problem as yours, the DMM can not be accessed for one month.

huihuijordan commented 3 years ago

Broken due to age check on DMM.jo.co site.

Pull request to handle the age check: #326

Could you please give me a working release jar? Many thanks, jia19870807@163.com

koonfoon commented 3 years ago

Broken due to age check on DMM.jo.co site.

Pull request to handle the age check: #326

Hi, I cloned the master branch from your repository. I run gradle shadowJar and produced a .jar file. But the DMM is still broken for me.

zuko7177 commented 3 years ago

DMM scraper may still be broken because it uses grammarchecker.net to do JP to EN translations. I've observed that site is not reliable (perhaps due to too many calls?). If the call to that site returns nothing, DMM scraper will not have English data.

Try enabling Preference -> Translation -> Scrape JAV Movies in Japanese Instead Of English

If DMM scraper returns JP data, then you know the translation is down. You can try waiting a day to see if EN translation is working again.

zuko7177 commented 3 years ago

I just tested DMM scraping and the translation feature is not working. Indeed, this is due to grammarcheck.net not returning translations. It will look like this:

I also went to test https://grammarchecker.net/translate/ and the translation feature is not working.

DMM scraping in JP is working OK.

koonfoon commented 3 years ago

DMM may still be broken because it uses grammarchecker.net to do JP to EN translations. I've observed that site is not reliable (perhaps due to too many calls?). If the call to that site returns nothing, DMM will not have English data.

Try enabling Preference -> Translation -> Scrape JAV Movies in Japanese Instead Of English

If DMM returns JP data, then you know the translation is down. You can try waiting a day to see if EN translation is working again.

Thank you 👍

JK0304 commented 3 years ago

@koonfoon : Hello, can you share me your jar file, i'm trying to build a jar file but no luck, thank you very much.

neko29ssn commented 3 years ago

Hi @koonfoon, which JDK you used to setup this project? sorry I know it is dumb question, I really not familiar with java @@ I have no luck trying with intellij + jdk 11 in windows 10

Thanks in advanced

tonyzzz321 commented 3 years ago

@JK0304 @neko29ssn This is how I successfully built the jar. I don't have any IDE. My JDK version is 11.0.8 and Gradle is at version 5.6.4. I cloned zuko7177's fork (https://github.com/zuko7177/JAVMovieScraper) and then run "gradle shadowjar" to build the jar. The output jar file is located in build/libs/ folder. Hope this helps.

JK0304 commented 3 years ago

@tonyzzz321 : I successfully create a jar file thanks for your guide but bad new is i can't open it, hope you can help me out. Untitled

neko29ssn commented 3 years ago

@JK0304 @neko29ssn This is how I successfully built the jar. I don't have any IDE. My JDK version is 11.0.8 and Gradle is at version 5.6.4. I cloned zuko7177's fork (https://github.com/zuko7177/JAVMovieScraper) and then run "gradle shadowjar" to build the jar. The output jar file is located in build/libs/ folder. Hope this helps.

It work like a charm :D Thank you so much @tonyzzz321 !!

tonyzzz321 commented 3 years ago

@JK0304 Can you run "gradle -v" to see what version of Gradle you have? Make sure you have version 5.6.4, not the latest version. I think the new version of Gradle updated something on how to configure the build, and JAVMovieScraper hasn't been updated hence not compatible with new version of Gradle.

Wizell commented 3 years ago

@tonyzzz321 is right. But this should be fixed in master.

I need to fix few more things and i will do a new release

JK0304 commented 3 years ago

@JK0304 Can you run "gradle -v" to see what version of Gradle you have? Make sure you have version 5.6.4, not the latest version. I think the new version of Gradle updated something on how to configure the build, and JAVMovieScraper hasn't been updated hence not compatible with new version of Gradle.

Oh man, i use the latest Gradle version, that's why i can't open jar file, it's working now, thank you very much for your help, cheers

zuko7177 commented 3 years ago

@Wizell May I suggest committing the Gradle Wrapper to repository. This should remove issues with Gradle version compatibility.

JAVMovieScraper\gradle\wrapper\gradle-wrapper.jar JAVMovieScraper\gradle\wrapper\gradle-wrapper.properties JAVMovieScraper\gradlew JAVMovieScraper\gradlew.bat

rickytor81 commented 3 years ago

@JK0304 @neko29ssn This is how I successfully built the jar. I don't have any IDE. My JDK version is 11.0.8 and Gradle is at version 5.6.4. I cloned zuko7177's fork (https://github.com/zuko7177/JAVMovieScraper) and then run "gradle shadowjar" to build the jar. The output jar file is located in build/libs/ folder. Hope this helps.

Thank you for the solution! It works!!

zuko7177 commented 3 years ago

For building a jar from my repo, see https://github.com/DoctorD1501/JAVMovieScraper/issues/335#issuecomment-695662489

Hopefully, @Wizell will approve the PR and build the next official release.