search

adultmm / AdultMediaManager

Adult Media Manager is the ultimate media manager for your adult movies and videos. Organize your content for Kodi, Plex, and other media centers.
178 stars 30 forks source link

JAV Library Scraper Broke #112

Open Zero177768 opened 4 months ago

Zero177768 commented 4 months ago

JavLibrary Scraper is throwing a 403 error. If I manually run it will find the info but can not access it to download. See screen shots. Screenshot 2024-05-13 195807 Screenshot 2024-05-13 195918 Screenshot 2024-05-13 195957 Screenshot 2024-05-13 200037

Thanks :) Troy

Zero177768 commented 4 months ago

I think this is a CloudFlare issue

Zero177768 commented 4 months ago

Untitled

Zero177768 commented 4 months ago

But This one works After I pass Cloud Untitled2 Flare

Zero177768 commented 4 months ago

Is there an Addon for Ember that can pass cloud Flare ? Or is this not possible?

Zero177768 commented 4 months ago

I can get Plex to pull Metadata using the instructions below, But Plex does not add the posters and metadata to the folder where the file is located only ember will do that.

Here are the instructions for plex to pull Metadata:

https://github.com/Xavier-Lam/JAV.bundle?tab=readme-ov-file

JAVLibrary Recently, JAVLibrary reenabled cloudflare challenge. To bypass it, you have to follow these steps:

1) Visit JAVLibrary on your server and pass the challenge. 2) After you can see content on JAVLibrary

    2.1)open developer tools of your browser by pressing F12,

    2.2)refresh the page

    2.3)choose Network tab and select Doc

    2.4)choose the first request, copy the User-Agent header in your request and cf_clearance cookie value to the 
          configuration in your plex agent Settings

Note:

The source IP address you visit JAVLibrary should be identical to your plex server outbound IP address, if you are using a proxy, the address would be the outbound IP address of your proxy; The cf_clearance value may change frequently, especially when you are using a proxy, every time your IP changes, the cf_clearance changes; Every time you update your browser, the User-Agent would change. Or simply, you can use this project: CF-Clearance-Scraper to get cf_clearance cookie.

adultmm commented 2 months ago

Yes, this scraper is broken because of the CloudFlare challenge. Unfortunately, I haven't found any solution for this type of challenge yet, and FlareSolverr doesn't work with it either.

Every idea or solution for this problem is very welcome.

adultmm commented 2 months ago

The CF-Clearance-Scraper is not working either.

python main.py -v -f cookies.json https://www.javlibrary.com/en/?v=javme5tj34 [19:14:24] [INFO] Launching headless browser... [19:14:26] [INFO] Going to https://www.javlibrary.com/en/?v=javme5tj34... [19:14:27] [INFO] Solving Cloudflare challenge [Managed]... [19:14:58] [ERROR] Failed to retrieve a Cloudflare clearance cookie.

adultmm commented 1 month ago

Jav.Guru scraper has been implemented in v1.0.0-beta2.

There isn't runtime information and fewer images, but it works as far as I could test. Give it a try and let me know if you find any problems.