search

CodyBerenson / PGMA-Modernized

An updated approach for Plex Gay Media Adult Agents for both Full Feature Films and Scenes
MIT License
124 stars 46 forks source link

[BUG]: latest plugins cannot scrape #213

Closed vampirelayer closed 1 year ago

vampirelayer commented 1 year ago

Mandatory

Describe the bug:

I have just downloaded the latest plugins and tried scraping some films. None of them is matching.

Specific Agent(s) Causing the Issue:

Index Site URL(s) Attempting to Match:

Try these: https://gayeroticvideoindex.com/video/69676 https://gayeroticvideoindex.com/video/21504 https://www.gaydvdempire.com/2521339/dirty-stories-porn-videos.html

Log Attached:

com.plexapp.agents.GayHotMovies.log com.plexapp.agents.GayEmpire.log com.plexapp.agents.GayDVDEmpire.log com.plexapp.agents.AEBN.log com.plexapp.agents.GEVI.log

Optional

Screenshot(s) with all nudity redacted:

Additional Context:

Desktop (please complete the following information):

CodyBerenson commented 1 year ago

Hi @vampirelayer ,

Jason will be better positioned to troubleshoot, but I do see something referenced in your log that may be the culprit, the missing plex token. In the preferences for each agent, for certain non windows systems perhaps like yours, you may need to enter your plex token. Here's a link for a similar resolution:

https://github.com/CodyBerenson/PGMA-Modernized/issues/207#issuecomment-1360444242

image

there are multiple ways for you to find your plex token. here's the easiest for me to remember: Select "Get Info" for any title in your library, select view XML, and the token is at the end of the address string.

image

Hope this helps.

JPH71 commented 1 year ago

@Xtian

Also make sure that you go through the preferences for all the agents and save after viewing them, so that Plex picks up the new settings.

Also, GayDVDEmpire has been renamed GayEmpire... so you need to delete that bundle!!!

AEBNiii is now AEBN

I will now look at your logs....

After you have done this - quit Plex Media Server and restart.

When you go into the agent logs, you will be able to see in the log file that the scraping process has been set up correctly... This part of the log shows up when you restart Plex.

Jason

On Sun, 8 Jan 2023 at 19:28, Cody Berenson @.***> wrote:

Hi @vampirelayer https://github.com/vampirelayer ,

Jason will be better positioned to troubleshoot, but I do see something referenced in your log that may be the culprit, the missing plex token. In the preferences for each agent, for certain non windows systems perhaps like yours, you may need to enter your plex token. Here's a link for a similar resolution:

207 (comment)

https://github.com/CodyBerenson/PGMA-Modernized/issues/207#issuecomment-1360444242

[image: image] https://user-images.githubusercontent.com/40373801/211214889-cc0a77ed-a16e-49de-981b-052c709f06fc.png

there are multiple ways for you to find your plex token. here's the easiest for me to remember: Select "Get Info" for any title in your library, select view XML, and the token is at the end of the address string.

[image: image] https://user-images.githubusercontent.com/40373801/211214989-e1f63dcc-f061-44c9-9d54-bd29ddc75fae.png

Hope this helps.

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1374909436, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKJJHWV7L6V4B5MWARLWRMIPJANCNFSM6AAAAAATUHUBFY . You are receiving this because you are subscribed to this thread.Message ID: @.***>

JPH71 commented 1 year ago

Just looked through the logs... You can see it states that the Plex token has not been found and that scraping can not continue: 2023-01-08 08:08:48,557 (70000d78c000) : ERROR (sandbox:19) - AEBN - SEARCH:: Error: <QUIT: Scraping Parameters Not Set Up!>

On Sun, 8 Jan 2023 at 19:40, Jason Hudson @.***> wrote:

@Xtian

Also make sure that you go through the preferences for all the agents and save after viewing them, so that Plex picks up the new settings.

Also, GayDVDEmpire has been renamed GayEmpire... so you need to delete that bundle!!!

AEBNiii is now AEBN

I will now look at your logs....

After you have done this - quit Plex Media Server and restart.

When you go into the agent logs, you will be able to see in the log file that the scraping process has been set up correctly... This part of the log shows up when you restart Plex.

Jason

On Sun, 8 Jan 2023 at 19:28, Cody Berenson @.***> wrote:

Hi @vampirelayer https://github.com/vampirelayer ,

Jason will be better positioned to troubleshoot, but I do see something referenced in your log that may be the culprit, the missing plex token. In the preferences for each agent, for certain non windows systems perhaps like yours, you may need to enter your plex token. Here's a link for a similar resolution:

207 (comment)

https://github.com/CodyBerenson/PGMA-Modernized/issues/207#issuecomment-1360444242

[image: image] https://user-images.githubusercontent.com/40373801/211214889-cc0a77ed-a16e-49de-981b-052c709f06fc.png

there are multiple ways for you to find your plex token. here's the easiest for me to remember: Select "Get Info" for any title in your library, select view XML, and the token is at the end of the address string.

[image: image] https://user-images.githubusercontent.com/40373801/211214989-e1f63dcc-f061-44c9-9d54-bd29ddc75fae.png

Hope this helps.

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1374909436, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKJJHWV7L6V4B5MWARLWRMIPJANCNFSM6AAAAAATUHUBFY . You are receiving this because you are subscribed to this thread.Message ID: @.***>

vampirelayer commented 1 year ago

The tips worked! Was worried Plex had broke on my machine. Just curious if the missing token is a Mac OS limitation that can be overcome by upgrading certain dependencies on my machine. I have not encountered this before ...

JPH71 commented 1 year ago

If you can provide the path to the preferences.xml file on your system, i can then try and code it in for you...

We can then try and test this...

On Mon, 9 Jan 2023, 03:55 Xtian Hog, @.***> wrote:

The tips worked! Was worried Plex had broke on my machine. Just curious if the missing token is a Mac OS limitation that can be overcome by upgrading certain dependencies on my machine. I have not encountered this before ...

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1375073606, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKNCAFFIWC3S2SMHRWDWROD3XANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

vampirelayer commented 1 year ago

I can't seem to find a single preferences.xml in MacOS. These are scattered, one for each agent, which is as expected from the tips provided. A bit strange why the directory structure is different from other OS though. image

JPH71 commented 1 year ago

I will look through the documentation and send it to you.. then you can check to see if its installed in the same place... Then one can try and code it...

On Mon, 9 Jan 2023, 14:26 Xtian Hog, @.***> wrote:

I can't seem to find a single preferences.xml in MacOS. These are scattered, one for each agent, which is as expected from the tips provided. A bit strange why the directory structure is different from other OS though. [image: image] https://user-images.githubusercontent.com/81353722/211330202-f1f8b0b3-9261-4cec-bb4f-2b2e3b0a567c.png

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1375703690, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKNVRHJUQL3SNO3GF5TWRQNZPANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

JPH71 commented 1 year ago

This picture folder list is definitely the wrong place...

On Mon, 9 Jan 2023, 19:17 Jason Hudson, @.***> wrote:

I will look through the documentation and send it to you.. then you can check to see if its installed in the same place... Then one can try and code it...

On Mon, 9 Jan 2023, 14:26 Xtian Hog, @.***> wrote:

I can't seem to find a single preferences.xml in MacOS. These are scattered, one for each agent, which is as expected from the tips provided. A bit strange why the directory structure is different from other OS though. [image: image] https://user-images.githubusercontent.com/81353722/211330202-f1f8b0b3-9261-4cec-bb4f-2b2e3b0a567c.png

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1375703690, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKNVRHJUQL3SNO3GF5TWRQNZPANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

JPH71 commented 1 year ago

On the MAC, there seems to be no preferences.xml file....

Look in the other linux areas.... If it is not there, find the file mentioned below and send it to me so that i can code a solution and get the value from the file Also let me know to the full path to your file on your computer..... you can xxxxx any personal names in the folder path

Jason xxx

Location of the Plex server token

The Plex token for your server is stored in a location that is dependent on what operating system you use for your Plex server: Location of the Server Plex Token Operating SystemLocation Windows HKEY_CURRENT_USER\Software\Plex, Inc.\Plex Media Server Value: PlexOnlineToken MacOS ~/Library/Preferences/com.plexapp.plexmediaserver.plist Key: PlexOnlineToken Linux $PLEX_HOME/Library/Application Support/Plex Media Server/Preferences. xml Value: PlexOnlineToken Debian, Fedora, Ubuntu, and CentOS /var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Preferences.xml Value: PlexOnlineToken

On Mon, 9 Jan 2023 at 19:18, Jason Hudson @.***> wrote:

This picture folder list is definitely the wrong place...

On Mon, 9 Jan 2023, 19:17 Jason Hudson, @.***> wrote:

I will look through the documentation and send it to you.. then you can check to see if its installed in the same place... Then one can try and code it...

On Mon, 9 Jan 2023, 14:26 Xtian Hog, @.***> wrote:

I can't seem to find a single preferences.xml in MacOS. These are scattered, one for each agent, which is as expected from the tips provided. A bit strange why the directory structure is different from other OS though. [image: image] https://user-images.githubusercontent.com/81353722/211330202-f1f8b0b3-9261-4cec-bb4f-2b2e3b0a567c.png

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1375703690, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKNVRHJUQL3SNO3GF5TWRQNZPANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

jfreiman commented 1 year ago

I had the same issue (missing token) on Windows 11, but none of the agents were working - for any website.

Using your instructions to locate and add the token to each Agent, I was able to fix the issue!

FYI, I also cannot locate the preferences.xml file in my %\AppData\Local\Plex Media Server folder.

JPH71 commented 1 year ago

You are looking in the wrong place It's in %LOCALAPPDATA%\Plex\Plex Média Server

I am using Windows 10... Hopefully the buggers in Microsoft haven't changed things too much

On Thu, 12 Jan 2023, 00:35 jfreiman, @.***> wrote:

I had the same issue (missing token) on Windows 11.

Using your instructions to locate and add the token to each Agent, I was able to fix the issue! FYI, I also cannot locate the preferences.xml file in my %\AppData\Local\Plex Media Server folder.

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1379659222, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKPWS7YR5TI7Q2MNMKDWR5GVPANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

jfreiman commented 1 year ago

You are looking in the wrong place It's in %LOCALAPPDATA%\Plex\Plex Média Server I am using Windows 10... Hopefully the buggers in Microsoft haven't changed things too much … On Thu, 12 Jan 2023, 00:35 jfreiman, @.> wrote: I had the same issue (missing token) on Windows 11. Using your instructions to locate and add the token to each Agent, I was able to fix the issue! FYI, I also cannot locate the preferences.xml file in my %\AppData\Local\Plex Media Server folder. — Reply to this email directly, view it on GitHub <#213 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKPWS7YR5TI7Q2MNMKDWR5GVPANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.>

Found it, it was exactly where you said it would be. Thank you.

Also, I just updated to the latest PGMA release (2023-01-12) After the update, the tokens I manually entered were still present and I did not have to re-enter them into the Agent.

JPH71 commented 1 year ago

It should have found the preferences.xml file and extracted the token from it...

Cody should have uploaded the newest versions to the repository... I have improved the token retrieval code...

Download the latest and test...

On Fri, 13 Jan 2023, 02:12 jfreiman, @.***> wrote:

You are looking in the wrong place It's in %LOCALAPPDATA%\Plex\Plex Média Server I am using Windows 10... Hopefully the buggers in Microsoft haven't changed things too much … <#m777183303817486746> On Thu, 12 Jan 2023, 00:35 jfreiman, @.> wrote: I had the same issue (missing token) on Windows 11. Using your instructions to locate and add the token to each Agent, I was able to fix the issue! FYI, I also cannot locate the preferences.xml file in my %\AppData\Local\Plex Media Server folder. — Reply to this email directly, view it on GitHub <#213 (comment) https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1379659222>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKPWS7YR5TI7Q2MNMKDWR5GVPANCNFSM6AAAAAATUHUBFY https://github.com/notifications/unsubscribe-auth/AKI3AKPWS7YR5TI7Q2MNMKDWR5GVPANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.>

Found it, it was exactly where you said it would be. Thank you.

Also, I just updated to the latest PGMA release (2023-01-12) After the update, the tokens I manually entered were still present and I did not have to re-enter them into the Agent.

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1381225350, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKM23BCISLBD6437RQLWSC2YVANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

vampirelayer commented 1 year ago

Thanks! I have tested with the latest, and I'm seeing a few errors. I wonder if it's because of the binary nature of plist files. com.plexapp.agents.GEVI.log

I'm also seeing an error in the Plex Media Server.log during startup, not sure if there's anything to do with it

Jan 15, 2023 17:55:40.647 [0x70000d2e6000] WARN - [HttpClient/HCl#2a] HTTP error requesting GET https://112-199-182-90.8ee9a66d75d34c6d99077c1e700e5ce4.plex.direct:15050/identity (7, Couldn't connect to server) (Failed to connect to 112-199-182-90.8ee9a66d75d34c6d99077c1e700e5ce4.plex.direct port 15050: Connection refused) Plex Media Server.log

JPH71 commented 1 year ago

Could you send me your plist file - I need to know how it is set up so that I can extract the token

Cheers

JPH71 commented 1 year ago

@Xtian Could you send me your preferences plist file, so that I can look at the setup and make sure the code I am using to read the file works???

Jason

On Sun, 15 Jan 2023 at 10:11, Xtian Hog @.***> wrote:

Thanks! I have tested with the latest, and I'm seeing a few errors. I wonder if it's because of the binary nature of plist files. com.plexapp.agents.GEVI.log https://github.com/CodyBerenson/PGMA-Modernized/files/10419908/com.plexapp.agents.GEVI.log

I'm also seeing an error in the Plex Media Server.log during startup, not sure if there's anything to do with it

Jan 15, 2023 17:55:40.647 [0x70000d2e6000] WARN - [HttpClient/HCl#2a] HTTP error requesting GET https://112-199-182-90.8ee9a66d75d34c6d99077c1e700e5ce4.plex.direct:15050/identity (7, Couldn't connect to server) (Failed to connect to 112-199-182-90.8ee9a66d75d34c6d99077c1e700e5ce4.plex.direct port 15050: Connection refused) Plex Media Server.log https://github.com/CodyBerenson/PGMA-Modernized/files/10419913/Plex.Media.Server.log

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1383110450, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKJQKENQQMYL7GTEEPTWSPEM7ANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

vampirelayer commented 1 year ago

Is there an email address I can send it to? The plist file contains rather sensitive information.

JPH71 commented 1 year ago

@.***

Cheers man

On Sat, 21 Jan 2023, 13:29 Xtian Hog, @.***> wrote:

Is there an email address I can send it to? The plist file contains rather sensitive information.

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1399242463, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKM53TUZZQX4YDVNFOTWTPJAXANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

vampirelayer commented 1 year ago

Your email address has been redacted!

JPH71 commented 1 year ago

Jp dot Hudson at Gmail dot com

On Sat, 21 Jan 2023, 16:29 Xtian Hog, @.***> wrote:

Your email address has been redacted!

— Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/213#issuecomment-1399271634, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKMMJEAV4M7NYSE5423WTP6E7ANCNFSM6AAAAAATUHUBFY . You are receiving this because you commented.Message ID: @.***>

JPH71 commented 1 year ago

Could you confirm if the latest bundle, I sent this evening to Cody fixed this?? The current latest, that I sent in yesterday would not work on Linux/Mac as it tried to import a windows only module... Once tested please close bug...

vampirelayer commented 1 year ago

Works for full films now, will raise a new one for scenes.

joshallen13 commented 6 months ago

When you’re viewing an entry in your library, look for the three dots on the bottom right of the movie poster. It can be any library and item in your Plex collection.  Then you’ll see “Get Info” on the bottom menu item here. In that menu, look for “View XML”.

It’ll open up a lot of gibberish. Ignore that and go to your browser address bar. Here scroll all the way to the end and you will see the words “Plex Access Token”. The token is all the string of characters after the “=“ sign. Hope that helps.

Joshua R. Allen Sent from my iPhone On Mar 8, 2024 at 7:29 PM -0500, Marcus @.***>, wrote:

Would you be so kind as to help me (and perhaps provide an additional illustration in your directions) as to where to find said token in said address string? Here's an example of one of mine but with this cold pounding my head I am not seeing straight (get it?). Thanks much! — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>

joshallen13 commented 6 months ago

Joshua R. Allen Sent from my iPhone On Mar 8, 2024 at 8:20 PM -0500, Joshua Allen @.***>, wrote:

When you’re viewing an entry in your library, look for the three dots on the bottom right of the movie poster. It can be any library and item in your Plex collection. <Screenshot 2024-03-08 at 8.15.20 PM.png> Then you’ll see “Get Info” on the bottom menu item here. In that menu, look for “View XML”. <Screenshot 2024-03-08 at 8.09.46 PM.png> It’ll open up a lot of gibberish. Ignore that and go to your browser address bar. Here scroll all the way to the end and you will see the words “Plex Access Token”. The token is all the string of characters after the “=“ sign. Hope that helps.

Joshua R. Allen Sent from my iPhone On Mar 8, 2024 at 7:29 PM -0500, Marcus @.***>, wrote:

Would you be so kind as to help me (and perhaps provide an additional illustration in your directions) as to where to find said token in said address string? Here's an example of one of mine but with this cold pounding my head I am not seeing straight (get it?). Thanks much! — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>