search

PAhelper / PhoenixAdult.bundle

Plex Meta-Data Agent for scene videos from multiple adult sites
358 stars 140 forks source link

Combine sites into Wow Network #1730

Open Demyrian opened 1 year ago

Demyrian commented 1 year ago

This is sort of a continuation from https://github.com/PAhelper/PhoenixAdult.bundle/issues/1729. It would be great if the two Wow Network sites that are available, 18OnlyGirls and WowGirls could be combined in addition to adding WowPorn. All three sites appear to have very similar source code. Searching all three sites would greatly help finding scenes as they get changed around over the years. In addition, the following could be added as sitename aliases as some older scenes use them instead of the three above.

AllFineGirls ex: https://www.18onlygirlsblog.com/a-super-duper-girl-2/

SuperSkinnyGirls ex: https://www.18onlygirlsblog.com/let-me-taste-it/

YoungLegalPorn ex: https://www.18onlygirlsblog.com/frail-beauty-2/

From my very limited search, it appears that every old site has moved to https://18onlygirls.com so at the very least they could be added there.

Breakdown of request:

Demyrian commented 1 year ago

I merged all three sites into WowNetwork (https://github.com/PAhelper/PhoenixAdult.bundle/pull/1738) and almost everything works. Some scenes cause an IndexError: list index out of range error.

Here's the log for a scene that works

Details `2023-02-27 01:14:07,217 (7f9fd77c4b38) : DEBUG (runtime:717) - Handling request GET /:/plugins/com.plexapp.agents.phoenixadult/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M1Ck1vdmllczEwCm1lZGlhX3R5cGUzCnM0CjMxOTZzMgppZHMzMwpXb3dHaXJscyAtIEZ1Y2tpbmcgQSBSZWQgVW1icmVsbGFzNApuYW1lczQKMjAxOXM0CnllYXJyMAo_ 2023-02-27 01:14:07,218 (7f9fd77c4b38) : DEBUG (runtime:49) - Received packed state data (80 bytes) 2023-02-27 01:14:07,219 (7f9fd77c4b38) : DEBUG (runtime:814) - Found route matching /:/plugins/com.plexapp.agents.phoenixadult/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M1Ck1vdmllczEwCm1lZGlhX3R5cGUzCnM0CjMxOTZzMgppZHMzMwpXb3dHaXJscyAtIEZ1Y2tpbmcgQSBSZWQgVW1icmVsbGFzNApuYW1lczQKMjAxOXM0CnllYXJyMAo_ 2023-02-27 01:14:07,219 (7f9fd77c4b38) : INFO (agentkit:961) - Searching for matches for {'year': '2019', 'id': '3196', 'name': 'WowGirls - Fucking A Red Umbrella'} 2023-02-27 01:14:07,219 (7f9fd77c4b38) : DEBUG (networking:143) - Requesting 'http:///library/metadata/3196/tree' 2023-02-27 01:14:07,226 (7f9fd77c4b38) : INFO (__init__:68) - ***MEDIA TITLE [from media.name]*** WowGirls - Fucking A Red Umbrella 2023-02-27 01:14:07,226 (7f9fd77c4b38) : INFO (PAsearchSites:51) - mediaTitle w/ possible abbreviation: WowGirls - Fucking A Red Umbrella 2023-02-27 01:14:07,235 (7f9fd77c4b38) : INFO (PAsearchSites:59) - mediaTitle w/ possible abbrieviation fixed: WowGirls - Fucking A Red Umbrella 2023-02-27 01:14:07,242 (7f9fd77c4b38) : INFO (PAsearchSites:71) - ^^^^^^^ siteNum: 743 2023-02-27 01:14:07,242 (7f9fd77c4b38) : INFO (PAsearchSites:72) - ^^^^^^^ Shortening Title 2023-02-27 01:14:07,246 (7f9fd77c4b38) : INFO (PAsearchSites:96) - Search Title (before date processing): Fucking a Red Umbrella 2023-02-27 01:14:07,246 (7f9fd77c4b38) : INFO (__init__:70) - {'siteName': 'wowgirls', 'searchDate': None, 'siteNum': 743, 'searchTitle': 'Fucking a Red Umbrella'} 2023-02-27 01:14:07,246 (7f9fd77c4b38) : INFO (PAsearchData:23) - SearchData.title: Fucking a Red Umbrella 2023-02-27 01:14:07,247 (7f9fd77c4b38) : INFO (__init__:107) - Provider: networkWowNetwork 2023-02-27 01:14:07,271 (7f9fd77c4b38) : INFO (PAutils:183) - Requesting GET "https://www.wowgirlsblog.com/?s=Fucking%20a%20Red%20Umbrella" 2023-02-27 01:14:09,019 (7f9fd77c4b38) : INFO (PAutils:282) - GZip request saved as "4383a50b5cd04fab946f1a99d956dbdd.gz" 2023-02-27 01:14:09,024 (7f9fd77c4b38) : INFO (PAutils:183) - Requesting GET "https://www.wowgirlsblog.com/?s=Fucking%20a%20Red%20Umbrella" 2023-02-27 01:14:09,334 (7f9fd77c4b38) : INFO (PAutils:282) - GZip request saved as "7827d6f64ce54c149386eb74c86a565f.gz" 2023-02-27 01:14:09,340 (7f9fd77c4b38) : DEBUG (runtime:88) - Sending packed state data (112 bytes) 2023-02-27 01:14:09,340 (7f9fd77c4b38) : DEBUG (runtime:924) - Response: [200] str, 1576 bytes `

Here's the log for a scene that doesn't work

Details `2023-02-27 01:16:07,578 (7f9fd77c4b38) : DEBUG (runtime:717) - Handling request GET /:/plugins/com.plexapp.agents.phoenixadult/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M1Ck1vdmllczEwCm1lZGlhX3R5cGUzCnM0CjMyMjFzMgppZHMxNwpXb3dHaXJscyAtIFZpc2lvbnM0Cm5hbWVzNAoyMDE5czQKeWVhcnIwCg__ 2023-02-27 01:16:07,579 (7f9fd77c4b38) : DEBUG (runtime:49) - Received packed state data (80 bytes) 2023-02-27 01:16:07,580 (7f9fd77c4b38) : DEBUG (runtime:814) - Found route matching /:/plugins/com.plexapp.agents.phoenixadult/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M1Ck1vdmllczEwCm1lZGlhX3R5cGUzCnM0CjMyMjFzMgppZHMxNwpXb3dHaXJscyAtIFZpc2lvbnM0Cm5hbWVzNAoyMDE5czQKeWVhcnIwCg__ 2023-02-27 01:16:07,580 (7f9fd77c4b38) : INFO (agentkit:961) - Searching for matches for {'year': '2019', 'id': '3221', 'name': 'WowGirls - Vision'} 2023-02-27 01:16:07,580 (7f9fd77c4b38) : DEBUG (networking:143) - Requesting 'http:///library/metadata/3221/tree' 2023-02-27 01:16:07,587 (7f9fd77c4b38) : INFO (__init__:68) - ***MEDIA TITLE [from media.name]*** WowGirls - Vision 2023-02-27 01:16:07,587 (7f9fd77c4b38) : INFO (PAsearchSites:51) - mediaTitle w/ possible abbreviation: WowGirls - Vision 2023-02-27 01:16:07,597 (7f9fd77c4b38) : INFO (PAsearchSites:59) - mediaTitle w/ possible abbrieviation fixed: WowGirls - Vision 2023-02-27 01:16:07,604 (7f9fd77c4b38) : INFO (PAsearchSites:71) - ^^^^^^^ siteNum: 743 2023-02-27 01:16:07,605 (7f9fd77c4b38) : INFO (PAsearchSites:72) - ^^^^^^^ Shortening Title 2023-02-27 01:16:07,608 (7f9fd77c4b38) : INFO (PAsearchSites:96) - Search Title (before date processing): Vision 2023-02-27 01:16:07,609 (7f9fd77c4b38) : INFO (__init__:70) - {'siteName': 'wowgirls', 'searchDate': None, 'siteNum': 743, 'searchTitle': 'Vision'} 2023-02-27 01:16:07,609 (7f9fd77c4b38) : INFO (PAsearchData:23) - SearchData.title: Vision 2023-02-27 01:16:07,609 (7f9fd77c4b38) : INFO (__init__:107) - Provider: networkWowNetwork 2023-02-27 01:16:07,611 (7f9fd77c4b38) : INFO (PAutils:183) - Requesting GET "https://www.wowgirlsblog.com/?s=Vision" 2023-02-27 01:16:09,208 (7f9fd77c4b38) : INFO (PAutils:282) - GZip request saved as "e4e31ffe50e042fbb84ba53d1b16f2ed.gz" 2023-02-27 01:16:09,213 (7f9fd77c4b38) : INFO (PAutils:183) - Requesting GET "https://www.wowgirlsblog.com/?s=Vision" 2023-02-27 01:16:10,847 (7f9fd77c4b38) : INFO (PAutils:282) - GZip request saved as "b0e28e543f804494923c2746e3910400.gz" 2023-02-27 01:16:10,851 (7f9fd77c4b38) : ERROR (__init__:111) - Traceback (most recent call last): File "/home/someone9456/Library/Application Support/Plex Media Server/Plug-ins/PhoenixAdult.bundle/Contents/Code/__init__.py", line 109, in search provider.search(results, lang, siteNum, search) File "/home/someone9456/Library/Application Support/Plex Media Server/Plug-ins/PhoenixAdult.bundle/Contents/Code/networkWowNetwork.py", line 18, in search image = PAutils.Encode(searchResult.xpath('.//img/@src')[0]) File "/mnt/mpathy/someone9456/Library/Plex/plexmediaserver-1.30.2.6563-3d4dc0cce.x86_64/usr/lib/plexmediaserver/Resources/Plug-ins-3d4dc0cce/Framework.bundle/Contents/Resources/Versions/2/Python/Framework/code/sandbox.py", line 108, in _getitem_ = lambda x, y: x.__getitem__(y), IndexError: list index out of range`

I think the error lies in the fact that different scenes have different img xpath structure. Here's for the one that works <img class="lazy loaded" src="https://www.wowgirlsblog.com/wp-content/uploads/2013/09/6595_My_Toy_Boy.jpg" data-src="https://www.wowgirlsblog.com/wp-content/uploads/2013/09/6595_My_Toy_Boy.jpg" alt="My Toy Boy" data-was-processed="true" title="" style="" width="640" height="360">

And here's the one that doesn't work <img data-src="https://www.wowgirlsblog.com/wp-content/uploads/2014/12/10852_This_Is_My_Only_Hobby.jpg" alt="This Is My Only Hobby!" class="loaded" src="https://www.wowgirlsblog.com/wp-content/uploads/2014/12/10852_This_Is_My_Only_Hobby.jpg" data-was-processed="true" title="" style="" width="300" height="168.75">

I think since it's looking for .//img/@src (https://github.com/PAhelper/PhoenixAdult.bundle/pull/1738/files#diff-2927d0a8ca25939606b65ffd1e2ae2034d3e0c5e14dd719ac1f4a8edfa5050afL18), it can't find it in the second one.