CodyBerenson / PGMA-Modernized

An updated approach for Plex Gay Media Adult Agents for both Full Feature Films and Scenes
MIT License
125 stars 46 forks source link

WB and FG not pulling in posters #15

Closed j-ktz closed 4 years ago

j-ktz commented 4 years ago

I downloaded fresh new agents from the Code page yesterday and replaced them all and stopped/started server. WB and FG files will put in all metadata except posters. I checked and I am still using https://cdn.vigue.me/unsafe in the agent settings. Is that still correct?

CodyBerenson commented 4 years ago

Hi @j-ktz

Sorry to hear you're having an issue. That is the correct image cropping location. I've been indexing all morning and everything is working fine.

I imagine @jph71 Jason is going to need to see your logs. Can you please attach?

CodyBerenson commented 4 years ago

@j-ktz @JPH71

GitHub mistakenly flagged the site in their automated scripts they run where they're looking for fake "spammy" accounts. Sorry to have been out of touch. Are you still having issues? If so, can you provide your logs for Jason?

In the meantime, he's been very busy creating new agents/updating existing agents, so he's been giving me quite a backlog of testing. If he weren't such a genius, I'd smack him silly for "fixing" things that aren't broke. LOL.

Cody

p.s. no injecting, drinking, or gargling with disinfectant, please. If you insist on introducing disinfectant into your body, please do so by incorporating into your marinades and brines. Disinfectant, and direct sunlight, is only safe when incorporated as part of a well balanced meal.

JPH71 commented 4 years ago

@CodyBerenson With this lockdown - i would give up my lower cheeks for a smack! :-)

On Mon, 27 Apr 2020 at 12:24, CodyBerenson notifications@github.com wrote:

@j-ktz https://github.com/j-ktz @JPH71 https://github.com/JPH71

GitHub mistakenly flagged the site in their automated scripts they run where they're looking for fake "spammy" accounts. Sorry to have been out of touch. Are you still having issues? If so, can you provide your logs for Jason?

In the meantime, he's been very busy creating new agents/updating existing agents, so he's been giving me quite a backlog of testing. If he weren't such a genius, I'd smack him silly for "fixing" things that aren't broke. LOL.

Cody

p.s. no injecting, drinking, or gargling with disinfectant, please. If you insist on introducing disinfectant into your body, please do so by incorporating into your marinades and brines. Disinfectant, and direct sunlight, is only safe when incorporated as part of a well balanced meal.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-619919696, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKOZL54L4OWVXEOPQPTROVTQHANCNFSM4MOFRAGA .

JPH71 commented 4 years ago

quick question - i noticed that GEVI also gives scene breakdowns like IAFD... would you like this scrapped?

On Mon, 27 Apr 2020 at 12:42, Jason Hudson jp.hudson@gmail.com wrote:

@CodyBerenson With this lockdown - i would give up my lower cheeks for a smack! :-)

On Mon, 27 Apr 2020 at 12:24, CodyBerenson notifications@github.com wrote:

@j-ktz https://github.com/j-ktz @JPH71 https://github.com/JPH71

GitHub mistakenly flagged the site in their automated scripts they run where they're looking for fake "spammy" accounts. Sorry to have been out of touch. Are you still having issues? If so, can you provide your logs for Jason?

In the meantime, he's been very busy creating new agents/updating existing agents, so he's been giving me quite a backlog of testing. If he weren't such a genius, I'd smack him silly for "fixing" things that aren't broke. LOL.

Cody

p.s. no injecting, drinking, or gargling with disinfectant, please. If you insist on introducing disinfectant into your body, please do so by incorporating into your marinades and brines. Disinfectant, and direct sunlight, is only safe when incorporated as part of a well balanced meal.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-619919696, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKOZL54L4OWVXEOPQPTROVTQHANCNFSM4MOFRAGA .

JPH71 commented 4 years ago

I downloaded fresh new agents from the Code page yesterday and replaced them all and stopped/started server. WB and FG files will put in all metadata except posters. I checked and I am still using https://cdn.vigue.me/unsafe in the agent settings. Is that still correct?

@j-ktz - send me the logs - or at least an example of the file you are trying to scrape - otherwise I won't be able to find the problem!

j-ktz commented 4 years ago

Hello Boys! I was worried we were gonna lose each other and I was gonna have to try and hunt you both down on social to try and put this thing back together. @JPH71, I'll send you logs when I can! It was every WB and FB poster. All data was coming in except posters. I know that isn't helpful so I'll send logs ASAP. Good to hear you're both okay!

j-ktz commented 4 years ago

@JPH71 Here's an example I just did for FG. It pulls in all metadata great except poster. Logs attached.

screenshot 2020-04-27 at 3 43 37 PM screenshot 2020-04-27 at 3 43 32 PM

Archive 2.zip

CodyBerenson commented 4 years ago

@JPH71 Re: IAFD scene info, It would be terrific if you could pull in the synopsis first, new paragraph, scene info. thats what i do when i manually create the xml

JPH71 commented 4 years ago

@j-ktz, are you on a windows machine?? As it is failing to get the %TEMP% folder, if not I will have to make a change to the scene agents..... there is an error in the logic.... damn!

On Mon, 27 Apr 2020 at 20:44, j-ktz notifications@github.com wrote:

@JPH71 https://github.com/JPH71 Here's an example I just did for FG. It pulls in all metadata great except poster. Logs attached. [image: screenshot 2020-04-27 at 3 43 37 PM] https://user-images.githubusercontent.com/59346628/80413741-f0d5ae00-889d-11ea-9d9c-b0b1e4bf5ccf.png [image: screenshot 2020-04-27 at 3 43 32 PM] https://user-images.githubusercontent.com/59346628/80413743-f0d5ae00-889d-11ea-8de1-a7171c9a77c3.png Archive 2.zip https://github.com/CodyBerenson/PGMA-Modernized/files/4541719/Archive.2.zip

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-620194474, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKMVXLSEUL6HIYQXBG3ROXOB7ANCNFSM4MOFRAGA .

JPH71 commented 4 years ago

@j-ktz I have made the changes to Fagalicious to enable the posters to work - I realised that the same error would be in the other two as it was looking for an environment variable that would not be on a non-windows machine.From what I can remember you are using a MAC???Test to see if these work on your MAC @CodyBerenson  Just in case I haven't effed anything else up - could you test that they work on Windows based machine.Once I have written python code to deal with the cropping, this functionality will not be restricted to windows machines only...

Cheers Jason

here are the 3 bundles

CodyBerenson commented 4 years ago

I'm having problems with QC and F. and , just with version control in general. tooooo many updates flying around. We need to get back on the rails.

CodyBerenson commented 4 years ago

strike that. QC isn't working. And now I don't know which version to revert to to see if it works, because there are so many in the emails. ARGH!

CodyBerenson commented 4 years ago

QC files that don't work:

(NextDoorStudios) - Evan Landers and Tannor Reed (2020).mp4 (Men.com) - Colby Tucker and Paul Canon (2020).mp4

CodyBerenson commented 4 years ago

I removed the bundles from the earlier thread. At this point I don't know what to do other than to close this issue, open a new issue that is specific to non windows machines.

I hadn't tested the all-bundles email, so i don't know if the broken QC is in what you just fixed, the previous bundle, etc.

CodyBerenson commented 4 years ago

The All Bundles QC didn't work on these files either.

CodyBerenson commented 4 years ago

hold up. in your email musing about possible improvements to agents, you discuss removing ".com"....is there a change to the naming rules introduced now?

CodyBerenson commented 4 years ago

The QC bundle in the master repository matches these files. You have a version control issue my friend. Somewhere you fixed something...not relating to j-ktz's issue...that broke the matching. I'll test F now.

CodyBerenson commented 4 years ago

I took the 8 most recent F scenes, and all match. I'll test WB now and then more indepth QC.

CodyBerenson commented 4 years ago

I took the 12 most recent WB scenes and all match. Indepth testing QC now

JPH71 commented 4 years ago

hold up. in your email musing about possible improvements to agents, you discuss removing ".com"....is there a change to the naming rules introduced now?

I was just thinking of it as an enhancement - i have not made any changes......

JPH71 commented 4 years ago

I'm having problems with QC and F. and , just with version control in general. tooooo many updates flying around. We need to get back on the rails.

Shit - I forgot to update the version numbers - let me do that after testing QC - so that we have everything in alignment...

CodyBerenson commented 4 years ago

I took the 12 most recent QC files. zero match. here's the log.

com.plexapp.agents.QueerClick.log

JPH71 commented 4 years ago

@CodyBerenson

I have upped the version for QC, and corrected the error... Both files you sent me to test with matched straight away. Here is the bundle

@j-ktz You will need to test this on your MAC

JPH71 commented 4 years ago

When I get time - I will look at some python code to do what the vbScript code does.....

CodyBerenson commented 4 years ago

What change did you make to F? because, when testing a QC file (F is ordered higher in my priority than QC), it is churning and churning and churning, filling log after log after log. Once it reaches 1,024 KB, it starts a new file its on file 7 now.

com.plexapp.agents.Fagalicious.log.zip

CodyBerenson commented 4 years ago

10 minutes, and it is still churning building log files.

CodyBerenson commented 4 years ago

I killed PMS, unchecked F, and then tested QC. 12 of the most recent files, all 12 matched.

Although the twelve test files for F matched....a non F file sent it off into neverland. That's a Fail for now.

JPH71 commented 4 years ago

I made the same change to fagalicious that i did to waybig - near the poster retrieval..... This is the change i made today, Red is removed - Yellow is added [image: image.png]

moved the lines in red to here [image: image.png]

and to here for the background art [image: image.png]

On Tue, 28 Apr 2020 at 18:11, CodyBerenson notifications@github.com wrote:

What change did you make to F? because, when testing a QC file (F is ordered higher in my priority than QC), it is churning and churning and churning, filling log after log after log. Once it reaches 1,024 KB, it starts a new file its on file 7 now.

com.plexapp.agents.Fagalicious.log.zip https://github.com/CodyBerenson/PGMA-Modernized/files/4547380/com.plexapp.agents.Fagalicious.log.zip

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-620738744, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKMRJ5AXXEP2JVASS73RO4E2HANCNFSM4MOFRAGA .

CodyBerenson commented 4 years ago

LOL. me asking you what change you made was rhetorical. it wouldn't mean much to me. F generated two dozen logs on one scene, and would still be going if i hadn't killed it. It is a problem. Did you review the log? Why did it keep trying and trying and trying and trying? There definitely needs to be a limit to the number of results it cycles through.

JPH71 commented 4 years ago

I am looking through the code now...

GEVI was erroring on some titles - when i threw a bunch of files at it - so I have corrected it the title it was failing on was (Titan Media) - Caught In the Act (2013)

On Tue, 28 Apr 2020 at 20:46, CodyBerenson notifications@github.com wrote:

LOL. me asking you what change you made was rhetorical. it wouldn't mean much to me. F generated two dozen logs on one file, and would still be going if i hadn't killed it. It is a problem. Did you review the log? Why did it keep trying and trying and trying and trying? There definitely needs to be a limit to the number of results it cycles through.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-620816801, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKP737A6ESCK4KCCY6DRO4XAXANCNFSM4MOFRAGA .

JPH71 commented 4 years ago

What was the name of the file you were trying to match that kept churning???

On Tue, 28 Apr 2020 at 21:56, Jason Hudson jp.hudson@gmail.com wrote:

I am looking through the code now...

GEVI was erroring on some titles - when i threw a bunch of files at it - so I have corrected it the title it was failing on was (Titan Media) - Caught In the Act (2013)

On Tue, 28 Apr 2020 at 20:46, CodyBerenson notifications@github.com wrote:

LOL. me asking you what change you made was rhetorical. it wouldn't mean much to me. F generated two dozen logs on one file, and would still be going if i hadn't killed it. It is a problem. Did you review the log? Why did it keep trying and trying and trying and trying? There definitely needs to be a limit to the number of results it cycles through.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-620816801, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKP737A6ESCK4KCCY6DRO4XAXANCNFSM4MOFRAGA .

JPH71 commented 4 years ago

looking through the log file - i am hoping it's this one Noir Male: DeAngelo Jackson fucks Jacob Peterson in “Casting Couch” https://fagalicious.com/noir-male-deangelo-jackson-fucks-jacob-peterson-in-casting-couch/

On Tue, 28 Apr 2020 at 21:59, Jason Hudson jp.hudson@gmail.com wrote:

What was the name of the file you were trying to match that kept churning???

On Tue, 28 Apr 2020 at 21:56, Jason Hudson jp.hudson@gmail.com wrote:

I am looking through the code now...

GEVI was erroring on some titles - when i threw a bunch of files at it - so I have corrected it the title it was failing on was (Titan Media) - Caught In the Act (2013)

On Tue, 28 Apr 2020 at 20:46, CodyBerenson notifications@github.com wrote:

LOL. me asking you what change you made was rhetorical. it wouldn't mean much to me. F generated two dozen logs on one file, and would still be going if i hadn't killed it. It is a problem. Did you review the log? Why did it keep trying and trying and trying and trying? There definitely needs to be a limit to the number of results it cycles through.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-620816801, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKP737A6ESCK4KCCY6DRO4XAXANCNFSM4MOFRAGA .

CodyBerenson commented 4 years ago

No pumpkin, you are misunderstanding.

I wasn't trying to match a scene on F. I was testing QC. QC is lower in priority so it has to go thru WB and F to get to QC. It never got to QC because it churned endlessly in F. The agents, I believe, need to have a set limit of titles they'll search thru before giving up. The F agent churned and churned and churned, and built log after log after log.

The QC scene is

(NoirMale) - DeAngelo Jackson.mp4

CodyBerenson commented 4 years ago

So technically, all three agents you just posted match fine and retrieve posters, but I think its worth looking into the endless churn issue before releasing them as good-to-go.

JPH71 commented 4 years ago

@CodyBerenson

Hi Cody I found the error out - i was looking at the wrong bit of html when going for the next page - so it did page 1, then page 2 then went back to page 1.... ad infinitumThis has being sorted now - i tested it with (NoirMale) - DeAngelo Jackson and it found the correct number of results - 2 full pages and 1 title on the third page.

I then tested it on (NoirMale) - DeAngelo Jackson fucks Jackson Reed in “BBC Massage” (2018)'

Jackson Reed does have a page on IAFD, but it would not pull his picture as his IAFD webpage lists him as Jackson Taylor, luckily the fagalicious uses this AKA name - so I manipulated that and managed to get his IAFD page. All IAFD requests that return a null string are assumed as before to be genres.

here is the offending fagalicious and the other two scenes with the versions upped - now sorted out, thanks for throwing that file at it as in most cases we don't find results going past 1 page...

CodyBerenson commented 4 years ago

lol. The Ground Hog Day Agent. Keeps living the same results page over and over.

ok, i'll give them a test. and report back

j-ktz commented 4 years ago

@CodyBerenson @JPH71 Morning gents, trying to play catch up. Is there a new Bundle I can test on my Mac?

CodyBerenson commented 4 years ago

@JPH71 Hi Pumpkin,

I threw the most recent 6 scenes for each of the three blogs, including the QC DeAngelo Jackson, scene. 100% match,

I have no means to test on a platform other than Windows, so @j-ktz will have to test on his Mac platform...although if memory serves, he doesn't use QC.

I am going to go ahead and push the code to the master repository....since we know the code that is there has issues with non-windows platforms, this code is preferable even if we haven't verified yet.

I'll wait a bit to hear back from @j-ktz before closing the issue.

Here's the package (i've been removing them from the thread until testing out ok):

3.SceneBundles.zip

JPH71 commented 4 years ago

Wait a wee bit.... Let me update all the version histories sorted for every bundle. As I made changes to the get-IAFDActor fpr Fagalicious - I have to make it for all the bundles and double-check that this change works... I am feeling a bit guilty that I have being misusing you a wee bit.... I should have them done in 4 hours or so..... Though - have you tried the new GEVI - in relation to the summaries and ratings?? What do you think about the Scenes... should we retain them?? Cheers

Jason

On Wed, 29 Apr 2020 at 14:13, CodyBerenson notifications@github.com wrote:

lol. The Ground Hog Day Agent. Keeps living the same results page over and over.

ok, i'll give them a test. and report back

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-621163369, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKJV5R2AA5NWRMIH5CLRPAKXRANCNFSM4MOFRAGA .

JPH71 commented 4 years ago

@CodyBerenson Wait a wee bit.... Let me update all the version histories sorted for every bundle. As I made changes to the get-IAFDActor fpr Fagalicious - I have to make it for all the bundles and double-check that this change works... I am feeling a bit guilty that I have being misusing you a wee bit.... I should have them done in 4 hours or so..... Though - have you tried the new GEVI - in relation to the summaries and ratings?? What do you think about the Scenes... should we retain them?? Cheers

On Wed, 29 Apr 2020 at 14:13, Jason Hudson jp.hudson@gmail.com wrote:

Wait a wee bit.... Let me update all the version histories sorted for every bundle. As I made changes to the get-IAFDActor fpr Fagalicious - I have to make it for all the bundles and double-check that this change works... I am feeling a bit guilty that I have being misusing you a wee bit.... I should have them done in 4 hours or so..... Though - have you tried the new GEVI - in relation to the summaries and ratings?? What do you think about the Scenes... should we retain them?? Cheers

Jason

On Wed, 29 Apr 2020 at 14:13, CodyBerenson notifications@github.com wrote:

lol. The Ground Hog Day Agent. Keeps living the same results page over and over.

ok, i'll give them a test. and report back

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-621163369, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKJV5R2AA5NWRMIH5CLRPAKXRANCNFSM4MOFRAGA .

CodyBerenson commented 4 years ago

I haven't looked at the film bundles. I'll give GEVI a try now, see what you're referring to and report back.

CodyBerenson commented 4 years ago

@JPH71 I'm a little confused by your last message, please let me know if i'm not understanding correctly....I broke into separate thoughts.

  1. What specifically am I testing in GEVI? I threw 3 files at it, it matched perfectly. IT works, summaries and ratings are there....but it was working before so I'm not sure what I'm testing for.

  2. Scenes. Re: IAFD or re: GEVI? In either case, I'm a fan for pulling the metadata that is there, and would be good when GEVI provides scene info, to include it in the description along with the summary.

JPH71 commented 4 years ago

In relation to GEVI... The error that was there before was that it did not scrape the whole summary, just the first paragraph... I have added scenes and ratings.. As I have made changes to the getIAFDactor routine in fagalicious.. I will for consistencies sake do it for all bundles soon I prefer using the same hymn sheet at all times... Either today or tomorrow I will get this done and update all the bundles... In the meantime if you find anything wrong or want any changes let me know and I will incorporate the corrections...

Cheers Jason

On Wed, 29 Apr 2020, 15:29 CodyBerenson, notifications@github.com wrote:

@JPH71 https://github.com/JPH71 I'm a little confused by your last message, please let me know if i'm not understanding correctly....I broke into separate thoughts.

1.

What specifically am I testing in GEVI? I threw 3 files at it, it matched perfectly. IT works, summaries and ratings are there....but it was working before so I'm not sure what I'm testing for. 2.

Scenes. Re: IAFD or re: GEVI? In either case, I'm a fan for pulling the metadata that is there, and would be good when GEVI provides scene info, to include it in the description along with the summary.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-621247835, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKPIZEEAFIYIX3N37RTRPA2S7ANCNFSM4MOFRAGA .

CodyBerenson commented 4 years ago

"I have added scenes and ratings" Specifically to GEVI? So are you saying that the GEVI scraper should pull in scenes? If you are saying that (I am having trouble with your Cockney, Eliza Doolittle), it does not. For example, this film has no summary but substantial scene info. The agent pulled in nothing except ","

https://www.gayeroticvideoindex.com/V/0/65370.html

image

JPH71 commented 4 years ago

oh damn... it did it for nearly 20 films i checked... let me look at it now as I have finished work for the day!

On Wed, 29 Apr 2020 at 16:23, CodyBerenson notifications@github.com wrote:

"I have added scenes and ratings" Specifically to GEVI? So are you saying that the GEVI scraper should pull in scenes? If you are saying that (I am having trouble with your Cockney, Eliza Doolittle), it does not. For example, this film has no summary but substantial scene info. The agent pulled in nothing except ","

https://www.gayeroticvideoindex.com/V/0/65370.html

[image: image] https://user-images.githubusercontent.com/40373801/80613874-ca358580-8a0b-11ea-9840-483dff058e3a.png

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/CodyBerenson/PGMA-Modernized/issues/15#issuecomment-621282907, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKI3AKIWMMABUDWXFY6RCULRPBA6VANCNFSM4MOFRAGA .

CodyBerenson commented 4 years ago

i'm using the GEVI that was part of the All-Bundles.zip you emailed. Was there a different version?

JPH71 commented 4 years ago

@codyBerenson    It really helps to send the correct version to you, i placed a copy in another directory before i went to far... and sent that one instead.... removed i need to get rid of the lines - View this scene at.....

JPH71 commented 4 years ago

@CodyBerenson

Got rid of the View this scene at.... so if you havent started testing use this one instead

CodyBerenson commented 4 years ago

i'm trying to find films that have both descriptions and scenes....just tested a film with only scenes and no description and it came in perfect. still looking and still testing

CodyBerenson commented 4 years ago

ok pumpkin, i found one and tested and it worked perfectly. i'll keep going but i'm slammed with work today...just wanted you to know. :)