search

pymedusa / Medusa

Automatic Video Library Manager for TV Shows. It watches for new episodes of your favorite shows, and when they are posted it does its magic.
https://pymedusa.com
GNU General Public License v3.0
1.8k stars 276 forks source link

Not finding torrent #5582

Closed Masterditto closed 5 years ago

Masterditto commented 6 years ago

Describe the bug Taking example in the TV series "Arrow", medusa refuses to find "Arrow.S07E02.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE" Where required word "Substance" is the only criteria for medusa. It easily find others (look below in log section)

This happends to all releases from "Substance" (Tracker: DanishBits) and "YesWeAre" (Tracker: NordicBits)

To Reproduce Steps to reproduce the behavior: Setup Medusa to do a search for "Arrow" with required word "Substance" on tracker DanishBits or "Supernatural" with required word "YesWeAre" on tracker NordicBits

I will gladly have you take a look from within my pc remotely, debug log says nothing else than normal log.

Expected behavior Expected behavior is it should download and find this "Substance" and "YesWeAre" releases. Been trying to fix this for days now. Please help :)

Screenshots None that would help better.

Medusa (please complete the following information):

Logs: Not finding "Substance" Arrow episode on DanishBits.

2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [0c0a735] Unable to find forced results for: Arrow - S07E02 - The Longbow Hunters
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.1080p.HEVC.x265-MeGusta based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.1080p.HEVC.x265-MeGusta is 1080p HDTV
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.HDTV.x264-SVA based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.HDTV.x264-SVA is SDTV
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.iNTERNAL.720p.WEB.h264-BAMBOOZLE based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.iNTERNAL.720p.WEB.h264-BAMBOOZLE is 720p WEB-DL
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.1080p.WEB.h264-TBS based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.1080p.WEB.h264-TBS is 1080p WEB-DL
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Ignoring Arrow.S07E02.720p.HDTV.x264-SVA based on required words filter: [u'SUBSTANCE']
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Quality of Arrow.S07E02.720p.HDTV.x264-SVA is 720p HDTV
2018-11-01 12:27:07 INFO     SEARCHQUEUE-FORCED-257655 :: [Danishbits] :: [0c0a735] Performing episode search for Arrow

Additional context Dont have more details.

medariox commented 6 years ago

Enable debug logs and post a full manual search.

Masterditto commented 6 years ago

I did enable debug, but "logs" dont show anything debug related. Been trying to find solution online too. What should I do ?

Even tried restarted Medusa after enable and try do manual search. Still shows no debug even tho I see the checkmark for "enabled"

medariox commented 6 years ago

You need to select debug from the drop down in view logs.

Masterditto commented 6 years ago

Stupid me.. Ok found debug. Look here please. https://imgur.com/a/Jq9sIKP

debug

Masterditto commented 6 years ago

Better picture here: debug2

p0psicles commented 6 years ago

Copy the logs to gist.github.com. Past gist link here

Masterditto commented 6 years ago

https://gist.github.com/Masterditto/218b55c0bfb002c623c4eee6985eb067

medariox commented 6 years ago

Now do the same with a manual search.

Masterditto commented 6 years ago

https://gist.github.com/Masterditto/8a6de8873c5ad86f151fba3a28cf19b1

medariox commented 6 years ago

That's still not a manual search. A manual search starts with SEARCHQUEUE-MANUAL-.

Masterditto commented 6 years ago

Sorry! got it.. but clicking it returns nothing in DEBUG log other than pushing me to this website: debug4

p0psicles commented 6 years ago

Click the force search button

p0psicles commented 6 years ago

It will star a new search. Also you have SUSTANCE as a required word? Why.

Masterditto commented 6 years ago

Ok that made it appear in the list! debug5

Log here: DELETED

I have required word "Substance" becuz its the only sub group I wanna download from in this paticular TV show. Could I do this smarter somehow?

p0psicles commented 6 years ago

Ok then it will only download those. It should have that picked up in a backlog search

Masterditto commented 6 years ago

It downloaded the Episode 02, but how can I tell it to look for these Substance? without me requiring to do a manual search everytime. Tried going to "Black Lightning" TV show. Same problem - This time "DBRETAiL" required word

Did a Force manual search on Episode 2 and it found DBRETAiL.

Tried to make it auto download episode 3, but had to do force manual search again?

sharkykh commented 6 years ago

Didn't read the whole thread but results with dk subs are ignored by default. Try removing dk from the list of ignored subtitled results on the Search Settings config page. Option is titled Ignore language names in subbed results

Masterditto commented 6 years ago

I already did a full clear there: search filters

Masterditto commented 6 years ago

Just wonder why it does not pick these up automaticly. Really dont wanna do a "Force manual search" every episode :( Which is the main purpose/job for Medusa to handle.

Hope someone has a fix for me :O

Masterditto commented 6 years ago

So I've now did what u asked. And surely enough a "Forced manuel search" does find Episode 2 here. Look at first picture, but why should I do a manual search on ALL episodes? Going into episode 3 (2. picture below) I again have to do manuel search ?

This is most likely a bug or?

2

1

All TV series mentioned below is from "substance" group and from same tracker (DanishBits) "Blindspot" and "The last ship" was found automaticly without a problem though... Blindspot and The Flash was released same day. "The Flash", "Arrow", "Mr. Mercedes", "The Walking Dead" was not found..

4

Can't seem to find the problem here. Help?

3

Please help me fix this! Love Medusa over old SickRage!

medariox commented 5 years ago

You most likely only want releases with danish subs, right? In that case you should just add DKsubs to required words. Regarding the issue you seem to have, without a full debug log (talking about at least 24h from when the episode was released) it is really hard to help you further.

Masterditto commented 5 years ago

Hi medaiox

Been trying having no required word for the show "Arrow" and it does not find the releases from "Substance" automaticly. I have to do a "Force manual search" before it shows up in the list - Like I talked about earlier. Take a look here:

BEFORE "Force Manual Search" arrow

AFTER "Force Manual Search" arrow2

My debug log didn't go further than this in the web-interface: https://gist.github.com/Masterditto/51b78727b75c096f4ad5d79f8217e7bf

"Danishbits" search provider does work, because its grabbing 90% of the content I also have MEDUSA search for. Recently this was taken without any problems: Kidding.S01E10.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL (2 hours ago - required word: DBRETAiL) DCs.Legends.of.Tomorrow.S04E03.NORDiC.720p.WEB-DL.DD5.1.H.264-DBRETAiL (19 hours ago - required word: DBRETAiL) The.Big.Bang.Theory.S12E08.Custom.DKsubs.720p.WEB-DL.x264-ENiGMA (2 days ago - required word: ENiGMA)

To me it could be fixed if Medusa could do its own "manuel force search" automaticly? Makes no sense users should do this on every new episode :) Hope you guys can fix this.

Regards

EDIT1: Medusa has just found this torrent with required word "substance" "The.Walking.Dead.S09E06.Custom.DKsubs.720p.WEB-DL.H264-SUBSTANCE" But still not arrow? cant find the reason behind it :( hmm....

EDIT2: "The.Flash.S05E05.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE" was not found unless I did a "Manual force search" on the episode.

Before before

After after

EDIT3: Blindspot.S04E05.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE - Was found Lethal.Weapon.S03\Lethal.Weapon.S03E07.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL - Was found

EDIT4: The.Big.Bang.Theory.S12E07.Custom.DKsubs.720p.WEB-DL.x264-ENiGMA The.Big.Bang.Theory.S12E09.Custom.DKsubs.720p.WEB-DL.x264-ENiGMA This was not found - Had to do manual force search again here: big bang

EDIT5: Black.Lightning.S02E06.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL black lightning black lightning2

And this Gold.Rush.S09E07.NORDiC.720p.WEB-DL.AAC2.0.H.264-DBRETAiL gold rush gold rush2

And this DCs.Legends.of.Tomorrow.S04E05.NORDiC.720p.WEB-DL.DD5.1.H.264-DBRETAiL dc legends of tomrrow dc legends of tomrrow2

ALL EDITS WORKS WHEN DOING "FORCE MANUAL SEARCH" help???

jbaun commented 5 years ago

I have the same problem with Medusa and Danishbits. Any news on a solution?

p0psicles commented 5 years ago

@Masterditto still an issue? Normally these episodes should be found 1. through daily (rss) search and then 2. backlog search. We'll need debug logs for these. A force manual search is the same as a backlog search but for one specific episode. All results from a backlog search, should also be added to cache.

Masterditto commented 5 years ago

Yes im still doing "Force manual search" on many episodes. Waiting for u guys for a fix (I hope)

What more information can I provide u to help fix this?

p0psicles commented 5 years ago

If your missing a result. Manual start a backlog search. And share the debug log.

Masterditto commented 5 years ago

"Force Manual Search" is not a backlog search? Can u tell me where that is?

p0psicles commented 5 years ago

Manage - manage searches You can trigger a backlog search there.

Masterditto commented 5 years ago

Hi p0psicles - Had to wait for a release to test :) here is one with full information.

The.Last.Ship.S05E10.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE Was released 14 days ago on my DanishBits tracker (I missed it) so changed backlog search to 30 days for this.

thelastship1

thelastship2

thelastship3

And debug log file AFTER doing "Manage - manage searches You can trigger a backlog search there." https://gist.github.com/Masterditto/072a2d331182bbcd7d33f693c5a57f15

AFTER CLICKING "FORCE SEARCH": thelastship4

p0psicles commented 5 years ago

@pymedusa/developers the backlog search works like this:

  1. Check cache for a specific show/episode
  2. if it finds results, it is satisfied with that, and moves to the next wanted ep.
  3. if it doesn't find results, it will search the provider.

Meaning that we're pretty much depending heavily on the RSS search. As that makes sure that "all" eps are added to cache.

The issue here is that for some reason the DKsubs releases are not added through the RSS search. But other releases are added. Then the backlog only finds the releases that were added and doesn't bother searching further.

So there are two issues here:

  1. RSS search doesn't pick up all releases
  2. Backlog doesn't search the provider if it has >= 1 release in cache.
p0psicles commented 5 years ago

@Masterditto For the two issues 2 is really hard to do something about short term. But we can focus for now on why the specific release is not added through the RSS. But for that, you need to keep an eye on the logs for when an episode is released. You can filter your logs with SEARCHQUEUE-DAILY-SEARCH.

p0psicles commented 5 years ago

@Masterditto it could also help if I get temporary access. But that's up to you.

p0psicles commented 5 years ago

@Masterditto can you checkout this branch, and run some tests for us? feature/check-cache-for-candidates

p0psicles commented 5 years ago

As discussed with @Masterditto, he had min seeders configured to 1 for danishbits. New results in the RSS can start with 0 seeders, and then will not be added. Advised to set set min seeders to 0.

Masterditto commented 5 years ago

I could recommend Medusa to set it to 0 as default ? (IF this solves the issue) I promise to return if its working :)

jbaun commented 5 years ago

Hi. Mine was also set to 1. I have now set it to 0 and will also test this.

Masterditto commented 5 years ago

So far one problem.

Z.Nation.S05E09.Custom.DKsubs.720p.WEB-DL.H.264-SUBSTANCE Released 2 hours ago.

z1

Forcing backlog search didnt find it either. (I know it WILL find it if I again do a "Force manual search")

p0psicles commented 5 years ago

Plesase zip you Logs folder

Masterditto commented 5 years ago

application.zip

here is log file

p0psicles commented 5 years ago

Ok

Masterditto commented 5 years ago

Supergirl.S04E08.NORDiC.720p.WEB-DL.DDP5.1.H.264-DBRETAiL - Releases 14 hours ago was not found.

supergirl

supergirl2

p0psicles commented 5 years ago

Just your last application.log?

Masterditto commented 5 years ago

Logs.zip

Here is logs after this Supergirl episode :)

Masterditto commented 5 years ago

UPDATE:

This was not found. Full screenshots and log file after I ran manage searches "Backlog" and "Daily". flash

flash1

flash2

flash3

Logs.zip

XenoBIT78 commented 5 years ago

If you need more logs let me know im facing the same problem.. :)

p0psicles commented 5 years ago

Danishbits has a really fast paced RSS. It has 20 items. And on times they move through them within 15 minutes. We have a minimum interval of 10 minutes. But there is a check that makes sure that individual providers are not polled more often then what they are configured for (individually). There is a small issue, where sometimes the last search was (for example) 9 minutes and 58 seconds ago. Then it skips that provider for that "turn". And 10 minutes later, the provider is allowed to pull new results. So although the provider is supposed to pull every 10 min. In that case there will be a gap of 19 minutes and 58 seconds. Which can result in missing a few eps.

I'll discuss with the other devs, if we can do something about this.

@Masterditto you can also fix this, by asking danishbits if they are willing to extend their RSS to for ex 50 or 100 items.

p0psicles commented 5 years ago

Example of the actual RSS pulls:

application.log.1:2018-12-06 19:39:30 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 19:49:32 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 19:59:34 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 20:19:34 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 20:39:34 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 20:49:36 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:09:36 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:19:38 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:39:41 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 21:59:41 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
application.log.1:2018-12-06 22:19:42 DEBUG    SEARCHQUEUE-DAILY-SEARCH :: [Danishbits] :: [54da0c7] GET URL: https://danishbits.org/couchpotato.php?search=.&latest=true&user=**********&passkey=********** [Status: 200]
p0psicles commented 5 years ago

You can see it often skips 20 minutes, where it should skip 10 now.

Masterditto commented 5 years ago

I contacted staff on Danishbits now. Will return with an answer for you :)

p0psicles commented 5 years ago

You can tell them, that if they extend the number of results, users can also extend the interval. Lowering the amount of hits on their api.