pymedusa / Medusa

Automatic Video Library Manager for TV Shows. It watches for new episodes of your favorite shows, and when they are posted it does its magic.
https://pymedusa.com
GNU General Public License v3.0
1.79k stars 276 forks source link

1883 file update not working correctly; #10353

Closed nydave69 closed 2 years ago

nydave69 commented 2 years ago

Describe the bug A clear and concise description of what the bug is. Noticed that series 1883 had lost some episodes. Tried a refresh. things got worse.

now looks like this; image

the folder has; image

the log shows; 2022-02-16 15:45:22 INFO SHOWQUEUE-REFRESH :: [4908f30] Cache check completed 2022-02-16 15:45:22 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Updating NFOs for show with new indexer info 2022-02-16 15:45:22 INFO SHOWQUEUE-REFRESH :: [4908f30] Trying to clean any empty folder under O:\series\1883 (2021) 2022-02-16 15:45:21 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E05 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E05) (2022-01-09) (1080p-h264 BluRay EAC3-6ch) TBA.mkv 2022-02-16 15:45:21 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E03 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E03) (2021-12-26) (1080p-h264 BluRay EAC3-6ch) River.mkv 2022-02-16 15:45:21 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E02 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E02) (2021-12-19) (1080p-h264 BluRay AC3-2ch) Behind Us, A Cliff.mkv 2022-02-16 15:45:20 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E01 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E01) (2021-12-19) (1080p-h264 BluRay AC3-2ch) 1883.mkv 2022-02-16 15:45:16 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Performing refresh on 1883 2022-02-16 15:43:13 INFO POSTPROCESSOR :: [4908f30] Post-processing completed. 2022-02-16 15:35:03 INFO SHOWQUEUE-REFRESH :: [4908f30] Cache check completed

and from the command window; 2022-02-16 15:45:19 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Series result returned zero 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Series 1883 is anime 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: No entries found in show: 1883 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: The result that was found (O:\series\1883 (2021)\Season 01\1883 (2021) (S01E01) (2021-12-19) (1080p-x264 BluRay AC3-2ch) 1883.mkv) i s not yet supported by Medusa and will be skipped. Sorry. 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: Creating episode from: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E03) (2021-12-26) (1080p-AVC BluRay EAC3-6ch) River.mkv 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: Creating episode object from O:\series\1883 (2021)\Season 01\1883 (2021) (S01E03) (2021-12-26) (1080p-AVC BluRay EAC3-6ch) River.mkv

2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Using guessit cache item for O:\series\1883 (2021)\Season 01\1883 (2021) (S01E03) (2021-12-26) (1080p-AVC BluRay EAC3-6ch) River.mkv 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Series 1883 is anime 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: No entries found in show: 1883 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: The result that was found (O:\series\1883 (2021)\Season 01\1883 (2021) (S01E03) (2021-12-26) (1080p-AVC BluRay EAC3-6ch) River.mkv) is not yet supported by Medusa and will be skipped. Sorry. 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: Loading all episodes from '1883' with a location from the database 2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: Location for '1883' S01E01 doesn't exist and current status is 'Downloaded', removing it and changing status to 'Archived' 2022-02-16 15:45:20 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E01 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E01) (2021-12-19) (1080p -h264 BluRay AC3-2ch) 1883.mkv 2022-02-16 15:45:20 DEBUG APIv2-Thread_7 :: [4908f30] Broken providers already updated in the last hour 2022-02-16 15:45:21 DEBUG SHOWQUEUE-REFRESH :: [4908f30] No associated files were found for O:\series\1883 (2021)\Season 01\1883 (2021) (S01E01) (2021-12-19) (1080p-h264 BluRay AC3-2ch) 1883.mkv 2022-02-16 15:45:21 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: Location for '1883' S01E02 doesn't exist and current status is 'Downloaded', removing it and changing status to 'Archived' 2022-02-16 15:45:21 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E02 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E02) (2021-12-19) (1080p -h264 BluRay AC3-2ch) Behind Us, A Cliff.mkv 2022-02-16 15:45:21 DEBUG SHOWQUEUE-REFRESH :: [4908f30] No associated files were found for O:\series\1883 (2021)\Season 01\1883 (2021) (S01E02) (2021-12-19) (1080p-h264 BluRay AC3-2ch) Behind Us, A Cliff.mkv 2022-02-16 15:45:21 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: Location for '1883' S01E03 doesn't exist and current status is 'Downloaded', removing it and changing status to 'Archived' 2022-02-16 15:45:21 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E03 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E03) (2021-12-26) (1080p -h264 BluRay EAC3-6ch) River.mkv 2022-02-16 15:45:21 DEBUG SHOWQUEUE-REFRESH :: [4908f30] No associated files were found for O:\series\1883 (2021)\Season 01\1883 (2021) (S01E03) (2021-12-26) (1080p-h264 BluRay EAC3-6ch) River.mkv 2022-02-16 15:45:21 DEBUG SHOWQUEUE-REFRESH :: [4908f30] 396390: Location for '1883' S01E05 doesn't exist and current status is 'Downloaded', removing it and changing status to 'Archived' 2022-02-16 15:45:21 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Looking for hanging associated files for: '1883' S01E05 in: O:\series\1883 (2021)\Season 01\1883 (2021) (S01E05) (2022-01-09) (1080p -h264 BluRay EAC3-6ch) TBA.mkv 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] No associated files were found for O:\series\1883 (2021)\Season 01\1883 (2021) (S01E05) (2022-01-09) (1080p-h264 BluRay EAC3-6ch) TBA.mkv 2022-02-16 15:45:22 INFO SHOWQUEUE-REFRESH :: [4908f30] Trying to clean any empty folder under O:\series\1883 (2021) 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Not deleting O:\series\1883 (2021).actors. The folder is not empty or should be kept. 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Not deleting O:\series\1883 (2021)\Season 01. The folder is not empty or should be kept. 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Transaction with 4 queries executed 2022-02-16 15:45:22 INFO SHOWQUEUE-REFRESH :: [4908f30] 396390: Updating NFOs for show with new indexer info 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Checking if O:\series\1883 (2021)\tvshow.nfo exists: True 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Metadata provider KODI updating series indexer info metadata file for 1883 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Checking if O:\series\1883 (2021)\tvshow.nfo exists: True 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Metadata provider KODI 12+ updating series indexer info metadata file for 1883 2022-02-16 15:45:22 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Checking if O:\series\1883 (2021)\folder.jpg exists: True

and I found season 1 episode 5 in the trash.. I had all 8 episodes listed yesterday

Medusa Info: Branch: master Commit: 4908f30db4fb3d9d6e59c51ca07deab95fb03a91 Version: 0.5.24 Database: 44.19 Python Version: 3.7.3 (v3.7.3:ef4ec6ed12, Mar 25 2019, 22:22:05) [MSC v.1916 64 bit (AMD64)] SSL Version: OpenSSL 1.1.0j 20 Nov 2018 OS: Windows-7-6.1.7601-SP1 Locale: en_US.cp1252 Timezone: Eastern Standard Time

User: Plex Program Folder: C:\Medusa\Medusa Config File: C:\Medusa\Data\config.ini Database File: C:\Medusa\Data\main.db Cache Folder: C:\Medusa\Data\cache Log Folder: C:\Medusa\Data\Logs Arguments: --nolaunch --datadir=C:\Medusa\Data

I haven't tried a refresh on any other series since this one didn't turn out so good. I'm checking other series to see if any are missing episodes..

2022-02-16 15:45:20 DEBUG SHOWQUEUE-REFRESH :: [4908f30] Series 1883 is anime; image

I don't have any anime...

nydave69 commented 2 years ago

Anything on this?

p0psicles commented 2 years ago

Medusa doesn't remove episodes. It's nog possible.

p0psicles commented 2 years ago

I noticed an issue with the rule that was supposed to parse the release /1883 (2021)/Season 01/1883 (2021) (S01E03) (2021-12-26) (1080p-AVC BluRay EAC3-6ch) River.mkv. But somehow it still parsed an absolute episode number of 1883. Which should only be the shows title.

This should be fixed in PR #10358

nydave69 commented 2 years ago

I found more shows that are now messed up.....

Engineering Catastrophes (2018) I had all of season image

notice episode 4 is missing also episode 2 file name is not complete in the folder

image

Looking at Medusa all is there.. BUT I really wish I could figure out how to show the actual fine path as what shows when the pointer is placed on the file name. Medusa has the files all over the place including folders it shouldn't even know about. If anyone knows a way to display them let me know, I don't want to refresh the show, not sure whats going to happen..

I'm going to keep checking shows...

nydave69 commented 2 years ago

Update:
looks like any show that was updated with a episode since the last Medusa Update (3 4 days) that season has issues.

p0psicles commented 2 years ago

Can you give me an overview of your postprocessing config?

p0psicles commented 2 years ago

Could you enable debug. And then refresh a show. You could create a backup of the show folder if your not sure

nydave69 commented 2 years ago

Can you give me an overview of your postprocessing config?

image image image image

nydave69 commented 2 years ago

Could you enable debug. And then refresh a show. You could create a backup of the show folder if your not sure

Log removed...

Here is the log, Please remove from post

nydave69 commented 2 years ago

After that refresh, the tool tips now show the correct file path for season 5

episodes 4 and 7 are missing and not in the recycle folder..

nydave69 commented 2 years ago

Found another show BattleBots (2015) season 6

image

image

Here is the file locations for season 6 from the database.. image

the last 2 have a folder that should not be known by Medusa and there are no files in that folder The files would not be processed by any app to that folder.

I wish I had thought of getting the file locations for Engineering Catastrophes (2018) from the DB before the update.. It had more wrong locations..

nydave69 commented 2 years ago

Just did a scan of the database and excluded the good volumes that files should be in. The results are that
image

706 are in the wrong location according to the Medusa Database.. Did a quick check, the files them self's are where they should be... not where the DB says they are,,

At this point I am going to do nothing other than shutdown Medusa till I hear something.....

p0psicles commented 2 years ago

I just read and understand your last message. So you were able to determine that files have been postprocessed into a wrong volume. As the O:\utorrent\compledDownload is your utorrent completed folder. And that folder is not protected. Meaning that after postprocessing it could happen that files are "cleaned up".

Where is the location O:\utorrent\compledDownload\SER coming from? Same question for O:\utorrent\compledDownload\SC ?

Can you confirm that an episode that has been postprocessed recently (like in the last week) has been put in a wrong location?

nydave69 commented 2 years ago

O:\utorrent\compledDownload is where all the utorrents download to depending on their label Medusa should only know O:\utorrent\compledDownload\MU not any others...

the SER, SC and others are used by other apps... and they haven't been affected. I have never seen a MU download in any other folder as it would trigger errors from the other apps....

Can you confirm that an episode that has been postprocessed recently (like in the last week) has been put in a wrong location?

That's the thing about this is it doesn't put the files in these odd locatations, just puts the location in the DB for the episode. For the downloaded file I'm not sure, all I know is that files in seasons that were complete start loosing episodes, Medusa should not even look at those as they are complete and not needed.

OK, I have three files sitting in MU that finished downloading since I shut down Medusa, they are all current release episodes Before I start Medusa and see what happens any suggestions?

nydave69 commented 2 years ago

Update..

In checking, the only thing I can think of is that the new download handling is looking at all files that are in the downloading queue including those from other apps.. I turned download handling off and turned Scheduled Post-Processor back on. cleaned up as much of the shows as I can and restarted.

medariox commented 2 years ago

Seems to be fixed? Ping if not.