pymedusa / Medusa

Automatic Video Library Manager for TV Shows. It watches for new episodes of your favorite shows, and when they are posted it does its magic.
https://pymedusa.com
GNU General Public License v3.0
1.77k stars 275 forks source link

Medusa Not Starting After Latest Update To Docker Image #7350

Closed HPMSGEN8 closed 4 years ago

HPMSGEN8 commented 4 years ago

Describe the bug Medusa Not Starting After Latest Update To Docker Image - https://registry.hub.docker.com/u/pymedusa/medusa/

To Reproduce Steps to reproduce the behavior:

  1. Log on to Synology
  2. Update Medusa Docker Image
  3. Shutdown Container, Clear, Then Restart

Expected behavior Medusa meant to start

Medusa (please complete the following information):

Thanks

medariox commented 4 years ago

How are we supposed to help without logs? Post the most recent logs in your Logs folder.

HPMSGEN8 commented 4 years ago

@medariox Apologies for that.

This is what i have. There is nothing else after i start it.

2019-11-14 10:49:36 DEBUG MAIN :: [80b323e] Started updating network timezones 2019-11-14 10:49:36 DEBUG MAIN :: [80b323e] GET URL: https://cdn.pymedusa.com/sb_network_timezones/network_timezones.txt [Status: 200] 2019-11-14 10:49:36 DEBUG MAIN :: [80b323e] User-Agent: Medusa/0.3.6 (Linux; 3.10.105; ae8b3b6e-06bb-11ea-8db6-0242ac110002) 2019-11-14 10:49:36 DEBUG MAIN :: [80b323e] Finished updating network timezones 2019-11-14 10:49:37 INFO CHECKVERSION :: [80b323e] Checking for updates using Docker Updater 2019-11-14 10:49:39 DEBUG CHECKVERSION :: [80b323e] Checking GitHub for latest news. 2019-11-14 10:49:39 DEBUG CHECKVERSION :: [80b323e] GET URL: https://cdn.pymedusa.com/news/news.md [Status: 200] 2019-11-14 10:49:39 DEBUG CHECKVERSION :: [80b323e] User-Agent: Medusa/0.3.6 (Linux; 3.10.105; ae8b3b6e-06bb-11ea-8db6-0242ac110002)

medariox commented 4 years ago

Are these the logs after starting the container now or of a previous version? There should be definitively more logs, these are just a small part of the logs. Is the container actually started? Also post the Docker logs.

HPMSGEN8 commented 4 years ago

Ok so i have started it again and i got this. Docker shows it is started.

2019-11-14 11:18:25 DEBUG    MAIN :: [80b323e] GET URL: https://cdn.pymedusa.com/providers/broken_providers.json [Status: 200]
2019-11-14 11:18:25 DEBUG    MAIN :: [80b323e] User-Agent: Medusa/0.3.6 (Linux; 3.10.105; b62adc72-06bf-11ea-9053-0242ac110002)
2019-11-14 11:18:26 INFO     MAIN :: [80b323e] Broken providers found: ['torrent9', 'newpct', 'tntvillage']
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Running in a docker container
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking database structure...main.db
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Initial Schema database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] InitialSchema upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Version To Tv Episodes database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddVersionToTvEpisodes upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Default Ep Status To Tv Shows database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddDefaultEpStatusToTvShows upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Alter Shows Field Types database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AlterTVShowsFieldTypes upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Minor Version database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddMinorVersion upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Test Increase Major Version database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] TestIncreaseMajorVersion upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Proper Tags database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddProperTags upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Manual Searched database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddManualSearched upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Info Hash database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddInfoHash upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Plot database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddPlot upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Resource Size database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddResourceSize upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Indexer Mapping database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddPKIndexerMapping upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Indexer Integer database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddIndexerInteger upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Indexer Ids database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddIndexerIds upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Separated Status Quality Fields database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddSeparatedStatusQualityFields upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Shift Qualities database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] ShiftQualities upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Episode Watched Field database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddEpisodeWatchedField upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Tvshow Start Search Offset database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddTvshowStartSearchOffset upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Release Ignore Require Exlude Options database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddReleaseIgnoreRequireExludeOptions upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking database structure...cache.db
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Initial Schema database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] InitialSchema upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Scene Exceptions database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddSceneExceptions upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Scene Name Cache database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddSceneNameCache upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Network Timezones database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddNetworkTimezones upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Last Search database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddLastSearch upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Scene Exceptions Seasons database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddSceneExceptionsSeasons upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Scene Exceptions Custom database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddSceneExceptionsCustom upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Scene Exceptions Refresh database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddSceneExceptionsRefresh upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Convert Scene Exeptions To Indexer Scheme database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] ConvertSceneExeptionsToIndexerScheme upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Convert Scene Names To Indexer Scheme database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] ConvertSceneNamesToIndexerScheme upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Remove Indexer Update Schema database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] RemoveIndexerUpdateSchema upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Indexer Scene Exceptions database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddIndexerSceneExceptions upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Indexer Ids database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddIndexerIds upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Clear Provider Tables database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] ClearProviderTables upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Provider Tables Identifier database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddProviderTablesIdentifier upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Performing a vacuum on the CACHE database
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking database structure...failed.db
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Initial Schema database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] InitialSchema upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Size And Provider database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] SizeAndProvider upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking History database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] History upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking History Status database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] HistoryStatus upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Add Indexer Ids database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] AddIndexerIds upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Update History Table Quality database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] UpdateHistoryTableQuality upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking Shift Qualities database upgrade
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] ShiftQualities upgrade not required
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking for delete episodes with subtitle reference
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] Checking for null indexer mappings
2019-11-14 11:18:26 DEBUG    MAIN :: [80b323e] 12345: Loading show info from database
medariox commented 4 years ago

You need to wait a bit.... this is only a small part of the logs.

HPMSGEN8 commented 4 years ago

@medariox It shows the shows that it is updating for the Cache & DB then after that i get the info that i pasted in the first post. That is it.

Has something changed in this new update for master ? Should i try the Dev branch

medariox commented 4 years ago

Master and Develop are currently the same. The logs stopping at that point just makes no sense, so yeah, don't know what to tell you.

HPMSGEN8 commented 4 years ago

Is there any way to get the Older Docker Image at all OR how do i update back to https://github.com/pymedusa/Medusa/tree/baad1e5af59d7f29606c1fed1c110af1424bb117

Is there still an Digest Key for the older version at all. I am trying everything to move back but so far having no luck.

HPMSGEN8 commented 4 years ago

@medariox Finally after alot of checking i found the issue is down to SSL. I got this error now in my logs.

pyopenssl module missing, please install for https access

medariox commented 4 years ago

We didn't change anything that could cause that issue in the new version.

I suggest you backup your data and rebuild the container.

HPMSGEN8 commented 4 years ago

Ok sure will do.

HPMSGEN8 commented 4 years ago

@medariox I have deleted everything even docker and started all over. I still get the below when i try and enable SSL

2019-11-19 10:33:25 WARNING MAIN :: [fcb5a19] pyopenssl module missing, please install for https access 2019-11-19 10:33:25 WARNING MAIN :: [fcb5a19] Disabled HTTPS because of missing CERT and KEY files

medariox commented 4 years ago

Do you have the certificate and key added with the correct path?

HPMSGEN8 commented 4 years ago

I have used the default ones from day one. What is the correct path or locations for this please.

medariox commented 4 years ago

You will need to create a self signed cert. There are many sites that can do this online. For example https://www.selfsignedcertificate.com Just enter a name (e.g. Medusa), generate, place the .key and .cert file where they can be reached by Medusa and add the correct path to the UI.

HPMSGEN8 commented 4 years ago

@medariox Ok so i have tried this and i still get

pyopenssl module missing, please install for https access

Can you maybe plz help me with how to add the path to medusa. I added it as /Mount/Drive/cert.key

udochrist commented 4 years ago

Hi, just tested it: adding the correct files for key and cert and restarting medusa gives

2019-11-19 16:31:29 INFO     MAIN :: [fcb5a19] Starting Medusa [master] using '/config/config.ini'
2019-11-19 16:31:29 WARNING  MAIN :: [fcb5a19] pyopenssl module missing, please install for https access
2019-11-19 16:31:29 INFO     MAIN :: [fcb5a19] Unable to create CERT/KEY files, disabling HTTPS
2019-11-19 16:31:29 WARNING  MAIN :: [fcb5a19] Disabled HTTPS because of missing CERT and KEY files
2019-11-19 16:31:29 INFO     TORNADO :: [fcb5a19] Starting Medusa on http://0.0.0.0:8081/

So https does not get enabled, but medusa should be started to use normal non http. the log seems to indicate that a python module needs to be added to the container?

udochrist commented 4 years ago

i need to correct myself: the error about the python module seems to be triggered by configuring the wrong pathnames for cert and key.

once the config is ok i get

2019-11-19 16:49:13 INFO     MAIN :: [fcb5a19] Starting Medusa [master] using '/config/config.ini'
2019-11-19 16:49:13 INFO     TORNADO :: [fcb5a19] Starting Medusa on https://0.0.0.0:8081/
2019-11-19 16:49:13 DEBUG    CHECKVERSION :: [fcb5a19] Starting new thread: CHECKVERSION

accessing the web gui does not give any results (or errors) for me. the browser just hangs waiting for data...

p0psicles commented 4 years ago

Ok maybe this isn't that helpful. But ever considered using nginx for the https reverse proxy?

HPMSGEN8 commented 4 years ago

@udochrist can you please let me know how you fixed this.

@p0psicles Is there an guide on how to set this up with Docker and Medusa please ?

p0psicles commented 4 years ago

I haven't configured Medusa or nginx in containers. But it's just a matter of opening the proper ports for each container. For the nginx config, we have some examples in the wiki.

udochrist commented 4 years ago

@HPMSGEN8 The issue only came up when the files given as key and cert where not accessible. my mapping in docker looks like:

    volumes:
      - /volume1/docker/medusa/config:/config

and my keys are in that directory as files. the config in medusa has to be /config/server.key and /config/server.crt. of course file ownerships and perms must match your "docker container user"

medariox commented 4 years ago

Well, I just tested with self signed certs and it works fine for me... maybe something wrong with your web server config?

HPMSGEN8 commented 4 years ago

@udochrist Thanks i have tried this but still this crashes and starts again in HTTP. I do not know where this is going wrong or what has changed.

HPMSGEN8 commented 4 years ago

@medariox I have done an clean install on a new NAS, Python 3 and all other requirements. This is still in Docker.

When i enable HTTPS the container crashes and i have to start it again. Once it is up then HTTP Works.

So something is missing somewhere and keeps on crashing. I did not have this issue with the older versions.

HPMSGEN8 commented 4 years ago

Any help please anyone ?

HPMSGEN8 commented 4 years ago

I still cannot get this fixed anyone have any luck on how i can solve this please.

p0psicles commented 4 years ago

Disable https. Install nginx. Config that as reverse proxy with letsencrypt

HPMSGEN8 commented 4 years ago

@p0psicles Thanks is there an guide on how to do all of this please.

p0psicles commented 4 years ago

Nginx is enough out on the webs. To make it easy in yourself. Use a webroot for Medusa. And a virtualhost for your nginx config. Then your setup is similar to mine. Get on discord when you have the minimal setup.

p0psicles commented 4 years ago

So your url becomes virtualhost.hpmsgen8.com

HPMSGEN8 commented 4 years ago

@p0psicles So i have tested this without Docker and enabled HTTPS and left Verify SSL Selected.

This worked first time and no issues. There is something up with Docker, Python that is causing this.

p0psicles commented 4 years ago

Well honestly I don't believe in setting up Medusa with a certificate. As it's a fake security. As Medusa or any other python app is not supposed to be used as an edge connected node. It's not secure or hardened enough. You should really use a proxy like ngingx or Apache for that. So I'm not really invested or motivated enough to look into this.

HPMSGEN8 commented 4 years ago

@p0psicles That is 100% will try nginx. I just want to know this will not go out via the Internet this is all Local correct ?

p0psicles commented 4 years ago

That depends of you make port 80/443 available.