search

overhangio / tutor

The Docker-based Open edX distribution designed for peace of mind
https://docs.tutor.overhang.io/
GNU Affero General Public License v3.0
909 stars 433 forks source link

Problems after upgrading to Tutor #118

Closed frohro closed 5 years ago

frohro commented 5 years ago

I'm also having difficulty just after doing a make upgrade-to-tutor and make update as advised above. It seemed to be working until I restarted the server after doing some regular updates. Now I get the following:

frohro@fweb:~/openedx-docker/deploy/local$ make daemonize
docker-compose up -d
Creating local_elasticsearch_1 ... done
Creating local_mongodb_1       ... done
Creating local_rabbitmq_1      ... done
Creating local_memcached_1     ... 
Creating local_mysql_1         ... 
Creating local_nginx_1         ... error
Creating local_smtp_1          ... done
Creating local_memcached_1     ... done
Creating local_mysql_1         ... done
ERROR: for local_nginx_1  Cannot start service nginx: driver failed programming external connectivity on endpoint local_nginx_1 (3805025da41117e9ee0460eb3b220bdeb26d5b11d9c876464d15e343e185ae4d): Error starting userland proxy: listen tcp 0.0.0.0:443: binCreating local_forum_1         ... done
Creating local_xqueue_1          ... done
Creating local_notes_1           ... done
Creating local_lms_1             ... done
Creating local_cms_1             ... done
Creating local_xqueue_consumer_1 ... done
Creating local_lms_worker_1      ... done
Creating local_cms_worker_1      ... done

ERROR: for nginx  Cannot start service nginx: driver failed programming external connectivity on endpoint local_nginx_1 (3805025da41117e9ee0460eb3b220bdeb26d5b11d9c876464d15e343e185ae4d): Error starting userland proxy: listen tcp 0.0.0.0:443: bind: address already in use
ERROR: Encountered errors while bringing up the project.
Makefile:35: recipe for target 'daemonize' failed
make: *** [daemonize] Error 1

Remember that I had ports 80 and 443 for nginx on docker rerouted by apache to ports 8080 and 8443.

I found that the .env file that helped with that was still there in the main directory and so I copied it to deplay/local/ and tried again, but it still didn't work, though it said something about port 8443 now, which seemed like an improvement.
Here is what I got:

frohro@fweb:~/openedx-docker/deploy/local$ make run
docker-compose up
Creating local_memcached_1 ... 
Creating local_rabbitmq_1  ... 
Creating local_smtp_1      ... 
Creating local_memcached_1     ... done
Creating local_rabbitmq_1      ... done
Creating local_smtp_1          ... done
Creating local_mongodb_1         ... done
Creating local_elasticsearch_1   ... done
ERROR: for local_nginx_1  Cannot start service nginx: driver failed programming external connectivity on endpoint local_nginx_1 (c6cd6321d2dbff6c2eabf8a7e24cf09d3cb125e74cd2ed8a95cf53f20765a50a): Bind for 0.0.0.0:8443 faileCreating local_mysql_1         ... done
Creating local_xqueue_consumer_1 ... done
Creating local_notes_1           ... done
Creating local_xqueue_1          ... done
Creating local_cms_1             ... done
Creating local_forum_1           ... done
Creating local_cms_worker_1      ... done
Creating local_lms_1             ... done
Creating local_lms_worker_1      ... done

ERROR: for nginx  Cannot start service nginx: driver failed programming external connectivity on endpoint local_nginx_1 (c6cd6321d2dbff6c2eabf8a7e24cf09d3cb125e74cd2ed8a95cf53f20765a50a): Bind for 0.0.0.0:8443 failed: port is already allocated
ERROR: Encountered errors while bringing up the project.
Makefile:31: recipe for target 'run' failed
make: *** [run] Error 1
frohro@fweb:~/openedx-docker/deploy/local$ docker-compose logs -f nginx
Attaching to local_nginx_1
local_nginx_1 exited with code 128

Do you have any suggestions?

Thanks, Rob edx.fweb.wallawalla.edu.conf.txt

_Originally posted by @frohro in https://github.com/_render_node/MDU6SXNzdWUzOTQ0MjM5MDg=/issues/unread_timeline#issuecomment-451608427_

frohro commented 5 years ago

So after looking at your advice on the previous issue, I did a make stop, expecting that maybe not everything is stopping. Sure enough, here is what I see:

frohro@fweb:~/openedx-docker/deploy/local$ make stop
docker-compose rm --stop --force
Stopping local_lms_worker_1      ... done
Stopping local_lms_1             ... done
Stopping local_forum_1           ... done
Stopping local_cms_worker_1      ... done
Stopping local_cms_1             ... done
Stopping local_notes_1           ... done
Stopping local_xqueue_consumer_1 ... done
Stopping local_xqueue_1          ... done
Stopping local_elasticsearch_1   ... done
Stopping local_mysql_1           ... done
Stopping local_rabbitmq_1        ... done
Stopping local_smtp_1            ... done
Stopping local_mongodb_1         ... done
Stopping local_memcached_1       ... done
Stopping local_nginx_1           ... done
Going to remove local_lms_worker_1, local_lms_1, local_forum_1, local_cms_worker_1, local_cms_1, local_notes_1, local_xqueue_consumer_1, local_xqueue_1, local_elasticsearch_1, local_mysql_1, local_rabbitmq_1, local_smtp_1, local_mongodb_1, local_memcached_1, local_nginx_1
Removing local_lms_worker_1      ... done
Removing local_lms_1             ... done
Removing local_forum_1           ... done
Removing local_cms_worker_1      ... done
Removing local_cms_1             ... done
Removing local_notes_1           ... done
Removing local_xqueue_consumer_1 ... done
Removing local_xqueue_1          ... done
Removing local_elasticsearch_1   ... done
Removing local_mysql_1           ... done
Removing local_rabbitmq_1        ... done
Removing local_smtp_1            ... done
Removing local_mongodb_1         ... done
Removing local_memcached_1       ... done
Removing local_nginx_1           ... done
frohro@fweb:~/openedx-docker/deploy/local$ docker ps
CONTAINER ID        IMAGE                        COMMAND                  CREATED             STATUS                            PORTS                                NAMES
1718a04d1c71        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (1) 36 seconds ago                                          openedx-docker_cms_worker_1
acd2b8bf529c        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (1) 30 seconds ago                                          openedx-docker_lms_worker_1
2ed09e4e78ce        portainer/portainer:latest   "/portainer"             3 weeks ago         Up 4 hours                        9000/tcp                             openedx-docker_portainer_1
c0ab6fe6d334        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 11 seconds ago                                          openedx-docker_cms_1
6d3a1c030db4        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 14 seconds ago                                          openedx-docker_lms_1
4bbd3a19c5cd        2ceaf452d923                 "./manage.py run_con…"   3 weeks ago         Restarting (2) 17 seconds ago                                          openedx-docker_xqueue_consumer_1
93168f79d0d0        2ceaf452d923                 "/bin/sh -c 'gunicor…"   3 weeks ago         Up 4 hours                        8040/tcp                             openedx-docker_xqueue_1
7dc7affcc91d        9e1ae7a9f56c                 "/bin/sh -c 'gunicor…"   3 weeks ago         Up 4 hours                        8000/tcp                             openedx-docker_notes_1
f3334f3fc5e0        e796675eda33                 "/bin/sh -c './bin/u…"   3 weeks ago         Up 5 seconds                      4567/tcp                             openedx-docker_forum_1
b69f40c48800        mysql:5.6.36                 "docker-entrypoint.s…"   3 weeks ago         Up 39 seconds                     3306/tcp                             openedx-docker_mysql_1
6f4bd504a887        rabbitmq:3.6.10              "docker-entrypoint.s…"   3 weeks ago         Up 4 hours                        4369/tcp, 5671-5672/tcp, 25672/tcp   openedx-docker_rabbitmq_1
12da79c2a1f0        elasticsearch:1.5.2          "/docker-entrypoint.…"   3 weeks ago         Up 4 hours                        9200/tcp, 9300/tcp                   openedx-docker_elasticsearch_1
e522d85d6135        namshi/smtp                  "/bin/entrypoint.sh …"   3 weeks ago         Up 4 hours                        25/tcp                               openedx-docker_smtp_1
a7e1511a89ad        memcached:1.4.38             "docker-entrypoint.s…"   3 weeks ago         Up 4 hours                        11211/tcp                            openedx-docker_memcached_1
20ff3680dbac        mongo:3.2.16                 "docker-entrypoint.s…"   3 weeks ago         Restarting (100) 39 seconds ago                                        openedx-docker_mongodb_1
frohro@fweb:~/openedx-docker/deploy/local$

When I restarted, it obviously stopped everything, but make stop doesn't.

One suggestion I have in retrospect is that you make a backup of all your courses before you try to upgrade. :-) I didn't do it for a while, and so may have lost some work. :-( I should know better.

frohro commented 5 years ago

Docker seems to have some zombies. They restart. Maybe this has to do with using daemonize, because I didn't want to see the logs stuff scrolling by. 

frohro@fweb:~/openedx-docker/deploy/local$ docker ps
CONTAINER ID        IMAGE                        COMMAND                  CREATED             STATUS                            PORTS                                NAMES
1718a04d1c71        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (1) 41 seconds ago                                          openedx-docker_cms_worker_1
acd2b8bf529c        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (1) 31 seconds ago                                          openedx-docker_lms_worker_1
2ed09e4e78ce        portainer/portainer:latest   "/portainer"             3 weeks ago         Up 5 hours                        9000/tcp                             openedx-docker_portainer_1
c0ab6fe6d334        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 10 seconds ago                                          openedx-docker_cms_1
6d3a1c030db4        ff9d0d82e40d                 "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 13 seconds ago                                          openedx-docker_lms_1
4bbd3a19c5cd        2ceaf452d923                 "./manage.py run_con…"   3 weeks ago         Restarting (2) 25 seconds ago                                          openedx-docker_xqueue_consumer_1
93168f79d0d0        2ceaf452d923                 "/bin/sh -c 'gunicor…"   3 weeks ago         Up 5 hours                        8040/tcp                             openedx-docker_xqueue_1
7dc7affcc91d        9e1ae7a9f56c                 "/bin/sh -c 'gunicor…"   3 weeks ago         Up 5 hours                        8000/tcp                             openedx-docker_notes_1
f3334f3fc5e0        e796675eda33                 "/bin/sh -c './bin/u…"   3 weeks ago         Restarting (101) 19 seconds ago                                        openedx-docker_forum_1
b69f40c48800        mysql:5.6.36                 "docker-entrypoint.s…"   3 weeks ago         Up 21 minutes                     3306/tcp                             openedx-docker_mysql_1
6f4bd504a887        rabbitmq:3.6.10              "docker-entrypoint.s…"   3 weeks ago         Up 5 hours                        4369/tcp, 5671-5672/tcp, 25672/tcp   openedx-docker_rabbitmq_1
12da79c2a1f0        elasticsearch:1.5.2          "/docker-entrypoint.…"   3 weeks ago         Up 5 hours                        9200/tcp, 9300/tcp                   openedx-docker_elasticsearch_1
e522d85d6135        namshi/smtp                  "/bin/entrypoint.sh …"   3 weeks ago         Up 5 hours                        25/tcp                               openedx-docker_smtp_1
a7e1511a89ad        memcached:1.4.38             "docker-entrypoint.s…"   3 weeks ago         Up 5 hours                        11211/tcp                            openedx-docker_memcached_1
20ff3680dbac        mongo:3.2.16                 "docker-entrypoint.s…"   3 weeks ago         Up 20 minutes                     27017/tcp                            openedx-docker_mongodb_1
frohro@fweb:~/openedx-docker/deploy/local$ docker stop 1718a04d1c71 acd2b8bf529c 2ed09e4e78ce c0ab6fe6d334 6d3a1c030db4  4bbd3a19c5cd  93168f79d0d0 7dc7affcc91d  f3334f3fc5e0 b69f40c48800  6f4bd504a887  12da79c2a1f0 e522d85d6135 a7e1511a89ad 20ff3680dbac 
1718a04d1c71
acd2b8bf529c
2ed09e4e78ce
c0ab6fe6d334
6d3a1c030db4
4bbd3a19c5cd
93168f79d0d0
7dc7affcc91d
f3334f3fc5e0
b69f40c48800
6f4bd504a887
12da79c2a1f0
e522d85d6135
a7e1511a89ad
20ff3680dbac
frohro@fweb:~/openedx-docker/deploy/local$ docker ps
CONTAINER ID        IMAGE               COMMAND                  CREATED             STATUS                              PORTS               NAMES
1718a04d1c71        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (1) About a minute ago                       openedx-docker_cms_worker_1
acd2b8bf529c        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (1) About a minute ago                       openedx-docker_lms_worker_1
c0ab6fe6d334        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 45 seconds ago                           openedx-docker_cms_1
6d3a1c030db4        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 48 seconds ago                           openedx-docker_lms_1
4bbd3a19c5cd        2ceaf452d923        "./manage.py run_con…"   3 weeks ago         Restarting (2) About a minute ago                       openedx-docker_xqueue_consumer_1
f3334f3fc5e0        e796675eda33        "/bin/sh -c './bin/u…"   3 weeks ago         Restarting (101) 53 seconds ago                         openedx-docker_forum_1
frohro@fweb:~/openedx-docker/deploy/local$
frohro commented 5 years ago

I'm not sure why all the strike throughs above. My terminal doesn't have them.

frohro commented 5 years ago

Looking at why I can't login to the CMS, I get this bunch of problems:

frohro@fweb:~/openedx-docker/deploy/local$ docker-compose logs -f cms
Attaching to local_cms_1
cms_1              | 2019-01-05 21:18:19 [8] [INFO] Starting gunicorn 0.17.4
cms_1              | 2019-01-05 21:18:19 [8] [INFO] Listening at: http://0.0.0.0:8000 (8)
cms_1              | 2019-01-05 21:18:19 [8] [INFO] Using worker: sync
cms_1              | 2019-01-05 21:18:19 [12] [INFO] Booting worker with pid: 12
cms_1              | 2019-01-05 22:15:39,449 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: '192.147.172.36:8080'. You may need to add u'192.147.172.36' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 22:30:40,945 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: 'fweb.wallawalla.edu'. You may need to add u'fweb.wallawalla.edu' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 22:34:14,027 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: 'fweb.wallawalla.edu'. You may need to add u'fweb.wallawalla.edu' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 22:47:49,569 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: '192.147.172.36:8080'. You may need to add u'192.147.172.36' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 22:53:00,902 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: 'fweb.wallawalla.edu'. You may need to add u'fweb.wallawalla.edu' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 22:53:00,941 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: 'fweb.wallawalla.edu'. You may need to add u'fweb.wallawalla.edu' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 23:21:16,808 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: 'fweb.wallawalla.edu'. You may need to add u'fweb.wallawalla.edu' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 23:24:15,666 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: '192.147.172.36:8080'. You may need to add u'192.147.172.36' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 23:34:38,011 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: '192.147.172.36:8080'. You may need to add u'192.147.172.36' to ALLOWED_HOSTS.
cms_1              | 2019-01-05 23:48:27,286 INFO 12 [tracking] logger.py:50 - {"username": "", "event_type": "/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "studio.edx.fweb.wallawalla.edu", "referer": "", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": null, "org_id": "", "course_id": "", "path": "/"}, "time": "2019-01-05T23:48:27.286413+00:00", "page": null}
cms_1              | 2019-01-05 23:48:31,468 INFO 12 [tracking] logger.py:50 - {"username": "", "event_type": "/signin", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "studio.edx.fweb.wallawalla.edu", "referer": "https://studio.edx.fweb.wallawalla.edu/", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": null, "org_id": "", "course_id": "", "path": "/signin"}, "time": "2019-01-05T23:48:31.468264+00:00", "page": null}
frohro commented 5 years ago

Working on why I can't see the content in the course outline:

frohro@fweb:~/openedx-docker/deploy/local$ docker-compose logs -f lms
Attaching to local_lms_1
lms_1              | 2019-01-05 21:18:27 [7] [INFO] Starting gunicorn 0.17.4
lms_1              | 2019-01-05 21:18:27 [7] [INFO] Listening at: http://0.0.0.0:8000 (7)
lms_1              | 2019-01-05 21:18:27 [7] [INFO] Using worker: sync
lms_1              | 2019-01-05 21:18:27 [11] [INFO] Booting worker with pid: 11
lms_1              | 2019-01-05 22:22:12,808 INFO 11 [tracking] logger.py:50 - {"username": "", "event_type": "/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)", "host": "edx.fweb.wallawalla.edu", "referer": "", "accept_language": "", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": null, "org_id": "", "course_id": "", "path": "/"}, "time": "2019-01-05T22:22:12.808817+00:00", "page": null}
lms_1              | 2019-01-05 22:22:13,430 WARNING 11 [openedx.core.djangoapps.catalog.utils] utils.py:66 - Failed to get program UUIDs from the cache.
lms_1              | 2019-01-05 22:25:59,823 INFO 11 [tracking] logger.py:50 - {"username": "", "event_type": "/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com)", "host": "edx.fweb.wallawalla.edu", "referer": "", "accept_language": "", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": null, "org_id": "", "course_id": "", "path": "/"}, "time": "2019-01-05T22:25:59.822922+00:00", "page": null}
lms_1              | 2019-01-05 22:25:59,838 WARNING 11 [openedx.core.djangoapps.catalog.utils] utils.py:66 - Failed to get program UUIDs from the cache.
lms_1              | 2019-01-05 23:45:09,376 INFO 11 [tracking] logger.py:50 - {"username": "", "event_type": "/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (Linux; Android 8.0.0; LG-H830) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": null, "org_id": "", "course_id": "", "path": "/"}, "time": "2019-01-05T23:45:09.376430+00:00", "page": null}
lms_1              | 2019-01-05 23:45:09,396 WARNING 11 [openedx.core.djangoapps.catalog.utils] utils.py:66 - Failed to get program UUIDs from the cache.
lms_1              | 2019-01-05 23:45:39,958 INFO 11 [tracking] logger.py:50 - {"username": "", "event_type": "/courses/course-v1:wallawalla+ENGR356+2018/about", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (Linux; Android 8.0.0; LG-H830) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "https://edx.fweb.wallawalla.edu/", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"course_user_tags": {}, "user_id": null, "org_id": "wallawalla", "course_id": "course-v1:wallawalla+ENGR356+2018", "path": "/courses/course-v1:wallawalla+ENGR356+2018/about"}, "time": "2019-01-05T23:45:39.958011+00:00", "page": null}
lms_1              | 2019-01-05 23:47:34,186 INFO 11 [tracking] logger.py:50 - {"username": "", "event_type": "/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": null, "org_id": "", "course_id": "", "path": "/"}, "time": "2019-01-05T23:47:34.186385+00:00", "page": null}
lms_1              | 2019-01-05 23:47:48,364 INFO 11 [audit] models.py:2420 - Login success - user.id: 2
lms_1              | 2019-01-05 23:47:48,505 INFO 11 [tracking] logger.py:50 - {"username": "frohro", "event_type": "/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "https://edx.fweb.wallawalla.edu/login?next=%2F", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": 2, "org_id": "", "course_id": "", "path": "/"}, "time": "2019-01-05T23:47:48.505418+00:00", "page": null}
lms_1              | 2019-01-05 23:47:48,578 INFO 11 [tracking] logger.py:50 - {"username": "frohro", "event_type": "/dashboard", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "https://edx.fweb.wallawalla.edu/login?next=%2F", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"user_id": 2, "org_id": "", "course_id": "", "path": "/dashboard"}, "time": "2019-01-05T23:47:48.578570+00:00", "page": null}
lms_1              | 2019-01-05 23:47:48,617 WARNING 11 [openedx.core.djangoapps.catalog.utils] utils.py:66 - Failed to get program UUIDs from the cache.
lms_1              | 2019-01-05 23:47:52,950 INFO 11 [tracking] logger.py:50 - {"username": "frohro", "event_type": "/courses/course-v1:wallawalla+engr354+2018/course/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "https://edx.fweb.wallawalla.edu/dashboard", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"course_user_tags": {}, "user_id": 2, "org_id": "wallawalla", "course_id": "course-v1:wallawalla+engr354+2018", "path": "/courses/course-v1:wallawalla+engr354+2018/course/"}, "time": "2019-01-05T23:47:52.950430+00:00", "page": null}
lms_1              | 2019-01-05 23:47:53,226 INFO 11 [openedx.core.djangoapps.content.block_structure.store] store.py:174 - BlockStructure: Not found in cache; <openedx.core.djangoapps.content.block_structure.store.StubModel object at 0x7f53f7f8c0d0>.
lms_1              | 2019-01-05 23:47:57,339 INFO 11 [openedx.core.djangoapps.content.block_structure.store] store.py:161 - BlockStructure: Added to cache; <openedx.core.djangoapps.content.block_structure.store.StubModel object at 0x7f53f6f27e10>, size: 129398
lms_1              | 2019-01-05 23:52:02,801 INFO 11 [tracking] logger.py:50 - {"username": "frohro", "event_type": "/courses/course-v1:wallawalla+engr354+2018/jump_to/block-v1:wallawalla+engr354+2018+type@vertical+block@c1s1v1", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"course_user_tags": {}, "user_id": 2, "org_id": "wallawalla", "course_id": "course-v1:wallawalla+engr354+2018", "path": "/courses/course-v1:wallawalla+engr354+2018/jump_to/block-v1:wallawalla+engr354+2018+type@vertical+block@c1s1v1"}, "time": "2019-01-05T23:52:02.801732+00:00", "page": null}
lms_1              | 2019-01-05 23:52:02,925 INFO 11 [tracking] logger.py:50 - {"username": "frohro", "event_type": "/courses/course-v1:wallawalla+engr354+2018/courseware/c1/c1s1/1", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {\"activate_block_id\": [\"block-v1:wallawalla+engr354+2018+type@vertical+block@c1s1v1\"]}}", "event_source": "server", "context": {"course_user_tags": {}, "user_id": 2, "org_id": "wallawalla", "course_id": "course-v1:wallawalla+engr354+2018", "path": "/courses/course-v1:wallawalla+engr354+2018/courseware/c1/c1s1/1"}, "time": "2019-01-05T23:52:02.925162+00:00", "page": null}
lms_1              | 2019-01-05 23:52:43,317 INFO 11 [tracking] logger.py:50 - {"username": "frohro", "event_type": "/courses/course-v1:wallawalla+engr354+2018/course/", "ip": "172.18.0.1", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "host": "edx.fweb.wallawalla.edu", "referer": "https://edx.fweb.wallawalla.edu/dashboard", "accept_language": "en-US,en;q=0.9", "event": "{\"POST\": {}, \"GET\": {}}", "event_source": "server", "context": {"course_user_tags": {}, "user_id": 2, "org_id": "wallawalla", "course_id": "course-v1:wallawalla+engr354+2018", "path": "/courses/course-v1:wallawalla+engr354+2018/course/"}, "time": "2019-01-05T23:52:43.317067+00:00", "page": null}
lms_1              | 2019-01-05 23:52:43,562 INFO 11 [openedx.core.djangoapps.content.block_structure.store] store.py:177 - BlockStructure: Read from cache; <openedx.core.djangoapps.content.block_structure.store.StubModel object at 0x7f53f7ca0990>, size: 129398
lms_1              | 2019-01-05 23:52:44,594 INFO 11 [tracking] logger.py:42 - {"username": "frohro", "event_source": "browser", "name": "page_close", "accept_language": "en-US,en;q=0.9", "time": "2019-01-05T23:52:44.594478+00:00", "agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36", "page": "https://edx.fweb.wallawalla.edu/courses/course-v1:wallawalla+engr354+2018/courseware/c1/c1s1/1?activate_block_id=block-v1%3Awallawalla%2Bengr354%2B2018%2Btype%40vertical%2Bblock%40c1s1v1", "host": "edx.fweb.wallawalla.edu", "session": "0d2d232939571f2d39185ef41eeb0183", "referer": "https://edx.fweb.wallawalla.edu/courses/course-v1:wallawalla+engr354+2018/courseware/c1/c1s1/1?activate_block_id=block-v1%3Awallawalla%2Bengr354%2B2018%2Btype%40vertical%2Bblock%40c1s1v1", "context": {"user_id": 2, "org_id": "wallawalla", "course_id": "course-v1:wallawalla+engr354+2018", "path": "/event"}, "ip": "172.18.0.1", "event": "{}", "event_type": "page_close"}
frohro commented 5 years ago

Both of the last two tests were done with this make run whose output is given below (with the previous docker ps so you can see the starting state of docker).

frohro@fweb:~/openedx-docker/deploy/local$ docker ps
CONTAINER ID        IMAGE               COMMAND                  CREATED             STATUS                            PORTS               NAMES
1718a04d1c71        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (1) 22 minutes ago                         openedx-docker_cms_worker_1
acd2b8bf529c        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (1) 22 minutes ago                         openedx-docker_lms_worker_1
c0ab6fe6d334        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 22 minutes ago                         openedx-docker_cms_1
6d3a1c030db4        ff9d0d82e40d        "docker-entrypoint.s…"   3 weeks ago         Restarting (3) 22 minutes ago                         openedx-docker_lms_1
4bbd3a19c5cd        2ceaf452d923        "./manage.py run_con…"   3 weeks ago         Restarting (2) 22 minutes ago                         openedx-docker_xqueue_consumer_1
f3334f3fc5e0        e796675eda33        "/bin/sh -c './bin/u…"   3 weeks ago         Restarting (101) 22 minutes ago                       openedx-docker_forum_1
frohro@fweb:~/openedx-docker/deploy/local$ make run
docker-compose up
Creating local_mysql_1         ... done
Creating local_rabbitmq_1        ... done
Creating local_memcached_1       ... done
Creating local_smtp_1            ... done
Creating local_mongodb_1         ... done
Creating local_nginx_1           ... done
Creating local_elasticsearch_1   ... done
Creating local_xqueue_1          ... done
Creating local_xqueue_consumer_1 ... done
Creating local_notes_1           ... done
Creating local_cms_1             ... done
Creating local_cms_worker_1      ... done
Creating local_forum_1           ... done
Creating local_lms_1             ... done
Creating local_lms_worker_1      ... done
Attaching to local_mysql_1, local_rabbitmq_1, local_smtp_1, local_xqueue_1, local_xqueue_consumer_1, local_memcached_1, local_nginx_1, local_mongodb_1, local_cms_1, local_cms_worker_1, local_notes_1, local_elasticsearch_1, local_forum_1, local_lms_1, local_lms_worker_1
mysql_1            | 2019-01-05 21:18:12 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
mysql_1            | 2019-01-05 21:18:12 0 [Note] mysqld (mysqld 5.6.36) starting as process 1 ...
smtp_1             | + sed -ri '
smtp_1             |    s/^#?(dc_local_interfaces)=.*/\1='\''[0.0.0.0]:25 ; [::0]:25'\''/;
smtp_1             |    s/^#?(dc_other_hostnames)=.*/\1='\'''\''/;
smtp_1             |    s/^#?(dc_relay_nets)=.*/\1='\''172.18.0.3\/16'\''/;
smtp_1             |    s/^#?(dc_eximconfig_configtype)=.*/\1='\''internet'\''/;
smtp_1             | ' /etc/exim4/update-exim4.conf.conf
smtp_1             | + update-exim4.conf -v
smtp_1             | using non-split configuration scheme from /etc/exim4/exim4.conf.template
smtp_1             |     1 LOG: MAIN
smtp_1             |     1   exim 4.84_2 daemon started: pid=1, -q15m, listening for SMTP on port 25 (IPv6 and IPv4)
rabbitmq_1         | 
rabbitmq_1         |               RabbitMQ 3.6.10. Copyright (C) 2007-2017 Pivotal Software, Inc.
rabbitmq_1         |   ##  ##      Licensed under the MPL.  See http://www.rabbitmq.com/
rabbitmq_1         |   ##  ##
rabbitmq_1         |   ##########  Logs: tty
rabbitmq_1         |   ######  ##        tty
rabbitmq_1         |   ##########
rabbitmq_1         |               Starting broker...
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:14 ===
rabbitmq_1         | Starting RabbitMQ 3.6.10 on Erlang 19.2.1
rabbitmq_1         | Copyright (C) 2007-2017 Pivotal Software, Inc.
rabbitmq_1         | Licensed under the MPL.  See http://www.rabbitmq.com/
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:14 ===
rabbitmq_1         | node           : rabbit@3b82dbb2e0a4
rabbitmq_1         | home dir       : /var/lib/rabbitmq
rabbitmq_1         | config file(s) : /etc/rabbitmq/rabbitmq.config
rabbitmq_1         | cookie hash    : huJHj8fUFPgM97OF0PQM4Q==
rabbitmq_1         | log            : tty
rabbitmq_1         | sasl log       : tty
rabbitmq_1         | database dir   : /var/lib/rabbitmq/mnesia/rabbit@3b82dbb2e0a4
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Memory limit set to 3142MB of 7855MB total.
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Enabling free disk space monitoring
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Disk free limit set to 50MB
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Limiting to approx 1048476 file handles (943626 sockets)
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | FHC read buffering:  OFF
rabbitmq_1         | FHC write buffering: ON
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Database directory at /var/lib/rabbitmq/mnesia/rabbit@3b82dbb2e0a4 is empty. Initialising from scratch...
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         |     application: mnesia
rabbitmq_1         |     exited: stopped
rabbitmq_1         |     type: temporary
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Waiting for Mnesia tables for 30000 ms, 9 retries left
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Waiting for Mnesia tables for 30000 ms, 9 retries left
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Waiting for Mnesia tables for 30000 ms, 9 retries left
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Priority queues enabled, real BQ is rabbit_variable_queue
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Starting rabbit_node_monitor
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Adding vhost '/'
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Creating user 'guest'
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Setting user tags for user 'guest' to [administrator]
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Setting permissions for 'guest' in '/' to '.*', '.*', '.*'
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | msg_store_transient: using rabbit_msg_store_ets_index to provide index
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | msg_store_persistent: using rabbit_msg_store_ets_index to provide index
rabbitmq_1         | 
rabbitmq_1         | =WARNING REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | msg_store_persistent: rebuilding indices from scratch
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | started TCP Listener on [::]:5672
rabbitmq_1         |  completed with 0 plugins.
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:16 ===
rabbitmq_1         | Server startup complete; 0 plugins started.
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:27 ===
rabbitmq_1         | accepting AMQP connection <0.371.0> (172.18.0.13:53442 -> 172.18.0.4:5672)
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:27 ===
rabbitmq_1         | connection <0.371.0> (172.18.0.13:53442 -> 172.18.0.4:5672): user 'guest' authenticated and granted access to vhost '/'
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:27 ===
rabbitmq_1         | accepting AMQP connection <0.380.0> (172.18.0.13:53444 -> 172.18.0.4:5672)
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:27 ===
rabbitmq_1         | connection <0.380.0> (172.18.0.13:53444 -> 172.18.0.4:5672): user 'guest' authenticated and granted access to vhost '/'
xqueue_1           | 2019-01-05 21:18:14 [8] [INFO] Starting gunicorn 0.16.1
xqueue_1           | 2019-01-05 21:18:14 [8] [INFO] Listening at: http://0.0.0.0:8040 (8)
xqueue_1           | 2019-01-05 21:18:14 [8] [INFO] Using worker: sync
xqueue_1           | 2019-01-05 21:18:14 [10] [INFO] Booting worker with pid: 10
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/data/db 64-bit host=9dd9953c6c12
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] db version v3.2.16
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] git version: 056bf45128114e44c5358c7a8776fb582363e094
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.0.1t  3 May 2016
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] allocator: tcmalloc
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] modules: none
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] build environment:
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten]     distmod: debian81
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten]     distarch: x86_64
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten]     target_arch: x86_64
mongodb_1          | 2019-01-05T21:18:18.224+0000 I CONTROL  [initandlisten] options: { storage: { engine: "wiredTiger", journal: { enabled: false }, mmapv1: { smallFiles: true } } }
mongodb_1          | 2019-01-05T21:18:18.228+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=4G,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),,log=(enabled=false),
mongodb_1          | 2019-01-05T21:18:18.312+0000 W STORAGE  [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger
mongodb_1          | 2019-01-05T21:18:18.319+0000 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db/diagnostic.data'
mongodb_1          | 2019-01-05T21:18:18.320+0000 I NETWORK  [initandlisten] waiting for connections on port 27017
mongodb_1          | 2019-01-05T21:18:18.320+0000 I NETWORK  [HostnameCanonicalizationWorker] Starting hostname canonicalization worker
mongodb_1          | 2019-01-05T21:18:26.691+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.14:45678 #1 (1 connection now open)
mongodb_1          | 2019-01-05T21:18:26.691+0000 I NETWORK  [conn1] end connection 172.18.0.14:45678 (0 connections now open)
mongodb_1          | 2019-01-05T21:18:26.691+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.14:45680 #2 (1 connection now open)
mongodb_1          | 2019-01-05T21:18:26.694+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.14:45682 #3 (2 connections now open)
mongodb_1          | 2019-01-05T21:18:26.703+0000 I NETWORK  [conn2] end connection 172.18.0.14:45680 (1 connection now open)
mongodb_1          | 2019-01-05T21:18:26.703+0000 I NETWORK  [conn3] end connection 172.18.0.14:45682 (1 connection now open)
cms_1              | 2019-01-05 21:18:19 [8] [INFO] Starting gunicorn 0.17.4
cms_1              | 2019-01-05 21:18:19 [8] [INFO] Listening at: http://0.0.0.0:8000 (8)
cms_1              | 2019-01-05 21:18:19 [8] [INFO] Using worker: sync
cms_1              | 2019-01-05 21:18:19 [12] [INFO] Booting worker with pid: 12
cms_worker_1       | 2019-01-05 21:18:26,283 WARNING 1 [py.warnings] platforms.py:812 - /usr/local/lib/python2.7/dist-packages/celery/platforms.py:812: RuntimeWarning: You are running the worker with superuser privileges, which is
cms_worker_1       | absolutely not recommended!
cms_worker_1       | 
cms_worker_1       | Please specify a different user using the -u option.
cms_worker_1       | 
cms_worker_1       | User information: uid=0 euid=0 gid=0 egid=0
cms_worker_1       | 
cms_worker_1       |   uid=uid, euid=euid, gid=gid, egid=egid,
cms_worker_1       | 
cms_worker_1       | [2019-01-05 21:18:26,297: WARNING/MainProcess] /usr/local/lib/python2.7/dist-packages/celery/apps/worker.py:161: CDeprecationWarning: 
cms_worker_1       | Starting from version 3.2 Celery will refuse to accept pickle by default.
cms_worker_1       | 
cms_worker_1       | The pickle serializer is a security concern as it may give attackers
cms_worker_1       | the ability to execute any command.  It's important to secure
cms_worker_1       | your broker from unauthorized access when using pickle, so we think
cms_worker_1       | that enabling pickle should require a deliberate action and not be
cms_worker_1       | the default choice.
cms_worker_1       | 
cms_worker_1       | If you depend on pickle then you should set a setting to disable this
cms_worker_1       | warning and to be sure that everything will continue working
cms_worker_1       | when you upgrade to Celery 3.2::
cms_worker_1       | 
cms_worker_1       |     CELERY_ACCEPT_CONTENT = ['pickle', 'json', 'msgpack', 'yaml']
cms_worker_1       | 
cms_worker_1       | You must only enable the serializers that you will actually use.
cms_worker_1       | 
cms_worker_1       | 
cms_worker_1       |   warnings.warn(CDeprecationWarning(W_PICKLE_DEPRECATED))
cms_worker_1       | 
cms_worker_1       | [2019-01-05 21:18:27,061: INFO/MainProcess] Connected to amqp://guest:**@rabbitmq:5672//
cms_worker_1       | [2019-01-05 21:18:27,083: INFO/MainProcess] mingle: searching for neighbors
cms_worker_1       | [2019-01-05 21:18:28,142: INFO/MainProcess] mingle: all alone
cms_worker_1       | [2019-01-05 21:18:28,210: WARNING/MainProcess] celery@edx.cms.core.default.%79aabd27fcf2 ready.
elasticsearch_1    | [2019-01-05 21:18:22,936][INFO ][node                     ] [Helio] version[1.5.2], pid[1], build[62ff986/2015-04-27T09:21:06Z]
elasticsearch_1    | [2019-01-05 21:18:22,936][INFO ][node                     ] [Helio] initializing ...
elasticsearch_1    | [2019-01-05 21:18:22,943][INFO ][plugins                  ] [Helio] loaded [], sites []
elasticsearch_1    | [2019-01-05 21:18:25,981][INFO ][node                     ] [Helio] initialized
elasticsearch_1    | [2019-01-05 21:18:25,981][INFO ][node                     ] [Helio] starting ...
elasticsearch_1    | [2019-01-05 21:18:26,271][INFO ][transport                ] [Helio] bound_address {inet[/0.0.0.0:9300]}, publish_address {inet[/172.18.0.8:9300]}
elasticsearch_1    | [2019-01-05 21:18:26,398][INFO ][discovery                ] [Helio] elasticsearch/TUiJcqMbSl2ljB1oyB8_2w
forum_1            | W, [2019-01-05T21:18:26.447960 #8]  WARN -- : NewRelic agent library not installed
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:52: warning: constant ::Fixnum is deprecated
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:54: warning: constant ::Fixnum is deprecated
forum_1            | W, [2019-01-05T21:18:26.666212 #8]  WARN -- : Overwriting existing field _id in class User.
forum_1            | W, [2019-01-05T21:18:26.682292 #8]  WARN -- : MONGODB | Unsupported client option 'max_retries'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:26.682361 #8]  WARN -- : MONGODB | Unsupported client option 'retry_interval'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:26.682386 #8]  WARN -- : MONGODB | Unsupported client option 'timeout'. It will be ignored.
forum_1            | ERROR: ElasticSearch configuration validation failed. "rake search:validate_index" failed with the following message: Failed to open TCP connection to elasticsearch:9200 (Connection refused - connect(2) for "elasticsearch" port 9200)
forum_1            | W, [2019-01-05T21:18:26.694925 #8]  WARN -- : NewRelic agent library not installed
lms_1              | 2019-01-05 21:18:27 [7] [INFO] Starting gunicorn 0.17.4
lms_1              | 2019-01-05 21:18:27 [7] [INFO] Listening at: http://0.0.0.0:8000 (7)
lms_1              | 2019-01-05 21:18:27 [7] [INFO] Using worker: sync
lms_1              | 2019-01-05 21:18:27 [11] [INFO] Booting worker with pid: 11
mongodb_1          | 2019-01-05T21:18:29.914+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.10:55112 #4 (1 connection now open)
mongodb_1          | 2019-01-05T21:18:29.914+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.10:55114 #5 (2 connections now open)
mongodb_1          | 2019-01-05T21:18:29.914+0000 I NETWORK  [conn4] end connection 172.18.0.10:55112 (1 connection now open)
mongodb_1          | 2019-01-05T21:18:29.915+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.10:55116 #6 (2 connections now open)
mongodb_1          | 2019-01-05T21:18:29.927+0000 I NETWORK  [conn5] end connection 172.18.0.10:55114 (1 connection now open)
mongodb_1          | 2019-01-05T21:18:29.928+0000 I NETWORK  [conn6] end connection 172.18.0.10:55116 (0 connections now open)
elasticsearch_1    | [2019-01-05 21:18:30,207][INFO ][cluster.service          ] [Helio] new_master [Helio][TUiJcqMbSl2ljB1oyB8_2w][ce3aa05f750f][inet[/172.18.0.8:9300]], reason: zen-disco-join (elected_as_master)
elasticsearch_1    | [2019-01-05 21:18:30,328][INFO ][http                     ] [Helio] bound_address {inet[/0.0.0.0:9200]}, publish_address {inet[/172.18.0.8:9200]}
elasticsearch_1    | [2019-01-05 21:18:30,329][INFO ][node                     ] [Helio] started
local_forum_1 exited with code 101
local_xqueue_consumer_1 exited with code 0
elasticsearch_1    | [2019-01-05 21:18:31,673][INFO ][gateway                  ] [Helio] recovered [11] indices into cluster_state
forum_1            | W, [2019-01-05T21:18:26.447960 #8]  WARN -- : NewRelic agent library not installed
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:52: warning: constant ::Fixnum is deprecated
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:54: warning: constant ::Fixnum is deprecated
forum_1            | W, [2019-01-05T21:18:26.666212 #8]  WARN -- : Overwriting existing field _id in class User.
forum_1            | W, [2019-01-05T21:18:26.682292 #8]  WARN -- : MONGODB | Unsupported client option 'max_retries'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:26.682361 #8]  WARN -- : MONGODB | Unsupported client option 'retry_interval'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:26.682386 #8]  WARN -- : MONGODB | Unsupported client option 'timeout'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:26.694925 #8]  WARN -- : NewRelic agent library not installed
forum_1            | ERROR: ElasticSearch configuration validation failed. "rake search:validate_index" failed with the following message: Failed to open TCP connection to elasticsearch:9200 (Connection refused - connect(2) for "elasticsearch" port 9200)
forum_1            | W, [2019-01-05T21:18:29.691001 #7]  WARN -- : NewRelic agent library not installed
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:52: warning: constant ::Fixnum is deprecated
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:54: warning: constant ::Fixnum is deprecated
forum_1            | W, [2019-01-05T21:18:29.884785 #7]  WARN -- : Overwriting existing field _id in class User.
forum_1            | W, [2019-01-05T21:18:29.903647 #7]  WARN -- : MONGODB | Unsupported client option 'max_retries'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:29.903713 #7]  WARN -- : MONGODB | Unsupported client option 'retry_interval'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:29.903738 #7]  WARN -- : MONGODB | Unsupported client option 'timeout'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:29.916075 #7]  WARN -- : NewRelic agent library not installed
forum_1            | ERROR: ElasticSearch configuration validation failed. "rake search:validate_index" failed with the following message: Failed to open TCP connection to elasticsearch:9200 (Connection refused - connect(2) for "elasticsearch" port 9200)
mongodb_1          | 2019-01-05T21:18:32.569+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.15:36804 #7 (1 connection now open)
mongodb_1          | 2019-01-05T21:18:32.948+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.15:36806 #8 (2 connections now open)
mongodb_1          | 2019-01-05T21:18:33.068+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.15:36808 #9 (3 connections now open)
forum_1            | W, [2019-01-05T21:18:33.379718 #8]  WARN -- : NewRelic agent library not installed
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:52: warning: constant ::Fixnum is deprecated
forum_1            | /openedx/cs_comments_service/vendor/bundle/ruby/2.4.0/gems/elasticsearch-transport-1.1.2/lib/elasticsearch/transport/transport/base.rb:54: warning: constant ::Fixnum is deprecated
forum_1            | W, [2019-01-05T21:18:33.583996 #8]  WARN -- : Overwriting existing field _id in class User.
forum_1            | W, [2019-01-05T21:18:33.602354 #8]  WARN -- : MONGODB | Unsupported client option 'max_retries'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:33.602411 #8]  WARN -- : MONGODB | Unsupported client option 'retry_interval'. It will be ignored.
forum_1            | W, [2019-01-05T21:18:33.602442 #8]  WARN -- : MONGODB | Unsupported client option 'timeout'. It will be ignored.
mongodb_1          | 2019-01-05T21:18:33.603+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.10:55136 #10 (4 connections now open)
mongodb_1          | 2019-01-05T21:18:33.603+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.10:55138 #11 (5 connections now open)
mongodb_1          | 2019-01-05T21:18:33.603+0000 I NETWORK  [conn10] end connection 172.18.0.10:55136 (3 connections now open)
mongodb_1          | 2019-01-05T21:18:33.606+0000 I NETWORK  [initandlisten] connection accepted from 172.18.0.10:55140 #12 (5 connections now open)
forum_1            | W, [2019-01-05T21:18:33.607645 #8]  WARN -- : NewRelic agent library not installed
forum_1            | I, [2019-01-05T21:18:33.681778 #8]  INFO -- : Passed: Alias 'content' exists with up-to-date mappings.
forum_1            | I, [2019-01-05T21:18:33.682738 #8]  INFO -- : Refreshing Gem list
forum_1            | `Rack::Timeout.timeout=`: class-level settings are deprecated. See README for examples on using the middleware initializer instead.
forum_1            | I, [2019-01-05T21:18:33.683213 #8]  INFO -- : listening on addr=0.0.0.0:4567 fd=11
forum_1            | I, [2019-01-05T21:18:33.683304 #8]  INFO -- : worker=0 spawning...
forum_1            | Loading config.ru.
forum_1            | I, [2019-01-05T21:18:33.685283 #8]  INFO -- : worker=1 spawning...
forum_1            | I, [2019-01-05T21:18:33.685973 #16]  INFO -- : worker=0 ready
forum_1            | I, [2019-01-05T21:18:33.687134 #8]  INFO -- : worker=2 spawning...
forum_1            | I, [2019-01-05T21:18:33.688365 #19]  INFO -- : worker=1 ready
forum_1            | I, [2019-01-05T21:18:33.688847 #8]  INFO -- : worker=3 spawning...
forum_1            | I, [2019-01-05T21:18:33.690116 #22]  INFO -- : worker=2 ready
forum_1            | I, [2019-01-05T21:18:33.690694 #8]  INFO -- : master process ready
forum_1            | I, [2019-01-05T21:18:33.691940 #25]  INFO -- : worker=3 ready
lms_worker_1       | 2019-01-05 21:18:35,862 WARNING 1 [py.warnings] platforms.py:812 - /usr/local/lib/python2.7/dist-packages/celery/platforms.py:812: RuntimeWarning: You are running the worker with superuser privileges, which is
lms_worker_1       | absolutely not recommended!
lms_worker_1       | 
lms_worker_1       | Please specify a different user using the -u option.
lms_worker_1       | 
lms_worker_1       | User information: uid=0 euid=0 gid=0 egid=0
lms_worker_1       | 
lms_worker_1       |   uid=uid, euid=euid, gid=gid, egid=egid,
lms_worker_1       | 
lms_worker_1       | 2019-01-05 21:18:35,874 WARNING 1 [py.warnings] worker.py:161 - /usr/local/lib/python2.7/dist-packages/celery/apps/worker.py:161: CDeprecationWarning: 
lms_worker_1       | Starting from version 3.2 Celery will refuse to accept pickle by default.
lms_worker_1       | 
lms_worker_1       | The pickle serializer is a security concern as it may give attackers
lms_worker_1       | the ability to execute any command.  It's important to secure
lms_worker_1       | your broker from unauthorized access when using pickle, so we think
lms_worker_1       | that enabling pickle should require a deliberate action and not be
lms_worker_1       | the default choice.
lms_worker_1       | 
lms_worker_1       | If you depend on pickle then you should set a setting to disable this
lms_worker_1       | warning and to be sure that everything will continue working
lms_worker_1       | when you upgrade to Celery 3.2::
lms_worker_1       | 
lms_worker_1       |     CELERY_ACCEPT_CONTENT = ['pickle', 'json', 'msgpack', 'yaml']
lms_worker_1       | 
lms_worker_1       | You must only enable the serializers that you will actually use.
lms_worker_1       | 
lms_worker_1       | 
lms_worker_1       |   warnings.warn(CDeprecationWarning(W_PICKLE_DEPRECATED))
lms_worker_1       | 
lms_worker_1       |  
lms_worker_1       |  -------------- celery@edx.lms.core.default.%1e3cb911874e v3.1.25 (Cipater)
lms_worker_1       | ---- **** ----- 
lms_worker_1       | --- * ***  * -- Linux-4.15.0-43-generic-x86_64-with-Ubuntu-16.04-xenial
lms_worker_1       | -- * - **** --- 
lms_worker_1       | - ** ---------- [config]
lms_worker_1       | - ** ---------- .> app:         proj:0x7feca04b5c10
lms_worker_1       | - ** ---------- .> transport:   amqp://guest:**@rabbitmq:5672//
lms_worker_1       | - ** ---------- .> results:     
lms_worker_1       | - *** --- * --- .> concurrency: 4 (prefork)
lms_worker_1       | -- ******* ---- 
lms_worker_1       | --- ***** ----- [queues]
lms_worker_1       |  -------------- .> edx.lms.core.default exchange=edx.lms.core(direct) key=edx.lms.core.default
lms_worker_1       |                 .> edx.lms.core.high exchange=edx.lms.core(direct) key=edx.lms.core.high
lms_worker_1       |                 .> edx.lms.core.high_mem exchange=edx.lms.core(direct) key=edx.lms.core.high_mem
lms_worker_1       |                 .> edx.lms.core.low exchange=edx.lms.core(direct) key=edx.lms.core.low
lms_worker_1       | 
lms_worker_1       | [tasks]
lms_worker_1       |   . bulk_email.tasks.send_course_email
lms_worker_1       |   . celery_utils.tasks.mark_resolved
lms_worker_1       |   . edx_sga.tasks.zip_student_submissions
lms_worker_1       |   . email_marketing.tasks.get_email_cookies_via_sailthru
lms_worker_1       |   . email_marketing.tasks.update_course_enrollment
lms_worker_1       |   . email_marketing.tasks.update_user
lms_worker_1       |   . email_marketing.tasks.update_user_email
lms_worker_1       |   . entitlements.tasks.expire_old_entitlements
lms_worker_1       |   . gating.tasks.task_evaluate_subsection_completion_milestones
lms_worker_1       |   . integrated_channels.integrated_channel.tasks.transmit_content_metadata
lms_worker_1       |   . integrated_channels.integrated_channel.tasks.transmit_learner_data
lms_worker_1       |   . lms.djangoapps.certificates.tasks.generate_certificate
lms_worker_1       |   . lms.djangoapps.discussion.tasks.send_ace_message
lms_worker_1       |   . lms.djangoapps.discussion.tasks.update_discussions_map
lms_worker_1       |   . lms.djangoapps.email_marketing.tasks.get_email_cookies_via_sailthru
lms_worker_1       |   . lms.djangoapps.email_marketing.tasks.update_course_enrollment
lms_worker_1       |   . lms.djangoapps.email_marketing.tasks.update_user
lms_worker_1       |   . lms.djangoapps.email_marketing.tasks.update_user_email
lms_worker_1       |   . lms.djangoapps.grades.tasks.compute_all_grades_for_course
lms_worker_1       |   . lms.djangoapps.grades.tasks.compute_grades_for_course
lms_worker_1       |   . lms.djangoapps.grades.tasks.compute_grades_for_course_v2
lms_worker_1       |   . lms.djangoapps.grades.tasks.recalculate_course_and_subsection_grades_for_user
lms_worker_1       |   . lms.djangoapps.grades.tasks.recalculate_subsection_grade_v3
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.calculate_grades_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.calculate_may_enroll_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.calculate_problem_grade_report
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.calculate_problem_responses_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.calculate_students_features_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.cohort_students
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.course_survey_report_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.delete_problem_state
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.enrollment_report_features_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.exec_summary_report_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.export_ora2_data
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.generate_certificates
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.override_problem_score
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.proctored_exam_results_csv
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.rescore_problem
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.reset_problem_attempts
lms_worker_1       |   . lms.djangoapps.instructor_task.tasks.send_bulk_course_email
lms_worker_1       |   . openedx.core.djangoapps.content.block_structure.tasks.get_course_in_cache
lms_worker_1       |   . openedx.core.djangoapps.content.block_structure.tasks.get_course_in_cache_v2
lms_worker_1       |   . openedx.core.djangoapps.content.block_structure.tasks.update_course_in_cache
lms_worker_1       |   . openedx.core.djangoapps.content.block_structure.tasks.update_course_in_cache_v2
lms_worker_1       |   . openedx.core.djangoapps.coursegraph.tasks.dump_course_to_neo4j
lms_worker_1       |   . openedx.core.djangoapps.credentials.tasks.v1.tasks.send_grade_to_credentials
lms_worker_1       |   . openedx.core.djangoapps.programs.tasks.v1.tasks.award_course_certificate
lms_worker_1       |   . openedx.core.djangoapps.programs.tasks.v1.tasks.award_program_certificates
lms_worker_1       |   . openedx.core.djangoapps.schedules.tasks.ScheduleCourseUpdate
lms_worker_1       |   . openedx.core.djangoapps.schedules.tasks.ScheduleMessageBaseTask
lms_worker_1       |   . openedx.core.djangoapps.schedules.tasks.ScheduleRecurringNudge
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:36 ===
rabbitmq_1         | accepting AMQP connection <0.440.0> (172.18.0.14:50428 -> 172.18.0.4:5672)
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:36 ===
rabbitmq_1         | connection <0.440.0> (172.18.0.14:50428 -> 172.18.0.4:5672): user 'guest' authenticated and granted access to vhost '/'
lms_worker_1       |   . openedx.core.djangoapps.2019-01-05 21:18:36,527 INFO 1 [celery.worker.consumer] consumer.py:526 - Connected to amqp://guest:**@rabbitmq:5672//
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:36 ===
rabbitmq_1         | accepting AMQP connection <0.447.0> (172.18.0.14:50430 -> 172.18.0.4:5672)
rabbitmq_1         | 
rabbitmq_1         | =INFO REPORT==== 5-Jan-2019::21:18:36 ===
rabbitmq_1         | connection <0.447.0> (172.18.0.14:50430 -> 172.18.0.4:5672): user 'guest' authenticated and granted access to vhost '/'
lms_worker_1       | 2019-01-05 21:18:36,537 INFO 1 [celery.worker.consumer] consumer.py:614 - mingle: searching for neighbors
cms_worker_1       | [2019-01-05 21:18:36,541: INFO/MainProcess] sync with celery@edx.lms.core.default.%1e3cb911874e
lms_worker_1       | 2019-01-05 21:18:37,546 INFO 1 [celery.worker.consumer] consumer.py:620 - mingle: sync with 1 nodes
lms_worker_1       | 2019-01-05 21:18:37,548 INFO 1 [celery.worker.consumer] consumer.py:630 - mingle: sync complete
lms_worker_1       | 2019-01-05 21:18:37,634 WARNING 1 [celery.redirected] log.py:282 - celery@edx.lms.core.default.%1e3cb911874e ready.
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
local_xqueue_consumer_1 exited with code 0
cms_1              | 2019-01-05 22:15:39,449 ERROR 12 [django.security.DisallowedHost] exception.py:80 - Invalid HTTP_HOST header: '192.147.172.36:8080'. You may need to add u'192.147.172.36' to ALLOWED_HOSTS.
nginx_1            | 179.113.250.174 - - [05/Jan/2019:22:15:39 +0000] "GET / HTTP/1.1" 400 26 "-" "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36" "-"
local_xqueue_consumer_1 exited with code 0
frohro commented 5 years ago

Here is the result of docker-compose logs -f (attached). logs_after_upgrade_to_tutor.txt

regisb commented 5 years ago

@frohro From what I can see at https://edx.fweb.wallawalla.edu/ and https://studio.fweb.wallawalla.edu/, you managed to solved the DisallowedHost problem, right? It seems to me that the only remaining problem is that static assets are not properly served by the web server. Please run make assets to solve this.

frohro commented 5 years ago

Thanks Regis! That seems to have fixed things! The things I see that might need to be done are:

Again, thanks so much for all your fantastic help.

Rob

regisb commented 5 years ago

Absolutely, the upgrade to tutor should really be better documented. I'll leave this open until I update the docs.

regisb commented 5 years ago

Oh and by the way @frohro, code samples and raw logs are easier to read when they are surrounded them with triple backticks ``` :wink: (you can also select them and click the "insert code" formatting button from the github editor)

frohro commented 5 years ago

Thanks! I'll try and remember that in the future.