search

rtcharity / eahub.org

A global directory for effective altruists to connect
https://eahub.org
MIT License
18 stars 6 forks source link

Unable to `run web django-admin createcontainer` #709

Closed michaltrzesimiech closed 5 years ago

michaltrzesimiech commented 5 years ago

Unable to set up local environment following the instructions in https://github.com/rtcharity/eahub.org

argo@argo:~/PycharmProjects/eahub.org$ docker-compose run web django-admin createcontainer
Creating network "eahuborg_default" with the default driver
Pulling db (postgres:10.5)...
10.5: Pulling from library/postgres
f17d81b4b692: Pull complete
c1f213be5edb: Pull complete
9c79723dc510: Pull complete
603a66804109: Pull complete
b4f1b901e523: Pull complete
99d9650419de: Pull complete
02d87bb25bad: Pull complete
333a24caa91e: Pull complete
9cab7935ece2: Pull complete
5977bf28967d: Pull complete
74ddd26cf783: Pull complete
07b76fcb42dd: Pull complete
7da7962ee038: Pull complete
0ddc5f8e0873: Pull complete
Creating eahuborg_db_1 ... 
Creating eahuborg_cache_1 ... 
Creating eahuborg_objstore_1 ... 
Creating eahuborg_mail_1     ... error

ERROR: for eahuborg_mail_1  Cannot start service mail: driver failed programming external connectivity on endpoint eahuborg_mail_1 (2a7abd507310d387404c204ffab4Creating eahuborg_objstore_1 ... error
eady allocated

Creating eahuborg_db_1       ... done
Creating eahuborg_cache_1    ... done
2a2aa3ec249b02a744e932615dba5c2aedbff6b36dab7099): Bind for 0.0.0.0:8002 failed: port is already allocated

ERROR: for mail  Cannot start service mail: driver failed programming external connectivity on endpoint eahuborg_mail_1 (2a7abd507310d387404c204ffab497ef711e13fee63cc1f31290b2cfdbc94810): Bind for 0.0.0.0:8001 failed: port is already allocated

ERROR: for objstore  Cannot start service objstore: driver failed programming external connectivity on endpoint eahuborg_objstore_1 (70ce6af05364f85a2a2aa3ec249b02a744e932615dba5c2aedbff6b36dab7099): Bind for 0.0.0.0:8002 failed: port is already allocated
ERROR: Encountered errors while bringing up the project.
taymonbeal commented 5 years ago

Are you already running anything on ports 8000 through 8002?

michaltrzesimiech commented 5 years ago

No, nothing

taymonbeal commented 5 years ago

Did you check? If you're on Linux, you can do this by running sudo netstat -tulpn | grep 800[012].

michaltrzesimiech commented 5 years ago

I did check image

sudo netstat -tulpn | grep 800[012] doesn't return anything

taymonbeal commented 5 years ago

docker ps?

michaltrzesimiech commented 5 years ago

image

taymonbeal commented 5 years ago

Okay, I don't know why you got the netstat results that you did, but this indicates that you are in fact already running an EA Hub development stack somewhere on this machine. Run docker stop $(docker ps -a -q) to turn it off, then try again.

michaltrzesimiech commented 5 years ago

Interesting.

Run that, then docker-compose run web django-admin createcontainer again, and it complained that I didn't run docker-compose build, so I did, and then createcontainer again and it now says

Building wheels for collected packages: django-environ
  Building wheel for django-environ (setup.py): started
  Building wheel for django-environ (setup.py): finished with status 'done'
  Stored in directory: /tmp/pip-ephem-wheel-cache-2djr8p_i/wheels/04/08/7a/f70577e6d4dc97b9b371d6344095e791854c710a8c44917f33
Successfully built django-environ
Installing collected packages: atomicwrites, attrs, certifi, chardet, idna, more-itertools, pluggy, py, six, pytest, urllib3, requests, pytest-base-url, pytest-metadata, pytest-html, pytest-variables, selenium, pytest-selenium, django-environ
Successfully installed atomicwrites-1.3.0 attrs-18.2.0 certifi-2018.11.29 chardet-3.0.4 django-environ-0.4.5 idna-2.8 more-itertools-6.0.0 pluggy-0.9.0 py-1.8.0 pytest-4.3.0 pytest-base-url-1.4.1 pytest-html-1.20.0 pytest-metadata-1.8.0 pytest-selenium-1.16.0 pytest-variables-1.7.1 requests-2.21.0 selenium-3.141.0 six-1.12.0 urllib3-1.24.2
You are using pip version 19.0.1, however version 19.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Removing intermediate container e9f444c7aa60
 ---> dd09255d1b3d
Step 6/7 : ENV  PYTHONPATH  /code/  PYTHONDONTWRITEBYTECODE True
 ---> Running in 6d83b4f19983
Removing intermediate container 6d83b4f19983
 ---> e11427ce9bf2
Step 7/7 : CMD  ["pytest","--driver=Remote"]
 ---> Running in 65bf17565468
Removing intermediate container 65bf17565468
 ---> e7be990d20f4
Successfully built e7be990d20f4
Successfully tagged eahuborg_e2e:latest
argo@argo:~/PycharmProjects/eahub.org$ docker-compose run web django-admin createcontainer
Starting eahuborg_db_1 ... done
Starting eahuborg_mail_1 ... done
Starting eahuborg_objstore_1 ... done
Starting eahuborg_cache_1    ... done
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 204, in fetch_command
    app_name = commands[subcommand]
KeyError: 'createcontainer'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/django-admin", line 10, in <module>
    sys.exit(execute_from_command_line())
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
    utility.execute()
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 375, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 211, in fetch_command
    settings.INSTALLED_APPS
  File "/usr/local/lib/python3.6/site-packages/django/conf/__init__.py", line 79, in __getattr__
    self._setup(name)
  File "/usr/local/lib/python3.6/site-packages/django/conf/__init__.py", line 66, in _setup
    self._wrapped = Settings(settings_module)
  File "/usr/local/lib/python3.6/site-packages/django/conf/__init__.py", line 157, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
  File "/usr/local/lib/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 941, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'eahub.config'
taymonbeal commented 5 years ago

Okay, just to make sure, you've got the latest code from master, right?

michaltrzesimiech commented 5 years ago

Yes I do, and there exists eahub.org/eahub/config$

taymonbeal commented 5 years ago

docker-compose run web python -c 'import os; print(os.environ); import sys; print(sys.path); import eahub.config.settings'

michaltrzesimiech commented 5 years ago 
argo@argo:~/PycharmProjects/eahub.org/eahub/config$ docker-compose run web python -c 'import os; print(os.environ); import sys; print(sys.path); import eahub.config.settings'
Starting eahuborg_cache_1 ... done
Starting eahuborg_objstore_1 ... done
Starting eahuborg_db_1       ... done
Starting eahuborg_mail_1     ... done

environ({'PATH': '/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin', 'HOSTNAME': '10174c7cdc03', 'TERM': 'xterm', 'ADMINS': 'Local Admin=admin@example.com', 'AZURE_CONNECTION_STRING': 'UseDevelopmentStorage=true;BlobEndpoint=objstore:8002', 'AZURE_CONTAINER': 'media', 'CACHE_URL': 'redis://cache:6379/0', 'DATABASE_URL': 'postgresql://postgres:development_db_password@db:5432/postgres', 'DEBUG': 'True', 'EMAIL_URL': 'smtp://mail:1025', 'HOSTS': 'web,localhost', 'HTTPS': 'False', 'LEAN_MANAGERS': 'Local Manager=leanmanager@example.com', 'RECAPTCHA_SECRET_KEY': '6LeIxAcTAAAAAGG-vFI1TnRWxMZNFuojJ4WifJWe', 'RECAPTCHA_SITE_KEY': '6LeIxAcTAAAAAJcZVRqyHh71UMIEGNQ_MXjiZKhI', 'SECRET_KEY': 'development_secret_key', 'LANG': 'C.UTF-8', 'GPG_KEY': '0D96DF4D4110E5C43FBFB17F2D347EA6AA65421D', 'PYTHON_VERSION': '3.6.8', 'PYTHON_PIP_VERSION': '19.0.1', 'PYTHONPATH': '/code/', 'DJANGO_SETTINGS_MODULE': 'eahub.config.settings', 'HOME': '/root'})
['', '/code', '/usr/local/lib/python36.zip', '/usr/local/lib/python3.6', '/usr/local/lib/python3.6/lib-dynload', '/usr/local/lib/python3.6/site-packages']
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'eahub.config'
argo@argo:~/PycharmProjects/eahub.org/eahub/config$
taymonbeal commented 5 years ago

docker-compose run web ls /code/eahub/config

michaltrzesimiech commented 5 years ago 
argo@argo:~/PycharmProjects/eahub.org/eahub/config$ docker-compose run web ls /code/eahub/config
Starting eahuborg_db_1 ... done
Starting eahuborg_mail_1 ... done
Starting eahuborg_objstore_1 ... done
Starting eahuborg_cache_1    ... done
ls: cannot access '/code/eahub/config': No such file or directory
taymonbeal commented 5 years ago

docker-compose run web ls /code

docker-compose run web mount

michaltrzesimiech commented 5 years ago 
argo@argo:~/PycharmProjects/eahub.org/eahub/config$ docker-compose run web ls /code
Starting eahuborg_cache_1 ... done
Starting eahuborg_mail_1  ... done
Starting eahuborg_db_1       ... done
Starting eahuborg_objstore_1 ... done

eahub
argo@argo:~/PycharmProjects/eahub.org/eahub/config$ docker-compose run web mount
Starting eahuborg_db_1    ... done
Starting eahuborg_objstore_1 ... done
Starting eahuborg_mail_1     ... done

overlay on / type overlay (rw,relatime,lowerdir=/mnt/sda1/var/lib/docker/overlay2/l/4OVLX4EIUWONBDRZEJO5GFLWNS:/mnt/sda1/var/lib/docker/overlay2/l/NN3U242PFPASLZJATK2VOXDRYX:/mnt/sda1/var/lib/docker/overlay2/l/FKNCUGSVNGUOR7EKL72HOXD3C2:/mnt/sda1/var/lib/docker/overlay2/l/GPJANGWGQT4LWL7EBEUCCGBPDR:/mnt/sda1/var/lib/docker/overlay2/l/V45BDVGEQNLAPDFFF4AGOXAXH3:/mnt/sda1/var/lib/docker/overlay2/l/XDO5EU2E4R6TIDV5R2FRNN4LR6:/mnt/sda1/var/lib/docker/overlay2/l/IVEP3ONJPENBK7KTKEZT5JVZQA:/mnt/sda1/var/lib/docker/overlay2/l/SYSAHVIRVB2LAMQSJHVU27VZ2M:/mnt/sda1/var/lib/docker/overlay2/l/UHTWROPHL3HOF57OQ6NXTZ7FCS:/mnt/sda1/var/lib/docker/overlay2/l/YUGURWUSTTROKS6I7HP5AGEF24:/mnt/sda1/var/lib/docker/overlay2/l/JK4WKPQ5WWR4X3PWFHU46XWJJM:/mnt/sda1/var/lib/docker/overlay2/l/STUJSB6VEMCA34YNMT4R5NACM4:/mnt/sda1/var/lib/docker/overlay2/l/PILVIQRETANIF3PKU3PMN42RH3:/mnt/sda1/var/lib/docker/overlay2/l/LT45KQZMRS22ZKLVRWA4YBBSZ2,upperdir=/mnt/sda1/var/lib/docker/overlay2/8d7522f76c672949b17e2afd6cc5f4c04087c8612492fc6dca28bb0e88b208d9/diff,workdir=/mnt/sda1/var/lib/docker/overlay2/8d7522f76c672949b17e2afd6cc5f4c04087c8612492fc6dca28bb0e88b208d9/work)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev type tmpfs (rw,nosuid,size=65536k,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=666)
sysfs on /sys type sysfs (ro,nosuid,nodev,noexec,relatime)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,relatime,mode=755)
cgroup on /sys/fs/cgroup/cpuset type cgroup (ro,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu type cgroup (ro,nosuid,nodev,noexec,relatime,cpu)
cgroup on /sys/fs/cgroup/cpuacct type cgroup (ro,nosuid,nodev,noexec,relatime,cpuacct)
cgroup on /sys/fs/cgroup/blkio type cgroup (ro,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/memory type cgroup (ro,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (ro,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (ro,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls type cgroup (ro,nosuid,nodev,noexec,relatime,net_cls)
cgroup on /sys/fs/cgroup/perf_event type cgroup (ro,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/net_prio type cgroup (ro,nosuid,nodev,noexec,relatime,net_prio)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (ro,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/pids type cgroup (ro,nosuid,nodev,noexec,relatime,pids)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
tmpfs on /code/eahub type tmpfs (rw,relatime,size=911792k)
/dev/sda1 on /etc/resolv.conf type ext4 (rw,relatime,data=ordered)
/dev/sda1 on /etc/hostname type ext4 (rw,relatime,data=ordered)
/dev/sda1 on /etc/hosts type ext4 (rw,relatime,data=ordered)
shm on /dev/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=65536k)
devpts on /dev/console type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=666)
proc on /proc/bus type proc (ro,relatime)
proc on /proc/fs type proc (ro,relatime)
proc on /proc/irq type proc (ro,relatime)
proc on /proc/sys type proc (ro,relatime)
proc on /proc/sysrq-trigger type proc (ro,relatime)
tmpfs on /proc/asound type tmpfs (ro,relatime)
tmpfs on /proc/acpi type tmpfs (ro,relatime)
tmpfs on /proc/kcore type tmpfs (rw,nosuid,size=65536k,mode=755)
tmpfs on /proc/keys type tmpfs (rw,nosuid,size=65536k,mode=755)
tmpfs on /proc/timer_list type tmpfs (rw,nosuid,size=65536k,mode=755)
tmpfs on /proc/scsi type tmpfs (ro,relatime)
tmpfs on /sys/firmware type tmpfs (ro,relatime)
michaltrzesimiech commented 5 years ago

Then 

argo@argo:~/PycharmProjects/eahub.org/eahub/config$ docker-compose run web django-admin createcontainer
Starting eahuborg_mail_1 ... done
Starting eahuborg_db_1   ... done
Starting eahuborg_objstore_1 ... done
Starting eahuborg_cache_1    ... done
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 204, in fetch_command
    app_name = commands[subcommand]
KeyError: 'createcontainer'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/django-admin", line 10, in <module>
    sys.exit(execute_from_command_line())
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
    utility.execute()
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 375, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 211, in fetch_command
    settings.INSTALLED_APPS
  File "/usr/local/lib/python3.6/site-packages/django/conf/__init__.py", line 79, in __getattr__
    self._setup(name)
  File "/usr/local/lib/python3.6/site-packages/django/conf/__init__.py", line 66, in _setup
    self._wrapped = Settings(settings_module)
  File "/usr/local/lib/python3.6/site-packages/django/conf/__init__.py", line 157, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
  File "/usr/local/lib/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 941, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'eahub.config'
taymonbeal commented 5 years ago

docker-compose run web ls /code/eahub

michaltrzesimiech commented 5 years ago

Done. 

argo@argo:~/PycharmProjects/eahub.org/eahub/config$ docker-compose run web ls /code/eahub
Starting eahuborg_cache_1 ... done
Starting eahuborg_mail_1  ... done
Starting eahuborg_db_1       ... done
Starting eahuborg_objstore_1 ... done
michaltrzesimiech commented 5 years ago

(Then same result for docker-compose run web django-admin createcontainer)

taymonbeal commented 5 years ago

Okay, there's something very very wrong with your Docker setup; your container doesn't have any of our code in it.

sha256sum docker-compose.yml eahub/Dockerfile

(By the way, these are all diagnostic commands and will not change anything by themselves.)

michaltrzesimiech commented 5 years ago
  1. Reinstalled docker-compose,
  2. rebooted Linux (Ubuntu Mate 16.04)
  3. 
argo@argo:~/PycharmProjects/eahub.org$ docker-machine start default
Starting "default"...
(default) Check network to re-create if needed...
(default) Waiting for an IP...
Machine "default" was started.
Waiting for SSH to be available...
Detecting the provisioner...
Started machines may have new IP addresses. You may need to re-run the `docker-machine env` command.
argo@argo:~/PycharmProjects/eahub.org$ docker-machine env
export DOCKER_TLS_VERIFY="1"
export DOCKER_HOST="tcp://192.168.99.100:2376"
export DOCKER_CERT_PATH="/home/argo/.docker/machine/machines/default"
export DOCKER_MACHINE_NAME="default"
# Run this command to configure your shell: 
# eval $(docker-machine env)
argo@argo:~/PycharmProjects/eahub.org$ eval $(docker-machine env)
argo@argo:~/PycharmProjects/eahub.org$ docker-compose run web django-admin createcontainer
Starting eahuborg_db_1 ... 
Starting eahuborg_mail_1     ... error
Starting eahuborg_objstore_1 ... 
Starting eahuborg_cache_1    ...

ERROR: for eahuborg_mail_1 Cannot start service mail: driver failed programming external connectivity on endpoint eahuborg_mail_1 (d1deddc2de6120265098019179acStarting eahuborg_objstore_1 ... error eady allocated

Starting eahuborg_db_1 ... done gramming external connectivity on endpoint eahuborg_objstore_1 (805c5bef9d3ed4d22a64af18bdc1f6cfd7fa48090fd860328f63c1a8e6ba4b54): Bind for 0.0.0.0:8002 failed:Starting eahuborg_cache_1 ... done

ERROR: for mail Cannot start service mail: driver failed programming external connectivity on endpoint eahuborg_mail_1 (d1deddc2de6120265098019179ac123ade1a22a557769137d4fbfdf352854b74): Bind for 0.0.0.0:8001 failed: port is already allocated

ERROR: for objstore Cannot start service objstore: driver failed programming external connectivity on endpoint eahuborg_objstore_1 (805c5bef9d3ed4d22a64af18bdc1f6cfd7fa48090fd860328f63c1a8e6ba4b54): Bind for 0.0.0.0:8002 failed: port is already allocated ERROR: Encountered errors while bringing up the project. argo@argo:~/PycharmProjects/eahub.org$ docker stop $(docker ps -a -q) dad6ddd95f32 3b35ec24365a 1286ffc1917d 5b4212af15b8 3fb0098efe6a a25beb130db9 cf9538903ddd a9f3862cad34 65367c7593f5 ee0ed43f55a2 2c0aca867653 8fc707addaa5 b2e27974a5b3 1f7b2c082828 10174c7cdc03 0fb9e26dfae9 87fd1fbc462f 9b00a5b106bd a3135b3dc301 8b17d23ab5a6 6f5bc56255f7 da840f1b805f 13ef25a8e4ab 777be39ab791 e2164897b47b 886d29bcd2cf 3e5e9f1843f2 argo@argo:~/PycharmProjects/eahub.org$ docker-compose run web django-admin createcontainer Starting eahuborg_db_1 ... done Starting eahuborg_mail_1 ... done Starting eahuborg_cache_1 ... done Starting eahuborg_objstore_1 ... done Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/django/core/management/init.py", line 204, in fetch_command app_name = commands[subcommand] KeyError: 'createcontainer'

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/bin/django-admin", line 10, in sys.exit(execute_from_command_line()) File "/usr/local/lib/python3.6/site-packages/django/core/management/init.py", line 381, in execute_from_command_line utility.execute() File "/usr/local/lib/python3.6/site-packages/django/core/management/init.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/local/lib/python3.6/site-packages/django/core/management/init.py", line 211, in fetch_command settings.INSTALLED_APPS File "/usr/local/lib/python3.6/site-packages/django/conf/init.py", line 79, in getattr self._setup(name) File "/usr/local/lib/python3.6/site-packages/django/conf/init.py", line 66, in _setup self._wrapped = Settings(settings_module) File "/usr/local/lib/python3.6/site-packages/django/conf/init.py", line 157, in init mod = importlib.import_module(self.SETTINGS_MODULE) File "/usr/local/lib/python3.6/importlib/init.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 994, in _gcd_import File "", line 971, in _find_and_load File "", line 941, in _find_and_load_unlocked File "", line 219, in _call_with_frames_removed File "", line 994, in _gcd_import File "", line 971, in _find_and_load File "", line 953, in _find_and_load_unlocked ModuleNotFoundError: No module named 'eahub.config' argo@argo:~/PycharmProjects/eahub.org$ 


> (By the way, these are all diagnostic commands and will not change anything by themselves.)

You're right, I was running that on autopilot
taymonbeal commented 5 years ago

What came from the sha256sum command?

michaltrzesimiech commented 5 years ago 
argo@argo:~/PycharmProjects/eahub.org$ sha256sum docker-compose.yml eahub/Dockerfile
619711851cfd9cfe5652e1442e98174717d57da658d5ab26d08ac637d4d473ea  docker-compose.yml
613b2bb06c5e3bcbd2f17ef4e129dc8f015ee63414168c6829d4bad508987006  eahub/Dockerfile
argo@argo:~/PycharmProjects/eahub.org$
taymonbeal commented 5 years ago

Also, why are you using docker-machine on Linux? docker-machine is for setting up a lightweight VM to run Docker in on Windows and macOS, since Docker (at least the way we're using it) only runs natively on Linux. If you're already on Linux you don't need it.

michaltrzesimiech commented 5 years ago 
argo@argo:~/PycharmProjects/eahub.org$ docker-compose run web django-admin createcontainer
ERROR: Couldn't connect to Docker daemon - you might need to run `docker-machine start default`.
taymonbeal commented 5 years ago

How did you install Docker?

michaltrzesimiech commented 5 years ago

sudo apt-get install docker-compose?

taymonbeal commented 5 years ago

Try following the official installation instructions at https://docs.docker.com/install/linux/docker-ce/ubuntu/.

michaltrzesimiech commented 5 years ago

Uninstalled, installed again, restarted, then

argo@argo:~/PycharmProjects/eahub.org/eahub$ docker-compose run web django-admin createcontainer
ERROR: Couldn't connect to Docker daemon - you might need to run `docker-machine start default`.
taymonbeal commented 5 years ago

Did sudo docker run hello-world from the installation instructions work? Does it work now?

michaltrzesimiech commented 5 years ago

It does

argo@argo:~/PycharmProjects/eahub.org/eahub$ sudo docker run hello-world

Hello from Docker!
This message shows that your installation appears to be working correctly.

To generate this message, Docker took the following steps:
 1. The Docker client contacted the Docker daemon.
 2. The Docker daemon pulled the "hello-world" image from the Docker Hub.
    (amd64)
 3. The Docker daemon created a new container from that image which runs the
    executable that produces the output you are currently reading.
 4. The Docker daemon streamed that output to the Docker client, which sent it
    to your terminal.

To try something more ambitious, you can run an Ubuntu container with:
 $ docker run -it ubuntu bash

Share images, automate workflows, and more with a free Docker ID:
 https://hub.docker.com/

For more examples and ideas, visit:
 https://docs.docker.com/get-started/
taymonbeal commented 5 years ago

Did you do the first two post-installation procedures for Linux? https://docs.docker.com/install/linux/linux-postinstall/

michaltrzesimiech commented 5 years ago

That seemingly moved us further.

Here's what happened after it fetched the dependencies:

Building wheels for collected packages: ipdb, geographiclib, django-environ, django-storages, django-authtools, django-enumfield, rules, pytils, mysqlclient, django-sluggable, django-allauth, django-recaptcha, backcall, pycparser
  Building wheel for ipdb (setup.py): started
  Building wheel for ipdb (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/a8/0e/e2/ffc7bedd430bfd12e9dba3c4dd88906bc42962face85bc4df7
  Building wheel for geographiclib (setup.py): started
  Building wheel for geographiclib (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/99/45/d1/14954797e2a976083182c2e7da9b4e924509e59b6e5c661061
  Building wheel for django-environ (setup.py): started
  Building wheel for django-environ (setup.py): finished with status 'done'
  Stored in directory: /tmp/pip-ephem-wheel-cache-phitj_h2/wheels/04/08/7a/f70577e6d4dc97b9b371d6344095e791854c710a8c44917f33
  Building wheel for django-storages (setup.py): started
  Building wheel for django-storages (setup.py): finished with status 'done'
  Stored in directory: /tmp/pip-ephem-wheel-cache-phitj_h2/wheels/63/cf/8d/5d39e666eeb1b0e4287ed8a2fb7c460ea16f2746e8109a6802
  Building wheel for django-authtools (setup.py): started
  Building wheel for django-authtools (setup.py): finished with status 'done'
  Stored in directory: /tmp/pip-ephem-wheel-cache-phitj_h2/wheels/f4/55/7e/99655b23d7e178734bed668468b0a36bbf73edb7ea506fb923
  Building wheel for django-enumfield (setup.py): started
  Building wheel for django-enumfield (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/81/76/50/426965a18db48470fbbfcb123e774ca8ca3ccd421c8cc37c82
  Building wheel for rules (setup.py): started
  Building wheel for rules (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/67/ec/41/3478e4170bdffcc19892f03fc630fae08cd2f3c8d1711038ea
  Building wheel for pytils (setup.py): started
  Building wheel for pytils (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/d6/f9/dc/4f07d8ee40d9cfca9973b3f4aeff99d0bb69900e5f3dffbf32
  Building wheel for mysqlclient (setup.py): started
  Building wheel for mysqlclient (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/30/91/e0/2ee952bce05b1247807405c6710c6130e49468a5240ae27134
  Building wheel for django-sluggable (setup.py): started
  Building wheel for django-sluggable (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/3c/6a/00/9c859caccf7aec5baa664086570d6be63973ced8b86ad1caba
  Building wheel for django-allauth (setup.py): started
  Building wheel for django-allauth (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/54/fd/82/85627ea8a473608cec4fa5ca58bdfdf41c3845a40fd4fb1d16
  Building wheel for django-recaptcha (setup.py): started
  Building wheel for django-recaptcha (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/93/c7/1c/01c01667e7a713507835c515426b214d6e9dae8785c256b567
  Building wheel for backcall (setup.py): started
  Building wheel for backcall (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/98/b0/dd/29e28ff615af3dda4c67cab719dd51357597eabff926976b45
  Building wheel for pycparser (setup.py): started
  Building wheel for pycparser (setup.py): finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/f2/9a/90/de94f8556265ddc9d9c8b271b0f63e57b26fb1d67a45564511
Successfully built ipdb geographiclib django-environ django-storages django-authtools django-enumfield rules pytils mysqlclient django-sluggable django-allauth django-recaptcha backcall pycparser
ERROR: azure-cosmosdb-table 1.0.5 has requirement azure-storage-common~=1.1, but you'll have azure-storage-common 2.0.0 which is incompatible.
ERROR: azure-storage-file 1.4.0 has requirement azure-storage-common~=1.4, but you'll have azure-storage-common 2.0.0 which is incompatible.
ERROR: azure-storage-queue 1.4.0 has requirement azure-storage-common~=1.4, but you'll have azure-storage-common 2.0.0 which is incompatible.
ERROR: azure 4.0.0 has requirement azure-storage-blob~=1.3, but you'll have azure-storage-blob 2.0.1 which is incompatible.
Installing collected packages: pytz, sqlparse, django, gunicorn, psycopg2-binary, Brotli, whitenoise, chardet, urllib3, certifi, idna, requests, pickleshare, pygments, backcall, ptyprocess, pexpect, decorator, parso, jedi, wcwidth, six, prompt-toolkit, ipython-genutils, traitlets, ipython, ipdb, geographiclib, geopy, django-environ, python-dateutil, azure-common, asn1crypto, pycparser, cffi, cryptography, azure-storage-common, azure-nspkg, azure-cosmosdb-nspkg, azure-cosmosdb-table, azure-storage-file, azure-storage-blob, azure-storage-queue, isodate, oauthlib, requests-oauthlib, msrest, azure-servicefabric, azure-applicationinsights, azure-loganalytics, PyJWT, adal, azure-datalake-store, azure-servicemanagement-legacy, msrestazure, azure-graphrbac, azure-mgmt-cdn, azure-mgmt-nspkg, azure-mgmt-advisor, azure-mgmt-iothub, azure-mgmt-signalr, azure-mgmt-batch, azure-mgmt-loganalytics, azure-mgmt-powerbiembedded, azure-mgmt-compute, azure-mgmt-subscription, azure-mgmt-sql, azure-mgmt-network, azure-mgmt-monitor, azure-mgmt-marketplaceordering, azure-mgmt-servicebus, azure-mgmt-datafactory, azure-mgmt-logic, azure-mgmt-recoveryservices, azure-mgmt-trafficmanager, azure-mgmt-managementgroups, azure-mgmt-datamigration, azure-mgmt-consumption, azure-mgmt-devspaces, azure-mgmt-devtestlabs, azure-mgmt-commerce, azure-mgmt-machinelearningcompute, azure-mgmt-dns, azure-mgmt-eventgrid, azure-mgmt-hanaonazure, azure-mgmt-resource, azure-mgmt-containerinstance, azure-mgmt-containerregistry, azure-mgmt-containerservice, azure-mgmt-eventhub, azure-mgmt-managementpartner, azure-mgmt-media, azure-mgmt-keyvault, azure-mgmt-storage, azure-mgmt-billing, azure-mgmt-applicationinsights, azure-mgmt-rdbms, azure-mgmt-iotcentral, azure-mgmt-cognitiveservices, azure-mgmt-servicefabric, azure-mgmt-policyinsights, azure-mgmt-redis, azure-mgmt-relay, azure-mgmt-cosmosdb, azure-mgmt-msi, azure-mgmt-recoveryservicesbackup, azure-mgmt-datalake-nspkg, azure-mgmt-datalake-store, azure-mgmt-web, azure-mgmt-datalake-analytics, azure-mgmt-reservations, azure-mgmt-authorization, azure-mgmt-maps, azure-mgmt-iothubprovisioningservices, azure-mgmt-scheduler, azure-mgmt-notificationhubs, azure-mgmt-search, azure-mgmt-batchai, azure-mgmt, azure-keyvault, azure-eventgrid, azure-servicebus, azure-batch, azure, django-storages, django-authtools, redis, django-redis, hiredis, Pillow, sorl-thumbnail, django-cleanup, django-upload-path, airtable-python-wrapper, applicationinsights, django-autoslug, django-enumfield, django-crispy-forms, rules, pytils, mysqlclient, django-sluggable, defusedxml, python3-openid, django-allauth, django-recaptcha, django-pwned-passwords
Successfully installed Brotli-1.0.7 Pillow-5.4.1 PyJWT-1.7.1 adal-1.2.1 airtable-python-wrapper-0.11.3.post1 applicationinsights-0.11.7 asn1crypto-0.24.0 azure-4.0.0 azure-applicationinsights-0.1.0 azure-batch-4.1.3 azure-common-1.1.20 azure-cosmosdb-nspkg-2.0.2 azure-cosmosdb-table-1.0.5 azure-datalake-store-0.0.45 azure-eventgrid-1.2.0 azure-graphrbac-0.40.0 azure-keyvault-1.1.0 azure-loganalytics-0.1.0 azure-mgmt-4.0.0 azure-mgmt-advisor-1.0.1 azure-mgmt-applicationinsights-0.1.1 azure-mgmt-authorization-0.50.0 azure-mgmt-batch-5.0.1 azure-mgmt-batchai-2.0.0 azure-mgmt-billing-0.2.0 azure-mgmt-cdn-3.1.0 azure-mgmt-cognitiveservices-3.0.0 azure-mgmt-commerce-1.0.1 azure-mgmt-compute-4.6.2 azure-mgmt-consumption-2.0.0 azure-mgmt-containerinstance-1.4.1 azure-mgmt-containerregistry-2.8.0 azure-mgmt-containerservice-4.4.0 azure-mgmt-cosmosdb-0.4.1 azure-mgmt-datafactory-0.6.0 azure-mgmt-datalake-analytics-0.6.0 azure-mgmt-datalake-nspkg-3.0.1 azure-mgmt-datalake-store-0.5.0 azure-mgmt-datamigration-1.0.0 azure-mgmt-devspaces-0.1.0 azure-mgmt-devtestlabs-2.2.0 azure-mgmt-dns-2.1.0 azure-mgmt-eventgrid-1.0.0 azure-mgmt-eventhub-2.6.0 azure-mgmt-hanaonazure-0.1.1 azure-mgmt-iotcentral-0.1.0 azure-mgmt-iothub-0.5.0 azure-mgmt-iothubprovisioningservices-0.2.0 azure-mgmt-keyvault-1.1.0 azure-mgmt-loganalytics-0.2.0 azure-mgmt-logic-3.0.0 azure-mgmt-machinelearningcompute-0.4.1 azure-mgmt-managementgroups-0.1.0 azure-mgmt-managementpartner-0.1.0 azure-mgmt-maps-0.1.0 azure-mgmt-marketplaceordering-0.1.0 azure-mgmt-media-1.0.0 azure-mgmt-monitor-0.5.2 azure-mgmt-msi-0.2.0 azure-mgmt-network-2.7.0 azure-mgmt-notificationhubs-2.1.0 azure-mgmt-nspkg-3.0.2 azure-mgmt-policyinsights-0.1.0 azure-mgmt-powerbiembedded-2.0.0 azure-mgmt-rdbms-1.8.0 azure-mgmt-recoveryservices-0.3.0 azure-mgmt-recoveryservicesbackup-0.3.0 azure-mgmt-redis-5.0.0 azure-mgmt-relay-0.1.0 azure-mgmt-reservations-0.2.1 azure-mgmt-resource-2.1.0 azure-mgmt-scheduler-2.0.0 azure-mgmt-search-2.0.0 azure-mgmt-servicebus-0.5.3 azure-mgmt-servicefabric-0.2.0 azure-mgmt-signalr-0.1.1 azure-mgmt-sql-0.9.1 azure-mgmt-storage-2.0.0 azure-mgmt-subscription-0.2.0 azure-mgmt-trafficmanager-0.50.0 azure-mgmt-web-0.35.0 azure-nspkg-3.0.2 azure-servicebus-0.21.1 azure-servicefabric-6.3.0.0 azure-servicemanagement-legacy-0.20.6 azure-storage-blob-2.0.1 azure-storage-common-2.0.0 azure-storage-file-1.4.0 azure-storage-queue-1.4.0 backcall-0.1.0 certifi-2019.3.9 cffi-1.12.3 chardet-3.0.4 cryptography-2.6.1 decorator-4.4.0 defusedxml-0.6.0 django-2.2 django-allauth-0.39.1 django-authtools-1.7.dev0 django-autoslug-1.9.4 django-cleanup-3.0.1 django-crispy-forms-1.7.2 django-enumfield-1.5 django-environ-0.4.5 django-pwned-passwords-3.0.0 django-recaptcha-2.0.2 django-redis-4.10.0 django-sluggable-0.6.1 django-storages-1.7.1 django-upload-path-0.1.1 geographiclib-1.49 geopy-1.18.1 gunicorn-19.9.0 hiredis-1.0.0 idna-2.8 ipdb-0.11 ipython-7.5.0 ipython-genutils-0.2.0 isodate-0.6.0 jedi-0.13.3 msrest-0.6.6 msrestazure-0.6.0 mysqlclient-1.4.2.post1 oauthlib-3.0.1 parso-0.4.0 pexpect-4.7.0 pickleshare-0.7.5 prompt-toolkit-2.0.9 psycopg2-binary-2.7.6.1 ptyprocess-0.6.0 pycparser-2.19 pygments-2.4.0 python-dateutil-2.8.0 python3-openid-3.1.0 pytils-0.3 pytz-2018.9 redis-3.2.1 requests-2.21.0 requests-oauthlib-1.2.0 rules-2.0.1 six-1.12.0 sorl-thumbnail-12.5.0 sqlparse-0.3.0 traitlets-4.3.2 urllib3-1.24.3 wcwidth-0.1.7 whitenoise-4.1.2
Removing intermediate container 4256ac6aeb63
 ---> 1aef3275da43
Step 6/10 : ENV PYTHONPATH  /code/
 ---> Running in fc62e6063774
Removing intermediate container fc62e6063774
 ---> ff712a92c0d7
Step 7/10 : RUN mkdir /static/  && DJANGO_SETTINGS_MODULE=eahub.config.build_settings django-admin collectstatic
 ---> Running in b8f538555001

170 static files copied to '/static', 738 post-processed.
Removing intermediate container b8f538555001
 ---> 8bd50ceec665
Step 8/10 : ENV DJANGO_SETTINGS_MODULE  eahub.config.settings
 ---> Running in 8d0134adb08f
Removing intermediate container 8d0134adb08f
 ---> cd4559e70e34
Step 9/10 : EXPOSE  8000
 ---> Running in c5b1f6bc5364
Removing intermediate container c5b1f6bc5364
 ---> 8d595530503d
Step 10/10 : CMD    ["gunicorn","--bind=0.0.0.0:8000","eahub.config.wsgi"]
 ---> Running in f146469aaae8
Removing intermediate container f146469aaae8
 ---> d212ef80aaee
Successfully built d212ef80aaee
Successfully tagged eahuborg_web:latest
WARNING: Image for service web was built because it did not already exist. To rebuild this image you must use `docker-compose build` or `docker-compose up --build`.
Traceback (most recent call last):
  File "/usr/local/bin/django-admin", line 10, in <module>
    sys.exit(execute_from_command_line())
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
    utility.execute()
  File "/usr/local/lib/python3.6/site-packages/django/core/management/__init__.py", line 375, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/local/lib/python3.6/site-packages/django/core/management/base.py", line 323, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/usr/local/lib/python3.6/site-packages/django/core/management/base.py", line 361, in execute
    self.check()
  File "/usr/local/lib/python3.6/site-packages/django/core/management/base.py", line 390, in check
    include_deployment_checks=include_deployment_checks,
  File "/usr/local/lib/python3.6/site-packages/django/core/management/base.py", line 377, in _run_checks
    return checks.run_checks(**kwargs)
  File "/usr/local/lib/python3.6/site-packages/django/core/checks/registry.py", line 72, in run_checks
    new_errors = check(app_configs=app_configs)
  File "/usr/local/lib/python3.6/site-packages/django/core/checks/urls.py", line 40, in check_url_namespaces_unique
    all_namespaces = _load_all_namespaces(resolver)
  File "/usr/local/lib/python3.6/site-packages/django/core/checks/urls.py", line 57, in _load_all_namespaces
    url_patterns = getattr(resolver, 'url_patterns', [])
  File "/usr/local/lib/python3.6/site-packages/django/utils/functional.py", line 80, in __get__
    res = instance.__dict__[self.name] = self.func(instance)
  File "/usr/local/lib/python3.6/site-packages/django/urls/resolvers.py", line 571, in url_patterns
    patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
  File "/usr/local/lib/python3.6/site-packages/django/utils/functional.py", line 80, in __get__
    res = instance.__dict__[self.name] = self.func(instance)
  File "/usr/local/lib/python3.6/site-packages/django/urls/resolvers.py", line 564, in urlconf_module
    return import_module(self.urlconf_name)
  File "/usr/local/lib/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/code/eahub/config/urls.py", line 31, in <module>
    path('about/newsletter/', views.LegacyRedirectView.as_view(template_name='newsletter')),
  File "/usr/local/lib/python3.6/site-packages/django/views/generic/base.py", line 59, in as_view
    "attributes of the class." % (cls.__name__, key))
TypeError: LegacyRedirectView() received an invalid keyword 'template_name'. as_view only accepts arguments that are already attributes of the class.
michaltrzesimiech commented 5 years ago

I think that's my fault, actually.

taymonbeal commented 5 years ago

Ah, crap, I missed that in code review. Yeah, we're broken at head right now, one of us needs to fix.

michaltrzesimiech commented 5 years ago

About to commit

michaltrzesimiech commented 5 years ago

https://github.com/rtcharity/eahub.org/pull/712

michaltrzesimiech commented 5 years ago 
argo@argo:~/PycharmProjects/eahub.org$ docker-compose run web django-admin createcontainer
Starting eahuborg_db_1    ... done
Starting eahuborg_objstore_1 ... done
Starting eahuborg_mail_1     ... done
Successfully created container "media"