scotthugh commented 5 months ago

Hey bro,

Seems like an awesome project you have here.

I have tried to run the openvpn-aws installation and I want to get this working but I get an error when running the: ansible-playbook main.yml command. I have tried to run it multiple times to no avail.

I run on Ubuntu 24 LTS.

This is the error I get: TASK [Ensure OpenVPN is running.] *** fatal: [openvpn-aws]: FAILED! => {"changed": false, "msg": "Error connecting: Error while fetching server API version: HTTPConnection.request() got an unexpected keyword argument 'chunked'"}

PLAY RECAP ** openvpn-aws : ok=11 changed=0 unreachable=0 failed=1 skipped=4 rescued=0 ignored=0

In the openvpn.yml you write

TODO The first time this playbook is run, the `pi` user may not be added

to the `docker` group, so this task may fail.

I just don't know how to fix this.

Anyone?

Thanks

scotthugh commented 5 months ago

This is what I get when I run with -vvv

The full traceback is: File "/tmp/ansible_community.docker.docker_compose_payload_igw26ipj/ansible_community.docker.docker_compose_payload.zip/ansible_collections/community/docker/plugins/module_utils/common.py", line 248, in init super(AnsibleDockerClientBase, self).init(**self._connect_params) File "/usr/lib/python3/dist-packages/docker/api/client.py", line 197, in init self._version = self._retrieve_server_version() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version raise DockerException( fatal: [openvpn-aws]: FAILED! => { "changed": false, "invocation": { "module_args": { "api_version": "auto", "build": false, "ca_path": null, "client_cert": null, "client_key": null, "debug": false, "definition": null, "dependencies": true, "docker_host": "unix:///var/run/docker.sock", "env_file": null, "files": null, "hostname_check": false, "nocache": false, "profiles": null, "project_name": null, "project_src": "/home/myuser/openvpn-server/", "pull": false, "recreate": "smart", "remove_images": null, "remove_orphans": false, "remove_volumes": false, "restarted": false, "scale": null, "services": null, "ssl_version": null, "state": "present", "stopped": false, "timeout": null, "tls": false, "tls_hostname": null, "use_ssh_client": false, "validate_certs": false } }, "msg": "Error connecting: Error while fetching server API version: HTTPConnection.request() got an unexpected keyword argument 'chunked'" }

d3vilh commented 5 months ago

Hi @scotthugh, Hope you sorted it out already :) There is one config inventory.yml where you must add your current username (whoami) instead of admin. Then re-login and run the main playbook again. Should works fine.

scotthugh commented 5 months ago

Hi d3vilh,

I did that. I assumed it should be my own username.

But same error.

I'll try again, but for what it's worth I believe I will get same error again.

d3vilh commented 5 months ago

You need to check that your Docker is running: systemctl status docker

and your user have access to docker socket file ls -l /var/run/docker.sock

and you able to access ti the docker env without any additional passwords docker info; docker container ls; docker image ls

If you can't - relogin and run all the playbooks again, including Ansible modules installation with ansible-galaxy (par 4 of [Installation](https://github.com/d3vilh/openvpn-aws?tab=readme-ov-file#installation manual)).

It is better to follow the installation step by step, it also has user permissions fix in par 6.

scotthugh commented 5 months ago

I do go through the installation step by step meticulously but still get same error.

Now when I run the docker info; docker container ls; docker image ls I get this text - which points me towards thinking that the images are not running. Even if I run the playbooks again from scratch, multiple times etc. nothing, I don't know if I am doing something wrong: Client: Docker Engine - Community Version: 26.1.0 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.14.0 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v2.26.1 Path: /usr/libexec/docker/cli-plugins/docker-compose

Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 0 Server Version: 26.1.0 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: systemd Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog Swarm: inactive Runtimes: io.containerd.runc.v2 runc Default Runtime: runc Init Binary: docker-init containerd version: e377cd56a71523140ca6ae87e30244719194a521 runc version: v1.1.12-0-g51d5e94 init version: de40ad0 Security Options: apparmor seccomp Profile: builtin cgroupns Kernel Version: 6.8.0-31-generic Operating System: Ubuntu 24.04 LTS OSType: linux Architecture: x86_64 CPUs: 2 Total Memory: 1.858GiB Name: vpn.server.com ID: 9421e11b-70d7-42ee-aef5-79967d582ce4 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 127.0.0.0/8 Live Restore Enabled: false

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES REPOSITORY TAG IMAGE ID CREATED SIZE

d3vilh commented 5 months ago

OK, still this is problem with environment, lets dig further:

Docker is installed and we assume that
user has assigned docker group (run groups to check, there must be docker group in the list)
inventory.yml has your username set to admin var (in line 6)
We tried to do everything from the scratch, but did not clear the previous installations.

Lets give it one more try but, please:

Remove the current openvpn-aws repository.
Reinstall Docker sudo apt-get remove python3-docker && sudo apt-get install python3-docker.
Doublecheck that current user is in docker group sudo usermod -aG docker $USER.
Clone repo one more time git clone https://github.com/d3vilh/openvpn-aws.
Update inventory.yml line 6 with your current username.
Reinstall ansible galaxy collection ansible-galaxy collection install -r requirements.yml --force. This is very important.
Clear Docker cache files docker system prune -a, just in case.
Logout and Login again.
Run the playbook one more time, it should works fine now.

If it does not work, please share:

systemctl status docker;
groups;
ls -l /var/run/docker.sock;
docker --version && docker info;
pip show docker;
sudo journalctl -u docker.service;
ansible-playbook -vvv main.yml

Thanks for your time and help in debugging this!

scotthugh commented 5 months ago

Hey man, thanks for helping out here.

It still doesn’t work, and I’ll provide you with the information below. Before we jump to that I want to fill in some blanks. I start each time from at stock Ubuntu Server 24.04 LTS image. I created a snapshot that I revert to, to ensure that I don’t have anything from the old installations. What I notice is that the docker images doesn’t seem to be downloaded and spun up. I have little experience in this area, however, being analytical that is what I get out of it. So, maybe we should look there?

Have you tried to spin up a completely stock Ubuntu Server 24.04 LTS image and run the installation?

Ok now to the juicy part 😊 and crazy long

systemctl status docker;

● docker.service - Docker Application Container Engine

 Loaded: loaded (/usr/lib/systemd/system/docker.service; enabled; preset: enabled)

 Active: active (running) since Thu 2024-05-02 04:04:57 UTC; 8min ago

TriggeredBy: ● docker.socket

   Docs: https://docs.docker.com

Main PID: 10784 (dockerd)

  Tasks: 9

 Memory: 26.8M (peak: 29.3M)

    CPU: 529ms

 CGroup: /system.slice/docker.service

         └─10784 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.298006611Z" level=info msg="Starting up"

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.303233249Z" level=info msg="detected 127.0.0.53 nameserver, assuming systemd-resolved, so using resolv.conf: /run/systemd/resolve/resolv.conf"

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.454872567Z" level=info msg="[graphdriver] using prior storage driver: overlay2"

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.456533479Z" level=info msg="Loading containers: start."

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.799884108Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.909164213Z" level=info msg="Loading containers: done."

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.938483529Z" level=info msg="Docker daemon" commit=ac2de55 containerd-snapshotter=false storage-driver=overlay2 version=26.1.1

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.938567330Z" level=info msg="Daemon has completed initialization"

May 02 04:04:57 vpn dockerd[10784]: time="2024-05-02T04:04:57.976861812Z" level=info msg="API listen on /run/docker.sock"

May 02 04:04:57 vpn systemd[1]: Started docker.service - Docker Application Container Engine.

groups;

vpnuser adm cdrom sudo dip plugdev lxd docker

ls -l /var/run/docker.sock; srw-rw---- 1 root docker 0 May 2 04:04 /var/run/docker.sock

docker --version && docker info; Docker version 26.1.1, build 4cf5afa Client: Docker Engine - Community Version: 26.1.1 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.14.0 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v2.26.1 Path: /usr/libexec/docker/cli-plugins/docker-compose

Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 0 Server Version: 26.1.1 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: systemd Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog Swarm: inactive Runtimes: io.containerd.runc.v2 runc Default Runtime: runc Init Binary: docker-init containerd version: e377cd56a71523140ca6ae87e30244719194a521 runc version: v1.1.12-0-g51d5e94 init version: de40ad0 Security Options: apparmor seccomp Profile: builtin cgroupns Kernel Version: 6.8.0-31-generic Operating System: Ubuntu 24.04 LTS OSType: linux Architecture: x86_64 CPUs: 2 Total Memory: 1.858GiB Name: vpn ID: 9421e11b-70d7-42ee-aef5-79967d582ce4 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 127.0.0.0/8 Live Restore Enabled: false

pip show docker;

Name: docker

Version: 5.0.3

Summary: A Python library for the Docker Engine API.

Home-page: https://github.com/docker/docker-py

Author:

Author-email:

License: Apache License 2.0

Location: /usr/lib/python3/dist-packages

Requires:

sudo journalctl -u docker.service;

Apr 30 13:51:20 vpn systemd[1]: Starting docker.service - Docker Application Container Engine...

Apr 30 13:51:20 vpn dockerd[2567]: time="2024-04-30T13:51:20.378684182Z" level=info msg="Starting up"

Apr 30 13:51:20 vpn dockerd[2567]: time="2024-04-30T13:51:20.379768896Z" level=info msg="detected 127.0.0.53 nameserver, assuming systemd-resolved, so using resolv.conf: /run/systemd/resolve/resolv.conf"

Apr 30 13:51:20 vpn dockerd[2567]: time="2024-04-30T13:51:20.523651876Z" level=info msg="Loading containers: start."

Apr 30 13:51:20 vpn dockerd[2567]: time="2024-04-30T13:51:20.822945179Z" level=info msg="Loading containers: done."

Apr 30 13:51:20 vpn dockerd[2567]: time="2024-04-30T13:51:20.862013462Z" level=info msg="Docker daemon" commit=c8af8eb containerd-snapshotter=false storage-driver=overlay2 version=26.1.0

Apr 30 13:51:20 vpn dockerd[2567]: time="2024-04-30T13:51:20.862378466Z" level=info msg="Daemon has completed initialization"

Apr 30 13:51:20 vpn dockerd[2567]: time="2024-04-30T13:51:20.980735431Z" level=info msg="API listen on /run/docker.sock"

Apr 30 13:51:20 vpn systemd[1]: Started docker.service - Docker Application Container Engine.

May 02 04:04:57 vpn systemd[1]: Stopping docker.service - Docker Application Container Engine...

May 02 04:04:57 vpn.dockerd[2567]: time="2024-05-02T04:04:57.049470880Z" level=info msg="Processing signal 'terminated'"

May 02 04:04:57 vpn dockerd[2567]: time="2024-05-02T04:04:57.053032006Z" level=info msg="stopping event stream following graceful shutdown" error="" module=libcontainerd namespace=moby

May 02 04:04:57 vpn dockerd[2567]: time="2024-05-02T04:04:57.055482424Z" level=info msg="Daemon shutdown complete"

May 02 04:04:57 vpn systemd[1]: docker.service: Deactivated successfully.

May 02 04:04:57 vpn systemd[1]: Stopped docker.service - Docker Application Container Engine.

May 02 04:04:57 vpn systemd[1]: docker.service: Consumed 40.580s CPU time, 32.1M memory peak, 0B memory swap peak.

May 02 04:04:57 vpn systemd[1]: Starting docker.service - Docker Application Container Engine...