freeflow_caprover

What is CapRover?

CapRover is an easy-to-use app/database deployment and web server manager that works for a variety of applications such as Node.js, Ruby, PHP, Postgres, and MongoDB. It runs fast and is very robust, as it uses Docker, Nginx, LetsEncrypt, and NetData under the hood behind its user-friendly interface. Here’s a link to CapRover's open source repository on GitHub

Features of Caprover:

• CLI for automation and scripting
• Web GUI for ease of access and convenience
• No lock-in! Remove CapRover and your apps keep working!
• Docker Swarm under the hood for containerization and clustering
• Nginx (fully customizable template) under the hood for load-balancing
• Let’s Encrypt under the hood for free SSL (HTTPS)
• One-Click Apps: Deploying one-click apps is a matter of seconds! MongoDB, Parse, MySQL, WordPress, Postgres and many more.
• Fully Customizable: Optionally fully customizable nginx config allowing you to enable HTTP2, specific caching logic, custom SSL certs and etc
• Cluster Ready: Attach more nodes and create a cluster in seconds! CapRover automatically configures nginx to load balance.
• Increase Productivity: Focus on your apps! Not the bells and whistles just to run your apps!
• Easy Deploy: Many ways to deploy. You can upload your source from dashboard, use command line caprover deploy, use webhooks and build upon git push

Pre-requisites

• Domain Name: after installation, you will need to point a wildcard DNS entry to your CapRover IP Address. Note that you can use CapRover without a domain too. But you won't be able to setup HTTPS or add Self hosted Docker Registry.
• TerraForm installed to provision, adjust and tear down infrastructure using the tf configuration files provided here.
• Yggdrasil installed and enabled for End-to-end encrypted IPv6 networking.
• account created on Polkadot and got an twin id, and saved you mnemonics.
• TFTs in your account balance (in development, Transferer some test TFTs from ALICE account).

How to run CapRover on ThreeFold Grid 3:

In this guide, we will use Caprover to setup your own private Platform as a service (PaaS) on ThreeFold grid 3 infrastructure.

clone the project repo

git clone https://github.com/freeflowuniverse/freeflow_caprover.git

A) leader node deployment/setup:

step 1: Deploy a leader Node

• Modify the terraform file freeflow_caprover/terraform/leader/

  cd freeflow_caprover/terraform/leader/
  export MNEMONICS="<mnemonics words>"
  export NETWORK="<network>" # dev or test
  vim main.tf

  • In resource Block, update the disks size, memory size, and cores number to fit your needs or leave as it is for testing.
  • In the PUBLIC_KEY env var value put your ssh public key .
  • In the CAPROVER_ROOT_DOMAIN env var value put your root domain, this is optional and you can add it later from the dashboard put it will save you the extra step and allow you to access your dashboard using your domain name directly after the deployment.
  • In the DEFAULT_PASSWORD env var value put a password to be used for login to captain dashboard or leave it as it is to generate random password.

• save the file, and execute the following commands:

  terraform init && terraform apply -parallelism=1

• wait till you see apply complete, and note the VM public ip in the final output.

• not the tf output of caprover_default_password. you will need this password to login to the captain dashboard later.

• verify the status of the VM

  ssh root@{public_ip_address}
  zinit list
  zinit log caprover

  you will see output like this:

  root@caprover:~# zinit list
  sshd: Running
  containerd: Running
  dockerd: Running
  sshd-init: Success
  caprover: Running
  root@caprover:~# zinit log caprover
  [+] caprover: CapRover Root Domain: newapps.grid.tf
  [+] caprover: {
  [+] caprover:             "namespace": "captain",
  [+] caprover:             "customDomain": "newapps.grid.tf"
  [+] caprover:     }
  [+] caprover: CapRover will be available at http://captain.newapps.grid.    tf after installation
  [-] caprover: docker: Cannot connect to the Docker daemon at unix:///var/   run/docker.sock. Is the docker daemon running?.
  [-] caprover: See 'docker run --help'.
  [-] caprover: Unable to find image 'caprover/caprover:latest' locally
  [-] caprover: latest: Pulling from caprover/caprover
  [-] caprover: af4c2580c6c3: Pulling fs layer
  [-] caprover: 4ea40d27a2cf: Pulling fs layer
  [-] caprover: 523d612e9cd2: Pulling fs layer
  [-] caprover: 8fee6a1847b0: Pulling fs layer
  [-] caprover: 60cce3519052: Pulling fs layer
  [-] caprover: 4bae1011637c: Pulling fs layer
  [-] caprover: ecf48b6c1f43: Pulling fs layer
  [-] caprover: 856f69196742: Pulling fs layer
  [-] caprover: e86a512b6f8c: Pulling fs layer
  [-] caprover: cecbd06d956f: Pulling fs layer
  [-] caprover: cdd679ff24b0: Pulling fs layer
  [-] caprover: d60abbe06609: Pulling fs layer
  [-] caprover: 0ac0240c1a59: Pulling fs layer
  [-] caprover: 52d300ad83da: Pulling fs layer
  [-] caprover: 8fee6a1847b0: Waiting
  [-] caprover: e86a512b6f8c: Waiting
  [-] caprover: 60cce3519052: Waiting
  [-] caprover: cecbd06d956f: Waiting
  [-] caprover: cdd679ff24b0: Waiting
  [-] caprover: 4bae1011637c: Waiting
  [-] caprover: d60abbe06609: Waiting
  [-] caprover: 0ac0240c1a59: Waiting
  [-] caprover: 52d300ad83da: Waiting
  [-] caprover: 856f69196742: Waiting
  [-] caprover: ecf48b6c1f43: Waiting
  [-] caprover: 523d612e9cd2: Verifying Checksum
  [-] caprover: 523d612e9cd2: Download complete
  [-] caprover: 4ea40d27a2cf: Verifying Checksum
  [-] caprover: 4ea40d27a2cf: Download complete
  [-] caprover: af4c2580c6c3: Verifying Checksum
  [-] caprover: af4c2580c6c3: Download complete
  [-] caprover: 4bae1011637c: Verifying Checksum
  [-] caprover: 4bae1011637c: Download complete
  [-] caprover: 8fee6a1847b0: Verifying Checksum
  [-] caprover: 8fee6a1847b0: Download complete
  [-] caprover: 856f69196742: Verifying Checksum
  [-] caprover: 856f69196742: Download complete
  [-] caprover: ecf48b6c1f43: Verifying Checksum
  [-] caprover: ecf48b6c1f43: Download complete
  [-] caprover: e86a512b6f8c: Verifying Checksum
  [-] caprover: e86a512b6f8c: Download complete
  [-] caprover: cdd679ff24b0: Verifying Checksum
  [-] caprover: cdd679ff24b0: Download complete
  [-] caprover: d60abbe06609: Verifying Checksum
  [-] caprover: d60abbe06609: Download complete
  [-] caprover: cecbd06d956f: Download complete
  [-] caprover: 0ac0240c1a59: Verifying Checksum
  [-] caprover: 0ac0240c1a59: Download complete
  [-] caprover: 60cce3519052: Verifying Checksum
  [-] caprover: 60cce3519052: Download complete
  [-] caprover: af4c2580c6c3: Pull complete
  [-] caprover: 52d300ad83da: Download complete
  [-] caprover: 4ea40d27a2cf: Pull complete
  [-] caprover: 523d612e9cd2: Pull complete
  [-] caprover: 8fee6a1847b0: Pull complete
  [-] caprover: 60cce3519052: Pull complete
  [-] caprover: 4bae1011637c: Pull complete
  [-] caprover: ecf48b6c1f43: Pull complete
  [-] caprover: 856f69196742: Pull complete
  [-] caprover: e86a512b6f8c: Pull complete
  [-] caprover: cecbd06d956f: Pull complete
  [-] caprover: cdd679ff24b0: Pull complete
  [-] caprover: d60abbe06609: Pull complete
  [-] caprover: 0ac0240c1a59: Pull complete
  [-] caprover: 52d300ad83da: Pull complete
  [-] caprover: Digest:   sha256:39c3f188a8f425775cfbcdc4125706cdf614cd38415244ccf967cd1a4e692b4f
  [-] caprover: Status: Downloaded newer image for caprover/caprover:latest
  [+] caprover: Captain Starting ...
  [+] caprover: Overriding skipVerifyingDomains from /captain/data/   config-override.json
  [+] caprover: Installing Captain Service ...
  [+] caprover:
  [+] caprover:  Installation of CapRover is starting...
  [+] caprover: For troubleshooting, please see: https://caprover.com/docs/   troubleshooting.html
  [+] caprover:
  [+] caprover:
  [+] caprover:
  [+] caprover:
  [+] caprover:
  [+] caprover:  >>> Checking System Compatibility <<<
  [+] caprover:    Docker Version passed.
  [+] caprover:    Ubuntu detected.
  [+] caprover:    X86 CPU detected.
  [+] caprover:    Total RAM 8339 MB
  [+] caprover: Pulling: nginx:1
  [+] caprover: Pulling: caprover/caprover-placeholder-app:latest
  [+] caprover: Pulling: caprover/certbot-sleeping:v1.6.0
  [+] caprover: October 12th 2021, 12:49:26.301 pm    Fresh installation!
  [+] caprover: October 12th 2021, 12:49:26.309 pm    Starting swarm at   185.206.122.32:2377
  [+] caprover: Swarm started: z06ymksbcoren9cl7g2xzw9so
  [+] caprover: *** CapRover is initializing ***
  [+] caprover: Please wait at least 60 seconds before trying to access   CapRover.
  [+] caprover: ===================================
  [+] caprover:  **** Installation is done! *****
  [+] caprover: CapRover is available at http://captain.newapps.grid.tf
  [+] caprover: Default password is: captain42
  [+] caprover: ===================================

  wait until you see ** Installation is done! *** in the caprover service log

step 2: Connect Root Domain

After the container runs, you will now need to connect your Caprover instance to a Root Domain.

Let’s say you own example.com. You can set *.something.example.com as an A-record in your DNS settings to point to the IP address of the server where you installed CapRover. To do this, go to the DNS settings in your domain provider website, and set a wild card A record entry.

For example: Type: A, Name (or host): *.something.example.com, IP (or Points to): 110.122.131.141 where this is the IP address of your CapRover machine.

TYPE: A record
HOST: \*.something.example.com
POINTS TO: (IP Address of your server)
TTL: (doesn’t really matter)

To confirm, go to https://mxtoolbox.com/DNSLookup.aspx and enter somethingrandom.something.example.com and check if IP address resolves to the IP you set in your DNS.

Note

somethingrandom is needed because you set a wildcard entry in your DNS by setting *.something.example.com as your host, not something.example.com.

Step 3: CapRover Root Domain Configurations

skip this step if you provided your root domain in the TerraFrom configuration file

Once the CapRover is initialized, you can visit http://[IP_OF_YOUR_SERVER]:3000 in your browser and login to CapRover using the password from tf output noted in previous step. also you can change your password later.

In the UI enter you root domain and press Update Domain button.

Step 4: Access the Captain Dashboard

Once you set your root domain as caprover.example.com, you will be redirected to captain.caprover.example.com.

Now CapRover is ready and running in a single node.

To allow cluster mode

• Enable HTTPS

  • Go to CapRover Dashboard tab, then in CapRover Root Domain Configurations press on Enable HTTPS then you will asked to enter your email address

• Docker Registry Configuration

  • Go to CapRover Cluster tab, then in Docker Registry Configuration section, press on Self hosted Docker Registry or add your Remote Docker Registry

• Run the following command in the ssh session:

    docker swarm join-token worker

  It will output something like this:

  docker swarm join --token   SWMTKN-1-0892ds1ney7pa0hymi3qwph7why1d9r3z6bvwtin51r14hcz3t-cjsephnu4f2ez fpdd6svnnbq7 185.206.122.33:2377

• To add a worker node to this swarm, you need:

  • Generated token SWMTKN-1-0892ds1ney7pa0hymi3qwph7why1d9r3z6bvwtin51r14hcz3t-cjsephnu4f2ezfpdd6svnnbq7
  • Leader node public ip 185.206.122.33

This information is required in the next section to run Caprover in cluster mode.

B) Worker node deployment/setup:

step 1: Deploy a worker Node

• modify the terraform file ./freeflow_caprover/terraform/worker/main.tf

  cd freeflow_caprover/terraform/worker/
  vim main.tf

  • In provider Block, update the twin_id and add your mnemonics.
  • In resource Block, update the disks size, memory size, and cores number to fit your needs or leave as it is for testing.
  • In the PUBLIC_KEY env var value put your ssh public key.
  • In the SWMTKN env var value put the previously generated token.
  • In the LEADER_PUBLIC_IP env var value put the leader node public ip.

• save the file, and execute the following commands:

  terraform init
  terraform apply -parallelism=1

• wait till you see apply complete, and note the VM public ip in the final output.

• verify the status of the VM

  ssh root@{public_ip_address}
  zinit list
  zinit log caprover

  you will see output like this:

  root@caprover:~# zinit list
  caprover: Success
  dockerd: Running
  containerd: Running
  sshd: Running
  sshd-init: Success
  root@caprover:~# zinit log caprover
  [-] caprover: Cannot connect to the Docker daemon at unix:///var/run/   docker.sock. Is the docker daemon running?
  [+] caprover: This node joined a swarm as a worker.

This means that your worker node is now ready and have joined the cluster successfully.

You can also verify this from capRover dashboard in Cluster tab, check Nodes section, you should be able to see the new worker node added there.

Now CapRover is ready in cluster mode(more than one server).

To run One-Click Apps please follow this tutorial

Implementations details:

• we use Ubuntu 18.04 to minimize the production issues as CapRover is tested on Ubuntu 18.04 and Docker 19.03.

• In standard installation, CapRover has to be installed on a machine with a public IP address.

• Services are managed by Zinit service manager to bring these processes up and running in case of any failure:

  • sshd-init : service used to add user public key in vm ssh authorized keys (it run once).
  • containerd: service to maintain container runtime needed by docker.
  • caprover: service to run caprover container(it run once).
  • dockerd: service to run docker daemon.
  • sshd: service to maintain ssh server daemon.

• we adjusting the OOM priority on the Docker daemon so that it is less likely to be killed than other processes on the system

  echo -500 >/proc/self/oom_score_adj