Complete ES tests

[reynoldsalec]

We want to have examples (ie tests) for all of the P.sh services.

The basic process for creating these is fairly simple...

1) Copy an existing example directory (ex: examples/mariadb-10.2) 2) Reconfigure the config files to run the correct service and version. platform.app.yaml', '.platform/services.yaml' are probably the primary ones, although you'll want to signify the correct service version in all files. 3) Create Leia-legible tests in the README.md based on example commands found in the P.sh docs. 4) Experiment running those tests, both individually and finally as a suite (after generating testsyarn run generate:testsand runningyarn run test:functional`

Services we're targeting (in rough order of priority):

MariaDB

• [x] 10.5 [SERVICE BROKEN]
• [x] 10.4
• [x] 10.3
• [x] 10.2
• [x] 10.1
• [x] 10.0

MySQL

• [x] 10.4
• [x] 10.3
• [x] 10.2
• [x] 10.1
• [x] 10.0

Oracle MySQL [SHOULD CREATE ISSUE TO ADD SUPPORT FOR THIS]

Legacy Mariadb

• [x] 5.5 [THIS IMAGE 403s docker pull docker.registry.platform.sh/mariadb-5.5]

Legacy MySQL

• [x] 5.5 [THIS IMAGE IMMEDIATELY SEGFAULTS WHEN STARTING UP`]

PostgresSQL -> In progress (awaiting feedback)

• [x] 13
• [x] 12
• [x] 11
• [x] 10
• [x] 9.6
• [x] 9.3

Redis

• [x] 6.0
• [x] 5.0
• [x] 4.0
• [x] 3.2
• [x] 3.0
• [x] 2.8

Memcached

• [x] 1.6
• [x] 1.5
• [x] 1.4 [SERVICE BROKEN]

Solr

• [x] 8.6
• [x] 8.4
• [x] 8.0
• [x] 7.7
• [x] 6.6
• [x] 6.3
• [x] 4.10
• [x] 3.6

Elasticsearch -> In progress

• [x] 6.5
• [x] 6.8
• [ ] 7.2
• [ ] 7.5
• [ ] 7.7
• [ ] 7.9
• [ ] 7.10

Varnish

• [x] 6.3
• [x] 6.0
• [x] 5.2
• [x] 5.1 [THIS IMAGE TAG ACTUALLY PULLS VARNISH 5.2]

MongoDB

• [x] 3.6
• [x] 3.4
• [x] 3.2
• [x] 3.0

RabbitMQ

• [ ] 3.8
• [ ] 3.7
• [ ] 3.6
• [ ] 3.5

Headless Chrome

• [x] 73

InfluxDB

• [ ] 1.8
• [ ] 1.7
• [ ] 1.3
• [ ] 1.2

Kafka

• [ ] 2.5
• [ ] 2.4
• [ ] 2.3
• [ ] 2.2
• [ ] 2.1

Other important things

Integrations (eg init a site from Platform and doing a lando pull)

• [x] Drupal 8 (init and pulling from site on platform.sh)
• [x] Basics (exists mostly just to test platform config file loading and lando overrides)

Nice to have

• [x] "Advanced Config" for Databases eg spinning up a second DB for each version

[reynoldsalec]

One issue I'm noticing; any test that involves running a command on the app container fails because of this output that occurs upon sshing into the container:

/bin/sh: 1: /helpers/psh-exec.sh,/bin/sh,-c,if: not found

[pirog]

@reynoldsalec update here: the command is now yarn test:leia.

Also, if we are all going to work on this want to make a checklist of all the services in the issue so we don't overlap?

[reynoldsalec]

Copying over the maria tests, it does look like the issues I've been seeing locally aren't impacting GitHub Actions (good).

However, the tests for mariadb-10.5 are failing (bad). It looks like something in P.sh's startup scripts may be failing to setup the database correctly; in the Lando logs I see many errors along these lines...

mariadb_1  | runsv mysql-cluster: fatal: unable to lock supervise/lock: temporary failure
mariadb_1  | runsv idmapd: fatal: unable to lock supervise/lock: temporary failure
mariadb_1  | runsv mysql-standalone: fatal: unable to lock supervise/lock: temporary failure
mariadb_1  | runsv mysql-failure: fatal: unable to lock supervise/lock: temporary failure
mariadb_1  | runsv mysql-cluster: fatal: unable to lock supervise/lock: temporary failure

I tried debugging by ssh-ing into the mariadb container; I was unable to connect to the database via the mysql command (mysql -u user -P 3306 -h mariadb main) so I tried running the P.sh start script (/etc/platform/start) again as root, which looks like it produces a Connection refused error:

Traceback (most recent call last):
  File "./start", line 6, in <module>
    service.start()
  File "/usr/lib/python2.7/dist-packages/platformsh/agent/service.py", line 230, in start
    self.boot_wait_for_services()
  File "/etc/platform/config.py", line 715, in boot_wait_for_services
    super(StateAwareService, self).boot_wait_for_services()
  File "/etc/platform/config.py", line 168, in boot_wait_for_services
    self._tcp_connect()
  File "/usr/lib/python2.7/dist-packages/platformsh/agent/util.py", line 109, in retried_function
    return function(*args, **kwargs)
  File "/etc/platform/config.py", line 485, in _tcp_connect
    socket.socket().connect(("127.0.0.1", 3306))
  File "/usr/lib/python2.7/dist-packages/gevent/_socket2.py", line 272, in connect
    raise error(err, strerror(err))
socket.error: [Errno 111] Connection refused

[pirog]

@reynoldsalec added some more checkboxes. The other thing we will want to do explicitly is test out php but we can do that in a separate PR for "languages" instead of "services"