Make this project work with Turing Pi RK1 boards

[geerlingguy]

See: #7

I would also like to make sure any other little incompatibilities are fixed up.

I could also rename the repo to sbc-cluster, maybe... but for now I like 'Pi Cluster' since the majority of my work is with Pi still.

[geerlingguy]

The above issue was already fixed in #8 — so this will just document any other issues I encounter!

[geerlingguy]

When fixing #11 I noticed Pi OS Bookworm's use of NetworkManager required some tweaks to the static networking playbook. I made those, and also fixed up some TODOs in there to support more than four nodes in a cluster :)

[geerlingguy]

The static networking playbook fails with:

TASK [Configure static IP address (Network Manager).] ***************************************************
fatal: [turing4.local]: FAILED! => {"changed": false, "msg": "Failed to find required executable \"nmcli\" in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin"}
fatal: [turing3.local]: FAILED! => {"changed": false, "msg": "Failed to find required executable \"nmcli\" in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin"}
fatal: [turing2.local]: FAILED! => {"changed": false, "msg": "Failed to find required executable \"nmcli\" in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin"}
fatal: [turing1.local]: FAILED! => {"changed": false, "msg": "Failed to find required executable \"nmcli\" in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin"}

It looks like by default the server OS uses netplan, which I had never noticed before: https://askubuntu.com/q/1122757/88829

To switch to NetworkManager, modify the .yaml file inside /etc/netplan to read:

network:
  version: 2
  renderer: NetworkManager

Then run:

sudo netplan generate && sudo netplan apply && reboot

I'm adding a separate playbook that can be run to do this for you on all the nodes running Ubuntu.

[geerlingguy]

Works!

[geerlingguy]

Version 1.2.0 of this project should work fine with both Pi OS and Ubuntu, on Pis and other SBCs like the RK1.

[geerlingguy]

One more test—authenticated and anonymous requests to the Drupal site running on a Turing Pi 2 with 4x RK1 versus DeskPi Super6C running 6x Raspberry Pi CM4s (only one Drupal pod / instance, no scaling, so just measuring basic cluster performance).

DeskPi Super6C + 6x CM4:

Click to expand

``` Drupal benchmarks. Running wrk anonymous page load benchmark... Running 30s test @ http://10.0.2.61/ 4 threads and 100 connections Thread Stats Avg Stdev Max +/- Stdev Latency 1.43s 1.66s 9.85s 87.16% Req/Sec 21.41 13.79 100.00 78.42% 2364 requests in 30.06s, 83.26MB read Socket errors: connect 0, read 0, write 0, timeout 37 Requests/sec: 78.65 Transfer/sec: 2.77MB Running ab authenticated page load benchmark... This is ApacheBench, Version 2.3 <$Revision: 1903618 $> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Licensed to The Apache Software Foundation, http://www.apache.org/ Benchmarking 10.0.2.61 (be patient) Completed 100 requests Completed 200 requests Completed 300 requests Completed 400 requests Completed 500 requests Completed 600 requests Completed 700 requests Finished 700 requests Server Software: Apache/2.4.57 Server Hostname: 10.0.2.61 Server Port: 80 Document Path: / Document Length: 36382 bytes Concurrency Level: 10 Time taken for tests: 9.666 seconds Complete requests: 700 Failed requests: 0 Total transferred: 25783800 bytes HTML transferred: 25467400 bytes Requests per second: 72.42 [#/sec] (mean) Time per request: 138.084 [ms] (mean) Time per request: 13.808 [ms] (mean, across all concurrent requests) Transfer rate: 2604.98 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 0 1 0.3 1 5 Processing: 26 121 429.8 72 5137 Waiting: 25 119 429.7 70 5133 Total: 27 122 429.8 73 5138 Percentage of the requests served within a certain time (ms) 50% 73 66% 92 75% 103 80% 107 90% 133 95% 161 98% 316 99% 1064 100% 5138 (longest request) Drupal benchmark complete! ```

Turing Pi 2 + 4x RK1:

Click to expand

``` Drupal benchmarks. Running wrk anonymous page load benchmark... Running 30s test @ http://10.0.2.41/ 4 threads and 100 connections Thread Stats Avg Stdev Max +/- Stdev Latency 1.04s 799.56ms 6.19s 94.34% Req/Sec 31.37 24.10 120.00 71.59% 3135 requests in 30.06s, 110.47MB read Requests/sec: 104.30 Transfer/sec: 3.68MB Running ab authenticated page load benchmark... This is ApacheBench, Version 2.3 <$Revision: 1903618 $> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Licensed to The Apache Software Foundation, http://www.apache.org/ Benchmarking 10.0.2.41 (be patient) Completed 100 requests Completed 200 requests Completed 300 requests Completed 400 requests Completed 500 requests Completed 600 requests Completed 700 requests Finished 700 requests Server Software: Apache/2.4.57 Server Hostname: 10.0.2.41 Server Port: 80 Document Path: / Document Length: 36404 bytes Concurrency Level: 10 Time taken for tests: 4.228 seconds Complete requests: 700 Failed requests: 0 Total transferred: 25798500 bytes HTML transferred: 25482800 bytes Requests per second: 165.55 [#/sec] (mean) Time per request: 60.404 [ms] (mean) Time per request: 6.040 [ms] (mean, across all concurrent requests) Transfer rate: 5958.37 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 0 1 0.3 1 5 Processing: 29 59 19.1 54 159 Waiting: 27 57 18.8 53 158 Total: 29 59 19.1 55 160 Percentage of the requests served within a certain time (ms) 50% 55 66% 63 75% 69 80% 73 90% 86 95% 99 98% 108 99% 122 100% 160 (longest request) Drupal benchmark complete! ```

Summarized:

Benchmark	DeskPi Super 6C + CM4	Turing Pi 2 + RK1
wrk (anonymous)	78.65	104.30
ab (authenticated)	72.42	165.55