search

stationgroup / ansible-experiments

⚠️ [Moved to r21.io] Ansible experimentation
https://gitlab.com/stationgroup/ansible-experiments
MIT License
2 stars 2 forks source link

Update packages on ubuntu and freebsd #3

Closed srgvg closed 6 years ago

srgvg commented 6 years ago

Fixes #1

The Vagrant file being used is a copy from https://github.com/stationgroup/vagrant-labs/tree/master/imperialspeculate.

Two roles are being used: debian-upgrade (an upstream Galaxy role) and freebsd-upgrade (a small role based on what was proposed in the comments of #1 and extended with proper support for check mode.)

The upgrade process is contained in the playbook os_upgrade.yml, which will automatically create proper groups for Ubuntu and FreeBSD hosts. If unneeded, this first play can be left out, and the target hosts: in the second play can be replaced by the relevant groups you have in the inventory (e.g. ec2 tags.)

A local ansible.cfg is defined, and needed for these scripts to run out of the box. This implies that all ansible commands must be run from the ansible-experiments/package_updates folder.

A small script setup-requirements is provided, that initializes everything, to be executed after the vagrant boxes came online. It will generate an ssh-config for said vagrant boxes, download roles from galaxy, and make a base-install for the hosts (installing python dependencies, ansible itself on ubuntu1, a deploying an ssh key to all nodes to be used from the vagrant box ubuntu1, as ansible controller machine.)

When deploying and setting up from the machine where vagrant runs, you need to add some extra arguments: --ssh-extra-args "-F ./vagrant-ssh-config" --inventory hosts-vagrant to ansible execution. These are not necessary once running ansible from ubuntu1.

The vagrant setup seems to have a provisioning bug, that kicks in with the latest 18.04 Ubuntu. The FreeBSD boxes also experience a provisioning problem, with the same result: the second, private network interface does not get configured. As these interfaces are used to run ansible from ubuntu1, I could not fully test the scripts from there.

reelsense commented 6 years ago

Log of what I ran and where I hit issues

After I clone the branch in your ginsys fork for testing I ran started up all the VMs with vagrant up .

I start to initialize them with: ./setup-requirements

+ set -e
+ vagrant ssh-config
+ ansible-galaxy install -r roles/requirements.yml
- debian-update (v1.4.15) is already installed, skipping.
+ ansible-playbook --ssh-extra-args '-F ./vagrant-ssh-config' --inventory hosts-vagrant base-setup.yml

PLAY [install ansible requirements - ubuntu xenial] ************************************************

TASK [install python2 (vagrant images seem to come with python3 only)] *****************************
changed: [ubuntu1]
changed: [ubuntu2]

PLAY [install ansible requirements - ubuntu bionic] ************************************************

TASK [install python3-apt] *************************************************************************
changed: [ubuntu4]
changed: [ubuntu3]

PLAY [install ansible requirements - freebsd] ******************************************************

TASK [raw] *****************************************************************************************
changed: [freebsd6]
changed: [freebsd5]

PLAY [install ubuntu1 node as ansible control machine] *********************************************

TASK [Gathering Facts] *****************************************************************************
ok: [ubuntu1]

TASK [apt] *****************************************************************************************
fatal: [ubuntu1]: FAILED! => {"changed": false, "msg": "No package matching 'python3-pip' is available"}

PLAY RECAP *****************************************************************************************
freebsd5                   : ok=1    changed=1    unreachable=0    failed=0   
freebsd6                   : ok=1    changed=1    unreachable=0    failed=0   
ubuntu1                    : ok=2    changed=1    unreachable=0    failed=1   
ubuntu2                    : ok=1    changed=1    unreachable=0    failed=0   
ubuntu3                    : ok=1    changed=1    unreachable=0    failed=0   
ubuntu4                    : ok=1    changed=1    unreachable=0    failed=0

I saw that error and thought maybe I have to vagrant ssh ubuntu1 and run sudo apt update, because the repos were out of date.

Now I get this error with I re-run ./setup-requirements:

+ set -e
+ vagrant ssh-config
+ ansible-galaxy install -r roles/requirements.yml
- debian-update (v1.4.15) is already installed, skipping.
+ ansible-playbook --ssh-extra-args '-F ./vagrant-ssh-config' --inventory hosts-vagrant base-setup.yml

PLAY [install ansible requirements - ubuntu xenial] ************************************************

TASK [install python2 (vagrant images seem to come with python3 only)] *****************************
changed: [ubuntu2]
changed: [ubuntu1]

PLAY [install ansible requirements - ubuntu bionic] ************************************************

TASK [install python3-apt] *************************************************************************
changed: [ubuntu3]
changed: [ubuntu4]

PLAY [install ansible requirements - freebsd] ******************************************************

TASK [raw] *****************************************************************************************
changed: [freebsd6]
changed: [freebsd5]

PLAY [install ubuntu1 node as ansible control machine] *********************************************

TASK [Gathering Facts] *****************************************************************************
ok: [ubuntu1]

TASK [apt] *****************************************************************************************
changed: [ubuntu1]

TASK [pip] *****************************************************************************************
fatal: [ubuntu1]: FAILED! => {"changed": false, "cmd": "/usr/bin/pip3 install --upgrade pip setuptools cryptography paramiko", "msg": "stdout: Collecting pip\n  Downloading https://files.pythonhosted.org/packages/0f/74/ecd13431bcc456ed390b44c8a6e917c1820365cbebcb6a8974d1cd045ab4/pip-10.0.1-py2.py3-none-any.whl (1.3MB)\nCollecting setuptools\n  Downloading https://files.pythonhosted.org/packages/8c/10/79282747f9169f21c053c562a0baa21815a8c7879be97abd930dbcf862e8/setuptools-39.1.0-py2.py3-none-any.whl (566kB)\nCollecting cryptography\n  Downloading https://files.pythonhosted.org/packages/ec/b2/faa78c1ab928d2b2c634c8b41ff1181f0abdd9adf9193211bd606ffa57e2/cryptography-2.2.2.tar.gz (443kB)\nCollecting paramiko\n  Downloading https://files.pythonhosted.org/packages/3e/db/cb7b6656e0e7387637ce850689084dc0b94b44df31cc52e5fc5c2c4fd2c1/paramiko-2.4.1-py2.py3-none-any.whl (194kB)\nCollecting idna>=2.1 (from cryptography)\n  Downloading https://files.pythonhosted.org/packages/27/cc/6dd9a3869f15c2edfab863b992838277279ce92663d334df9ecf5106f5c6/idna-2.6-py2.py3-none-any.whl (56kB)\nCollecting asn1crypto>=0.21.0 (from cryptography)\n  Downloading https://files.pythonhosted.org/packages/ea/cd/35485615f45f30a510576f1a56d1e0a7ad7bd8ab5ed7cdc600ef7cd06222/asn1crypto-0.24.0-py2.py3-none-any.whl (101kB)\nCollecting six>=1.4.1 (from cryptography)\n  Downloading https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl\nCollecting cffi>=1.7 (from cryptography)\n  Downloading https://files.pythonhosted.org/packages/59/cc/0e1635b4951021ef35f5c92b32c865ae605fac2a19d724fb6ff99d745c81/cffi-1.11.5-cp35-cp35m-manylinux1_x86_64.whl (420kB)\nCollecting bcrypt>=3.1.3 (from paramiko)\n  Downloading https://files.pythonhosted.org/packages/72/8d/57da727cbb4ddf0295b0665a93bd8f46fbbd2a48b76cbb0896ca7d27301f/bcrypt-3.1.4-cp35-cp35m-manylinux1_x86_64.whl (54kB)\nCollecting pyasn1>=0.1.7 (from paramiko)\n  Downloading https://files.pythonhosted.org/packages/ba/fe/02e3e2ee243966b143657fb8bd6bc97595841163b6d8c26820944acaec4d/pyasn1-0.4.2-py2.py3-none-any.whl (71kB)\nCollecting pynacl>=1.0.1 (from paramiko)\n  Downloading https://files.pythonhosted.org/packages/c9/9c/c8d4ae0f590faded4af55381131ad4db8729214eba6537c520622ba3548a/PyNaCl-1.2.1-cp35-cp35m-manylinux1_x86_64.whl (692kB)\nCollecting pycparser (from cffi>=1.7->cryptography)\n  Downloading https://files.pythonhosted.org/packages/8c/2d/aad7f16146f4197a11f8e91fb81df177adcc2073d36a17b1491fd09df6ed/pycparser-2.18.tar.gz (245kB)\nBuilding wheels for collected packages: cryptography, pycparser\n  Running setup.py bdist_wheel for cryptography: started\n  Running setup.py bdist_wheel for cryptography: finished with status 'error'\n  Complete output from command /usr/bin/python3 -u -c \"import setuptools, tokenize;__file__='/tmp/pip-build-ju7ulsyk/cryptography/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\\r\\n', '\\n'), __file__, 'exec'))\" bdist_wheel -d /tmp/tmpoe114s82pip-wheel- --python-tag cp35:\n  c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory\n  compilation terminated.\n  Traceback (most recent call last):\n    File \"/usr/lib/python3.5/distutils/unixccompiler.py\", line 118, in _compile\n      extra_postargs)\n    File \"/usr/lib/python3.5/distutils/ccompiler.py\", line 909, in spawn\n      spawn(cmd, dry_run=self.dry_run)\n    File \"/usr/lib/python3.5/distutils/spawn.py\", line 36, in spawn\n      _spawn_posix(cmd, search_path, dry_run=dry_run)\n    File \"/usr/lib/python3.5/distutils/spawn.py\", line 159, in _spawn_posix\n      % (cmd, exit_status))\n  distutils.errors.DistutilsExecError: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"/usr/lib/python3.5/distutils/core.py\", line 148, in setup\n      dist.run_commands()\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 955, in run_commands\n      self.run_command(cmd)\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 974, in run_command\n      cmd_obj.run()\n    File \"/usr/lib/python3/dist-packages/setuptools/command/bdist_egg.py\", line 161, in run\n      cmd = self.call_command('install_lib', warn_dir=0)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/bdist_egg.py\", line 147, in call_command\n      self.run_command(cmdname)\n    File \"/usr/lib/python3.5/distutils/cmd.py\", line 313, in run_command\n      self.distribution.run_command(command)\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 974, in run_command\n      cmd_obj.run()\n    File \"/usr/lib/python3/dist-packages/setuptools/command/install_lib.py\", line 23, in run\n      self.build()\n    File \"/usr/lib/python3.5/distutils/command/install_lib.py\", line 109, in build\n      self.run_command('build_ext')\n    File \"/usr/lib/python3.5/distutils/cmd.py\", line 313, in run_command\n      self.distribution.run_command(command)\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 974, in run_command\n      cmd_obj.run()\n    File \"/usr/lib/python3/dist-packages/setuptools/command/build_ext.py\", line 49, in run\n      _build_ext.run(self)\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 338, in run\n      self.build_extensions()\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 447, in build_extensions\n      self._build_extensions_serial()\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 472, in _build_extensions_serial\n      self.build_extension(ext)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/build_ext.py\", line 174, in build_extension\n      _build_ext.build_extension(self, ext)\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 532, in build_extension\n      depends=ext.depends)\n    File \"/usr/lib/python3.5/distutils/ccompiler.py\", line 574, in compile\n      self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)\n    File \"/usr/lib/python3.5/distutils/unixccompiler.py\", line 120, in _compile\n      raise CompileError(msg)\n  distutils.errors.CompileError: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 154, in save_modules\n      yield saved\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 195, in setup_context\n      yield\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 243, in run_setup\n      DirectorySandbox(setup_dir).run(runner)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 273, in run\n      return func()\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 242, in runner\n      _execfile(setup_script, ns)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 46, in _execfile\n      exec(code, globals, locals)\n    File \"/tmp/easy_install-zxcnabpo/cffi-1.11.5/setup.py\", line 240, in <module>\n      def run_tests(self):\n    File \"/usr/lib/python3.5/distutils/core.py\", line 163, in setup\n      raise SystemExit(\"error: \" + str(msg))\n  SystemExit: error: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 1087, in run_setup\n      run_setup(setup_script, args)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 246, in run_setup\n      raise\n    File \"/usr/lib/python3.5/contextlib.py\", line 77, in __exit__\n      self.gen.throw(type, value, traceback)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 195, in setup_context\n      yield\n    File \"/usr/lib/python3.5/contextlib.py\", line 77, in __exit__\n      self.gen.throw(type, value, traceback)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 166, in save_modules\n      saved_exc.resume()\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 141, in resume\n      six.reraise(type, exc, self._tb)\n    File \"/usr/lib/python3/dist-packages/pkg_resources/_vendor/six.py\", line 685, in reraise\n      raise value.with_traceback(tb)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 154, in save_modules\n      yield saved\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 195, in setup_context\n      yield\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 243, in run_setup\n      DirectorySandbox(setup_dir).run(runner)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 273, in run\n      return func()\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 242, in runner\n      _execfile(setup_script, ns)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 46, in _execfile\n      exec(code, globals, locals)\n    File \"/tmp/easy_install-zxcnabpo/cffi-1.11.5/setup.py\", line 240, in <module>\n      def run_tests(self):\n    File \"/usr/lib/python3.5/distutils/core.py\", line 163, in setup\n      raise SystemExit(\"error: \" + str(msg))\n  SystemExit: error: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"<string>\", line 1, in <module>\n    File \"/tmp/pip-build-ju7ulsyk/cryptography/setup.py\", line 319, in <module>\n      **keywords_with_side_effects(sys.argv)\n    File \"/usr/lib/python3.5/distutils/core.py\", line 108, in setup\n      _setup_distribution = dist = klass(attrs)\n    File \"/usr/lib/python3/dist-packages/setuptools/dist.py\", line 269, in __init__\n      self.fetch_build_eggs(attrs['setup_requires'])\n    File \"/usr/lib/python3/dist-packages/setuptools/dist.py\", line 313, in fetch_build_eggs\n      replace_conflicting=True,\n    File \"/usr/lib/python3/dist-packages/pkg_resources/__init__.py\", line 826, in resolve\n      dist = best[req.key] = env.best_match(req, ws, installer)\n    File \"/usr/lib/python3/dist-packages/pkg_resources/__init__.py\", line 1092, in best_match\n      return self.obtain(req, installer)\n    File \"/usr/lib/python3/dist-packages/pkg_resources/__init__.py\", line 1104, in obtain\n      return installer(requirement)\n    File \"/usr/lib/python3/dist-packages/setuptools/dist.py\", line 380, in fetch_build_egg\n      return cmd.easy_install(req)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 663, in easy_install\n      return self.install_item(spec, dist.location, tmpdir, deps)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 693, in install_item\n      dists = self.install_eggs(spec, download, tmpdir)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 873, in install_eggs\n      return self.build_and_install(setup_script, setup_base)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 1101, in build_and_install\n      self.run_setup(setup_script, setup_base, args)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 1089, in run_setup\n      raise DistutilsError(\"Setup script exited with %s\" % (v.args[0],))\n  distutils.errors.DistutilsError: Setup script exited with error: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  ----------------------------------------\n  Running setup.py clean for cryptography\n  Complete output from command /usr/bin/python3 -u -c \"import setuptools, tokenize;__file__='/tmp/pip-build-ju7ulsyk/cryptography/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\\r\\n', '\\n'), __file__, 'exec'))\" clean --all:\n  c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory\n  compilation terminated.\n  Traceback (most recent call last):\n    File \"/usr/lib/python3.5/distutils/unixccompiler.py\", line 118, in _compile\n      extra_postargs)\n    File \"/usr/lib/python3.5/distutils/ccompiler.py\", line 909, in spawn\n      spawn(cmd, dry_run=self.dry_run)\n    File \"/usr/lib/python3.5/distutils/spawn.py\", line 36, in spawn\n      _spawn_posix(cmd, search_path, dry_run=dry_run)\n    File \"/usr/lib/python3.5/distutils/spawn.py\", line 159, in _spawn_posix\n      % (cmd, exit_status))\n  distutils.errors.DistutilsExecError: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"/usr/lib/python3.5/distutils/core.py\", line 148, in setup\n      dist.run_commands()\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 955, in run_commands\n      self.run_command(cmd)\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 974, in run_command\n      cmd_obj.run()\n    File \"/usr/lib/python3/dist-packages/setuptools/command/bdist_egg.py\", line 161, in run\n      cmd = self.call_command('install_lib', warn_dir=0)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/bdist_egg.py\", line 147, in call_command\n      self.run_command(cmdname)\n    File \"/usr/lib/python3.5/distutils/cmd.py\", line 313, in run_command\n      self.distribution.run_command(command)\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 974, in run_command\n      cmd_obj.run()\n    File \"/usr/lib/python3/dist-packages/setuptools/command/install_lib.py\", line 23, in run\n      self.build()\n    File \"/usr/lib/python3.5/distutils/command/install_lib.py\", line 109, in build\n      self.run_command('build_ext')\n    File \"/usr/lib/python3.5/distutils/cmd.py\", line 313, in run_command\n      self.distribution.run_command(command)\n    File \"/usr/lib/python3.5/distutils/dist.py\", line 974, in run_command\n      cmd_obj.run()\n    File \"/usr/lib/python3/dist-packages/setuptools/command/build_ext.py\", line 49, in run\n      _build_ext.run(self)\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 338, in run\n      self.build_extensions()\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 447, in build_extensions\n      self._build_extensions_serial()\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 472, in _build_extensions_serial\n      self.build_extension(ext)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/build_ext.py\", line 174, in build_extension\n      _build_ext.build_extension(self, ext)\n    File \"/usr/lib/python3.5/distutils/command/build_ext.py\", line 532, in build_extension\n      depends=ext.depends)\n    File \"/usr/lib/python3.5/distutils/ccompiler.py\", line 574, in compile\n      self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts)\n    File \"/usr/lib/python3.5/distutils/unixccompiler.py\", line 120, in _compile\n      raise CompileError(msg)\n  distutils.errors.CompileError: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 154, in save_modules\n      yield saved\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 195, in setup_context\n      yield\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 243, in run_setup\n      DirectorySandbox(setup_dir).run(runner)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 273, in run\n      return func()\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 242, in runner\n      _execfile(setup_script, ns)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 46, in _execfile\n      exec(code, globals, locals)\n    File \"/tmp/easy_install-ks7u0nkf/cffi-1.11.5/setup.py\", line 240, in <module>\n      def run_tests(self):\n    File \"/usr/lib/python3.5/distutils/core.py\", line 163, in setup\n      raise SystemExit(\"error: \" + str(msg))\n  SystemExit: error: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 1087, in run_setup\n      run_setup(setup_script, args)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 246, in run_setup\n      raise\n    File \"/usr/lib/python3.5/contextlib.py\", line 77, in __exit__\n      self.gen.throw(type, value, traceback)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 195, in setup_context\n      yield\n    File \"/usr/lib/python3.5/contextlib.py\", line 77, in __exit__\n      self.gen.throw(type, value, traceback)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 166, in save_modules\n      saved_exc.resume()\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 141, in resume\n      six.reraise(type, exc, self._tb)\n    File \"/usr/lib/python3/dist-packages/pkg_resources/_vendor/six.py\", line 685, in reraise\n      raise value.with_traceback(tb)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 154, in save_modules\n      yield saved\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 195, in setup_context\n      yield\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 243, in run_setup\n      DirectorySandbox(setup_dir).run(runner)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 273, in run\n      return func()\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 242, in runner\n      _execfile(setup_script, ns)\n    File \"/usr/lib/python3/dist-packages/setuptools/sandbox.py\", line 46, in _execfile\n      exec(code, globals, locals)\n    File \"/tmp/easy_install-ks7u0nkf/cffi-1.11.5/setup.py\", line 240, in <module>\n      def run_tests(self):\n    File \"/usr/lib/python3.5/distutils/core.py\", line 163, in setup\n      raise SystemExit(\"error: \" + str(msg))\n  SystemExit: error: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  During handling of the above exception, another exception occurred:\n  \n  Traceback (most recent call last):\n    File \"<string>\", line 1, in <module>\n    File \"/tmp/pip-build-ju7ulsyk/cryptography/setup.py\", line 319, in <module>\n      **keywords_with_side_effects(sys.argv)\n    File \"/usr/lib/python3.5/distutils/core.py\", line 108, in setup\n      _setup_distribution = dist = klass(attrs)\n    File \"/usr/lib/python3/dist-packages/setuptools/dist.py\", line 269, in __init__\n      self.fetch_build_eggs(attrs['setup_requires'])\n    File \"/usr/lib/python3/dist-packages/setuptools/dist.py\", line 313, in fetch_build_eggs\n      replace_conflicting=True,\n    File \"/usr/lib/python3/dist-packages/pkg_resources/__init__.py\", line 826, in resolve\n      dist = best[req.key] = env.best_match(req, ws, installer)\n    File \"/usr/lib/python3/dist-packages/pkg_resources/__init__.py\", line 1092, in best_match\n      return self.obtain(req, installer)\n    File \"/usr/lib/python3/dist-packages/pkg_resources/__init__.py\", line 1104, in obtain\n      return installer(requirement)\n    File \"/usr/lib/python3/dist-packages/setuptools/dist.py\", line 380, in fetch_build_egg\n      return cmd.easy_install(req)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 663, in easy_install\n      return self.install_item(spec, dist.location, tmpdir, deps)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 693, in install_item\n      dists = self.install_eggs(spec, download, tmpdir)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 873, in install_eggs\n      return self.build_and_install(setup_script, setup_base)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 1101, in build_and_install\n      self.run_setup(setup_script, setup_base, args)\n    File \"/usr/lib/python3/dist-packages/setuptools/command/easy_install.py\", line 1089, in run_setup\n      raise DistutilsError(\"Setup script exited with %s\" % (v.args[0],))\n  distutils.errors.DistutilsError: Setup script exited with error: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n  \n  ----------------------------------------\n  Running setup.py bdist_wheel for pycparser: started\n  Running setup.py bdist_wheel for pycparser: finished with status 'done'\n  Stored in directory: /root/.cache/pip/wheels/c0/a1/27/5ba234bd77ea5a290cbf6d675259ec52293193467a12ef1f46\nSuccessfully built pycparser\nFailed to build cryptography\nInstalling collected packages: pip, setuptools, idna, asn1crypto, six, pycparser, cffi, cryptography, bcrypt, pyasn1, pynacl, paramiko\n  Found existing installation: pip 8.1.1\n    Not uninstalling pip at /usr/lib/python3/dist-packages, outside environment /usr\n  Found existing installation: setuptools 20.7.0\n    Not uninstalling setuptools at /usr/lib/python3/dist-packages, outside environment /usr\n  Found existing installation: idna 2.0\n    Not uninstalling idna at /usr/lib/python3/dist-packages, outside environment /usr\n  Found existing installation: six 1.10.0\n    Not uninstalling six at /usr/lib/python3/dist-packages, outside environment /usr\n  Found existing installation: cryptography 1.2.3\n    Not uninstalling cryptography at /usr/lib/python3/dist-packages, outside environment /usr\n  Running setup.py install for cryptography: started\n    Running setup.py install for cryptography: finished with status 'error'\n    Complete output from command /usr/bin/python3 -u -c \"import setuptools, tokenize;__file__='/tmp/pip-build-ju7ulsyk/cryptography/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\\r\\n', '\\n'), __file__, 'exec'))\" install --record /tmp/pip-s75nmk2f-record/install-record.txt --single-version-externally-managed --compile:\n    running install\n    running build\n    running build_py\n    creating build\n    creating build/lib.linux-x86_64-3.5\n    creating build/lib.linux-x86_64-3.5/cryptography\n    copying src/cryptography/fernet.py -> build/lib.linux-x86_64-3.5/cryptography\n    copying src/cryptography/__init__.py -> build/lib.linux-x86_64-3.5/cryptography\n    copying src/cryptography/__about__.py -> build/lib.linux-x86_64-3.5/cryptography\n    copying src/cryptography/exceptions.py -> build/lib.linux-x86_64-3.5/cryptography\n    copying src/cryptography/utils.py -> build/lib.linux-x86_64-3.5/cryptography\n    creating build/lib.linux-x86_64-3.5/cryptography/x509\n    copying src/cryptography/x509/extensions.py -> build/lib.linux-x86_64-3.5/cryptography/x509\n    copying src/cryptography/x509/certificate_transparency.py -> build/lib.linux-x86_64-3.5/cryptography/x509\n    copying src/cryptography/x509/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/x509\n    copying src/cryptography/x509/general_name.py -> build/lib.linux-x86_64-3.5/cryptography/x509\n    copying src/cryptography/x509/name.py -> build/lib.linux-x86_64-3.5/cryptography/x509\n    copying src/cryptography/x509/oid.py -> build/lib.linux-x86_64-3.5/cryptography/x509\n    copying src/cryptography/x509/base.py -> build/lib.linux-x86_64-3.5/cryptography/x509\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat\n    copying src/cryptography/hazmat/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/backends\n    copying src/cryptography/hazmat/backends/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends\n    copying src/cryptography/hazmat/backends/interfaces.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/bindings\n    copying src/cryptography/hazmat/bindings/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/bindings\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/constant_time.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/hashes.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/hmac.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/padding.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/serialization.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/cmac.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/mac.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    copying src/cryptography/hazmat/primitives/keywrap.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/hashes.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/hmac.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/dsa.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/aead.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/x509.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/x25519.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/decode_asn1.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/encode_asn1.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/cmac.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/dh.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/ec.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/backend.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/utils.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/ciphers.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    copying src/cryptography/hazmat/backends/openssl/rsa.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/backends/openssl\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/bindings/openssl\n    copying src/cryptography/hazmat/bindings/openssl/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/bindings/openssl\n    copying src/cryptography/hazmat/bindings/openssl/_conditional.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/bindings/openssl\n    copying src/cryptography/hazmat/bindings/openssl/binding.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/bindings/openssl\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/ciphers\n    copying src/cryptography/hazmat/primitives/ciphers/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/ciphers\n    copying src/cryptography/hazmat/primitives/ciphers/aead.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/ciphers\n    copying src/cryptography/hazmat/primitives/ciphers/algorithms.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/ciphers\n    copying src/cryptography/hazmat/primitives/ciphers/modes.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/ciphers\n    copying src/cryptography/hazmat/primitives/ciphers/base.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/ciphers\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/twofactor\n    copying src/cryptography/hazmat/primitives/twofactor/hotp.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/twofactor\n    copying src/cryptography/hazmat/primitives/twofactor/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/twofactor\n    copying src/cryptography/hazmat/primitives/twofactor/totp.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/twofactor\n    copying src/cryptography/hazmat/primitives/twofactor/utils.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/twofactor\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/dsa.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/x25519.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/padding.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/dh.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/ec.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/utils.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    copying src/cryptography/hazmat/primitives/asymmetric/rsa.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/asymmetric\n    creating build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    copying src/cryptography/hazmat/primitives/kdf/pbkdf2.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    copying src/cryptography/hazmat/primitives/kdf/hkdf.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    copying src/cryptography/hazmat/primitives/kdf/scrypt.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    copying src/cryptography/hazmat/primitives/kdf/__init__.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    copying src/cryptography/hazmat/primitives/kdf/x963kdf.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    copying src/cryptography/hazmat/primitives/kdf/kbkdf.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    copying src/cryptography/hazmat/primitives/kdf/concatkdf.py -> build/lib.linux-x86_64-3.5/cryptography/hazmat/primitives/kdf\n    running egg_info\n    writing requirements to src/cryptography.egg-info/requires.txt\n    writing top-level names to src/cryptography.egg-info/top_level.txt\n    writing dependency_links to src/cryptography.egg-info/dependency_links.txt\n    writing src/cryptography.egg-info/PKG-INFO\n    reading manifest file 'src/cryptography.egg-info/SOURCES.txt'\n    reading manifest template 'MANIFEST.in'\n    no previously-included directories found matching 'docs/_build'\n    warning: no previously-included files matching '*' found under directory 'vectors'\n    writing manifest file 'src/cryptography.egg-info/SOURCES.txt'\n    running build_ext\n    generating cffi module 'build/temp.linux-x86_64-3.5/_padding.c'\n    creating build/temp.linux-x86_64-3.5\n    generating cffi module 'build/temp.linux-x86_64-3.5/_constant_time.c'\n    generating cffi module 'build/temp.linux-x86_64-3.5/_openssl.c'\n    building '_openssl' extension\n    creating build/temp.linux-x86_64-3.5/build\n    creating build/temp.linux-x86_64-3.5/build/temp.linux-x86_64-3.5\n    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.5m -c build/temp.linux-x86_64-3.5/_openssl.c -o build/temp.linux-x86_64-3.5/build/temp.linux-x86_64-3.5/_openssl.o -Wconversion -Wno-error=sign-conversion\n    build/temp.linux-x86_64-3.5/_openssl.c:493:30: fatal error: openssl/opensslv.h: No such file or directory\n    compilation terminated.\n    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1\n    \n    ----------------------------------------\n\n:stderr:   Failed building wheel for cryptography\n  Failed cleaning build dir for cryptography\n  Can't rollback cryptography, nothing uninstalled.\nCommand \"/usr/bin/python3 -u -c \"import setuptools, tokenize;__file__='/tmp/pip-build-ju7ulsyk/cryptography/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\\r\\n', '\\n'), __file__, 'exec'))\" install --record /tmp/pip-s75nmk2f-record/install-record.txt --single-version-externally-managed --compile\" failed with error code 1 in /tmp/pip-build-ju7ulsyk/cryptography/\n"}

PLAY RECAP *****************************************************************************************
freebsd5                   : ok=1    changed=1    unreachable=0    failed=0   
freebsd6                   : ok=1    changed=1    unreachable=0    failed=0   
ubuntu1                    : ok=3    changed=2    unreachable=0    failed=1   
ubuntu2                    : ok=1    changed=1    unreachable=0    failed=0   
ubuntu3                    : ok=1    changed=1    unreachable=0    failed=0   
ubuntu4                    : ok=1    changed=1    unreachable=0    failed=0

:arrow_up: Keep in mind the error above doesn't wrap, and scrolls off screen to the right.

When deploying and setting up from the machine where vagrant runs, you need to add some extra arguments: --ssh-extra-args "-F ./vagrant-ssh-config" --inventory hosts-vagrant to ansible execution. These are not necessary once running ansible from ubuntu1.

After running it a 3rd time the pip process completes on ubuntu1 without issue.

The vagrant setup seems to have a provisioning bug, that kicks in with the latest 18.04 Ubuntu. The FreeBSD boxes also experience a provisioning problem, with the same result: the second, private network interface does not get configured. As these interfaces are used to run ansible from ubuntu1, I could not fully test the scripts from there.

I'm guessing the error below is what you were referring to.

[freebsd-update] step fails with the following error:

+ set -e
+ vagrant ssh-config
+ ansible-galaxy install -r roles/requirements.yml
- debian-update (v1.4.15) is already installed, skipping.
+ ansible-playbook --ssh-extra-args '-F ./vagrant-ssh-config' --inventory hosts-vagrant base-setup.yml

PLAY [install ansible requirements - ubuntu xenial] ************************************************

TASK [install python2 (vagrant images seem to come with python3 only)] *****************************
changed: [ubuntu2]
changed: [ubuntu1]

PLAY [install ansible requirements - ubuntu bionic] ************************************************

TASK [install python3-apt] *************************************************************************
changed: [ubuntu4]
changed: [ubuntu3]

PLAY [install ansible requirements - freebsd] ******************************************************

TASK [raw] *****************************************************************************************
changed: [freebsd6]
changed: [freebsd5]

PLAY [install ubuntu1 node as ansible control machine] *********************************************

TASK [Gathering Facts] *****************************************************************************
ok: [ubuntu1]

TASK [apt] *****************************************************************************************
ok: [ubuntu1]

TASK [pip] *****************************************************************************************
changed: [ubuntu1]

TASK [pip] *****************************************************************************************
changed: [ubuntu1]

TASK [git] *****************************************************************************************
changed: [ubuntu1]

TASK [user] ****************************************************************************************
changed: [ubuntu1]

PLAY [distribute vagrant@ubuntu1 ssh key] **********************************************************

TASK [Gathering Facts] *****************************************************************************
ok: [freebsd5]
ok: [ubuntu2]
ok: [ubuntu4]
ok: [ubuntu3]
ok: [ubuntu1]
ok: [freebsd6]

TASK [authorized_key] ******************************************************************************
changed: [freebsd5]
changed: [ubuntu2]
changed: [ubuntu1]
changed: [ubuntu3]
changed: [ubuntu4]
changed: [freebsd6]

PLAY RECAP *****************************************************************************************
freebsd5                   : ok=3    changed=2    unreachable=0    failed=0   
freebsd6                   : ok=3    changed=2    unreachable=0    failed=0   
ubuntu1                    : ok=9    changed=6    unreachable=0    failed=0   
ubuntu2                    : ok=3    changed=2    unreachable=0    failed=0   
ubuntu3                    : ok=3    changed=2    unreachable=0    failed=0   
ubuntu4                    : ok=3    changed=2    unreachable=0    failed=0   

+ ansible-playbook --ssh-extra-args '-F ./vagrant-ssh-config' --inventory hosts-vagrant os_upgrade.yml --check

PLAY [get facts and create os_type groups] *********************************************************

TASK [Gathering Facts] *****************************************************************************
ok: [freebsd5]
ok: [ubuntu3]
ok: [ubuntu4]
ok: [ubuntu2]
ok: [ubuntu1]
ok: [freebsd6]

TASK [group_by] ************************************************************************************
ok: [ubuntu1]
ok: [ubuntu2]
ok: [ubuntu3]
ok: [ubuntu4]
ok: [freebsd5]
ok: [freebsd6]
 [WARNING]: Could not match supplied host pattern, ignoring: mbuntu

PLAY [upgrade debian based machines] ***************************************************************

TASK [include_role] ********************************************************************************
skipping: [freebsd5]
skipping: [freebsd6]

TASK [include_role] ********************************************************************************

TASK [freebsd-update : Fetch any new FreeBSD updates] **********************************************
ok: [freebsd5]
ok: [freebsd6]

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]
skipping: [freebsd6]

TASK [freebsd-update : Install FreeBSD updates] ****************************************************
skipping: [freebsd5]
skipping: [freebsd6]

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]
skipping: [freebsd6]

TASK [freebsd-update : Upgrade FreeBSD packages - dry-run] *****************************************
fatal: [freebsd6]: FAILED! => {"changed": true, "cmd": ["pkg", "upgrade", "--dry-run"], "delta": "0:00:00.450758", "end": "2018-05-11 20:44:55.644407", "msg": "non-zero return code", "rc": 1, "start": "2018-05-11 20:44:55.193649", "stderr": "", "stderr_lines": [], "stdout": "Updating FreeBSD repository catalogue...\nFreeBSD repository is up to date.\nAll repositories are up to date.\nChecking for upgrades (4 candidates): .... done\nProcessing candidates (4 candidates): .... done\nThe following 3 package(s) will be affected (of 0 checked):\n\nInstalled packages to be UPGRADED:\n\tlibxml2: 2.9.4 -> 2.9.7\n\texpat: 2.2.1 -> 2.2.5\n\nInstalled packages to be REINSTALLED:\n\tlibpthread-stubs-0.4 (ABI changed: 'freebsd:11:x86:64' -> 'freebsd:11:*')\n\nNumber of packages to be upgraded: 2\nNumber of packages to be reinstalled: 1\n\n937 KiB to be downloaded.", "stdout_lines": ["Updating FreeBSD repository catalogue...", "FreeBSD repository is up to date.", "All repositories are up to date.", "Checking for upgrades (4 candidates): .... done", "Processing candidates (4 candidates): .... done", "The following 3 package(s) will be affected (of 0 checked):", "", "Installed packages to be UPGRADED:", "\tlibxml2: 2.9.4 -> 2.9.7", "\texpat: 2.2.1 -> 2.2.5", "", "Installed packages to be REINSTALLED:", "\tlibpthread-stubs-0.4 (ABI changed: 'freebsd:11:x86:64' -> 'freebsd:11:*')", "", "Number of packages to be upgraded: 2", "Number of packages to be reinstalled: 1", "", "937 KiB to be downloaded."]}
fatal: [freebsd5]: FAILED! => {"changed": true, "cmd": ["pkg", "upgrade", "--dry-run"], "delta": "0:00:00.597194", "end": "2018-05-11 20:44:55.777098", "msg": "non-zero return code", "rc": 1, "start": "2018-05-11 20:44:55.179904", "stderr": "", "stderr_lines": [], "stdout": "Updating FreeBSD repository catalogue...\nFreeBSD repository is up to date.\nAll repositories are up to date.\nChecking for upgrades (4 candidates): .... done\nProcessing candidates (4 candidates): .... done\nThe following 3 package(s) will be affected (of 0 checked):\n\nInstalled packages to be UPGRADED:\n\tlibxml2: 2.9.4 -> 2.9.7\n\texpat: 2.2.1 -> 2.2.5\n\nInstalled packages to be REINSTALLED:\n\tlibpthread-stubs-0.4 (ABI changed: 'freebsd:11:x86:64' -> 'freebsd:11:*')\n\nNumber of packages to be upgraded: 2\nNumber of packages to be reinstalled: 1\n\n937 KiB to be downloaded.", "stdout_lines": ["Updating FreeBSD repository catalogue...", "FreeBSD repository is up to date.", "All repositories are up to date.", "Checking for upgrades (4 candidates): .... done", "Processing candidates (4 candidates): .... done", "The following 3 package(s) will be affected (of 0 checked):", "", "Installed packages to be UPGRADED:", "\tlibxml2: 2.9.4 -> 2.9.7", "\texpat: 2.2.1 -> 2.2.5", "", "Installed packages to be REINSTALLED:", "\tlibpthread-stubs-0.4 (ABI changed: 'freebsd:11:x86:64' -> 'freebsd:11:*')", "", "Number of packages to be upgraded: 2", "Number of packages to be reinstalled: 1", "", "937 KiB to be downloaded."]}

PLAY RECAP *****************************************************************************************
freebsd5                   : ok=3    changed=0    unreachable=0    failed=1   
freebsd6                   : ok=3    changed=0    unreachable=0    failed=1   
ubuntu1                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu2                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu3                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu4                    : ok=2    changed=0    unreachable=0    failed=0

Ansible from ubuntu1 ansible controller VM

First I did a git clone of the ginsys repo for testing again, and cd into the correct directory.

ansible-playbook os_upgrade.yml failed because of a typo that I corrected here: https://github.com/ginsys/ansible-experiments/commit/e6cd6bc239c29478e65f4f43777cc4bc52bf3087 .

I ran ansible-playbook os_upgrade.yml again from ubuntu1:


PLAY [get facts and create os_type groups] *********************************************************

TASK [Gathering Facts] *****************************************************************************
ok: [freebsd5]
ok: [ubuntu4]
ok: [ubuntu3]
ok: [ubuntu2]
ok: [ubuntu1]
ok: [freebsd6]

TASK [group_by] ************************************************************************************
ok: [ubuntu1]
ok: [ubuntu2]
ok: [freebsd6]
ok: [ubuntu3]
ok: [freebsd5]
ok: [ubuntu4]
 [WARNING]: Could not match supplied host pattern, ignoring: ubuntu

PLAY [upgrade debian based machines] ***************************************************************

TASK [include_role] ********************************************************************************
skipping: [freebsd6]
skipping: [freebsd5]

TASK [include_role] ********************************************************************************

TASK [freebsd-update : Fetch any new FreeBSD updates] **********************************************
fatal: [freebsd6]: FAILED! => {"changed": true, "cmd": ["freebsd-update", "fetch", "--not-running-from-cron"], "delta": "0:00:00.949456", "end": "2018-05-11 21:16:08.351807", "msg": "non-zero return code", "rc": 1, "start": "2018-05-11 21:16:07.402351", "stderr": "rm: latest.ssl: No such file or directory\nrm: tINDEX.wanted: No such file or directory", "stderr_lines": ["rm: latest.ssl: No such file or directory", "rm: tINDEX.wanted: No such file or directory"], "stdout": "src component not installed, skipped\nLooking up update.FreeBSD.org mirrors... 3 mirrors found.\nFetching metadata signature for 11.1-RELEASE from update6.freebsd.org... done.\nFetching metadata index... done.", "stdout_lines": ["src component not installed, skipped", "Looking up update.FreeBSD.org mirrors... 3 mirrors found.", "Fetching metadata signature for 11.1-RELEASE from update6.freebsd.org... done.", "Fetching metadata index... done."]}
ok: [freebsd5]

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]

TASK [freebsd-update : Install FreeBSD updates] ****************************************************
skipping: [freebsd5]

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]

TASK [freebsd-update : Upgrade FreeBSD packages - dry-run] *****************************************
skipping: [freebsd5]

TASK [freebsd-update : Upgrade FreeBSD packages] ***************************************************
ok: [freebsd5]

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]

PLAY RECAP *****************************************************************************************
freebsd5                   : ok=4    changed=0    unreachable=0    failed=0   
freebsd6                   : ok=2    changed=0    unreachable=0    failed=1   
ubuntu1                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu2                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu3                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu4                    : ok=2    changed=0    unreachable=0    failed=0
reelsense commented 6 years ago

Continuing the freebsd6 error mystery

I exited ubuntu1 and vagrant ssh freebsd6 to investigate why it always failed.

I thought maybe if I manually did a sudo pkg upgrade I would see an error or some clue.

Maybe freebsd6 is failing because it can't handle this ABI changing REINSTALL?:

Updating FreeBSD repository catalogue...
FreeBSD repository is up to date.
All repositories are up to date.
Checking for upgrades (4 candidates): 100%
Processing candidates (4 candidates): 100%
The following 3 package(s) will be affected (of 0 checked):

Installed packages to be UPGRADED:
    libxml2: 2.9.4 -> 2.9.7
    expat: 2.2.1 -> 2.2.5

Installed packages to be REINSTALLED:
    libpthread-stubs-0.4 (ABI changed: 'freebsd:11:x86:64' -> 'freebsd:11:*')

Number of packages to be upgraded: 2
Number of packages to be reinstalled: 1

937 KiB to be downloaded.

Proceed with this action? [y/N]:

After a manual sudo pkg upgrade I exited freebsd6 and vagrant ssh ubuntu1.

From ubuntu1 I cd to the correct directory and ran ansible-playbook os_upgrade.yml again to see if it gets further.


PLAY [get facts and create os_type groups] *********************************************************

TASK [Gathering Facts] *****************************************************************************
ok: [freebsd5]
ok: [ubuntu1]
ok: [freebsd6]
ok: [ubuntu3]
ok: [ubuntu2]
ok: [ubuntu4]

TASK [group_by] ************************************************************************************
ok: [ubuntu1]
ok: [ubuntu2]
ok: [ubuntu3]
ok: [freebsd6]
ok: [ubuntu4]
ok: [freebsd5]
 [WARNING]: Could not match supplied host pattern, ignoring: ubuntu

PLAY [upgrade debian based machines] ***************************************************************

TASK [include_role] ********************************************************************************
skipping: [freebsd6]
skipping: [freebsd5]

TASK [include_role] ********************************************************************************

TASK [freebsd-update : Fetch any new FreeBSD updates] **********************************************
changed: [freebsd6]
ok: [freebsd5]

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]
ok: [freebsd6] => {
    "result_update": {
        "changed": true,
        "cmd": [
            "freebsd-update",
            "fetch",
            "--not-running-from-cron"
        ],
        "delta": "0:00:01.011717",
        "end": "2018-05-11 21:31:48.898219",
        "failed": false,
        "rc": 0,
        "start": "2018-05-11 21:31:47.886502",
        "stderr": "sort: Broken pipe",
        "stderr_lines": [
            "sort: Broken pipe"
        ],
        "stdout": "src component not installed, skipped\nLooking up update.FreeBSD.org mirrors... 3 mirrors found.\nFetching metadata signature for 11.1-RELEASE from update4.freebsd.org... done.\nFetching metadata index... done.\nInspecting system... done.\nPreparing to download files... done.\n\nThe following files will be added as part of updating to 11.1-RELEASE-p10:\n/boot/kernel/crypto.ko\n/boot/kernel/ctl.ko\n/boot/kernel/cuse.ko\n/boot/kernel/cxgbei.ko\n/boot/kernel/drm.ko\n/boot/kernel/drm2.ko\n/boot/kernel/dtrace.ko\n/boot/kernel/efirt.ko\n/boot/kernel/ext2fs.ko\n/boot/kernel/fasttrap.ko\n/boot/kernel/fdescfs.ko\n/boot/kernel/filemon.ko\n/boot/kernel/firmware.ko\n/boot/kernel/fuse.ko\n/boot/kernel/geom_eli.ko\n/boot/kernel/geom_journal.ko\n/boot/kernel/geom_md.ko\n/boot/kernel/geom_mirror.ko\n/boot/kernel/geom_raid.ko\n/boot/kernel/geom_raid3.ko\n/boot/kernel/geom_sched.ko\n/boot/kernel/geom_uzip.ko\n/boot/kernel/hpt27xx.ko\n/boot/kernel/hptmv.ko\n/boot/kernel/hptnr.ko\n/boot/kernel/hptrr.ko\n/boot/kernel/hv_utils.ko\n/boot/kernel/hv_vmbus.ko\n/boot/kernel/hwpmc.ko\n/boot/kernel/i915.ko\n/boot/kernel/i915kms.ko\n/boot/kernel/if_an.ko\n/boot/kernel/if_ath.ko\n/boot/kernel/if_aue.ko\n/boot/kernel/if_axe.ko\n/boot/kernel/if_axge.ko\n/boot/kernel/if_bnxt.ko\n/boot/kernel/if_bridge.ko\n/boot/kernel/if_cas.ko\n/boot/kernel/if_ena.ko\n/boot/kernel/if_gif.ko\n/boot/kernel/if_gre.ko\n/boot/kernel/if_iwi.ko\n/boot/kernel/if_ix.ko\n/boot/kernel/if_ixl.ko\n/boot/kernel/if_ixlv.ko\n/boot/kernel/if_ixv.ko\n/boot/kernel/if_lagg.ko\n/boot/kernel/if_lmc.ko\n/boot/kernel/if_me.ko\n/boot/kernel/if_mos.ko\n/boot/kernel/if_ndis.ko\n/boot/kernel/if_nxge.ko\n/boot/kernel/if_qlnxe.ko\n/boot/kernel/if_rue.ko\n/boot/kernel/if_run.ko\n/boot/kernel/if_smsc.ko\n/boot/kernel/if_stf.ko\n/boot/kernel/if_tun.ko\n/boot/kernel/if_udav.ko\n/boot/kernel/if_ure.ko\n/boot/kernel/if_vlan.ko\n/boot/kernel/if_vxlan.ko\n/boot/kernel/ig4.ko\n/boot/kernel/ip_mroute.ko\n/boot/kernel/ipl.ko\n/boot/kernel/ipsec.ko\n/boot/kernel/iscsi.ko\n/boot/kernel/iscsi_initiator.ko\n/boot/kernel/ismt.ko\n/boot/kernel/kernel\n/boot/kernel/kgssapi.ko\n/boot/kernel/krpc.ko\n/boot/kernel/ksyms.ko\n/boot/kernel/linprocfs.ko\n/boot/kernel/linsysfs.ko\n/boot/kernel/linux.ko\n/boot/kernel/linux64.ko\n/boot/kernel/linux_common.ko\n/boot/kernel/linuxkpi.ko\n/boot/kernel/mac_biba.ko\n/boot/kernel/mac_lomac.ko\n/boot/kernel/mac_mls.ko\n/boot/kernel/mach64.ko\n/boot/kernel/mem.ko\n/boot/kernel/mfi.ko\n/boot/kernel/mga.ko\n/boot/kernel/mlx5.ko\n/boot/kernel/mlx5en.ko\n/boot/kernel/mpr.ko\n/boot/kernel/mps.ko\n/boot/kernel/mqueuefs.ko\n/boot/kernel/mrsas.ko\n/boot/kernel/msdosfs.ko\n/boot/kernel/ndis.ko\n/boot/kernel/netgraph.ko\n/boot/kernel/nfscl.ko\n/boot/kernel/nfscommon.ko\n/boot/kernel/nfsd.ko\n/boot/kernel/nfslock.ko\n/boot/kernel/nfslockd.ko\n/boot/kernel/nfssvc.ko\n/boot/kernel/ng_btsocket.ko\n/boot/kernel/ng_eiface.ko\n/boot/kernel/ng_ether.ko\n/boot/kernel/ng_iface.ko\n/boot/kernel/ng_ip_input.ko\n/boot/kernel/ng_ksocket.ko\n/boot/kernel/ng_socket.ko\n/boot/kernel/nullfs.ko\n/boot/kernel/nvme.ko\n/boot/kernel/opensolaris.ko\n/boot/kernel/padlock.ko\n/boot/kernel/padlock_rng.ko\n/boot/kernel/pf.ko\n/boot/kernel/pfsync.ko\n/boot/kernel/procfs.ko\n/boot/kernel/profile.ko\n/boot/kernel/proto.ko\n/boot/kernel/pseudofs.ko\n/boot/kernel/r128.ko\n/boot/kernel/radeon.ko\n/boot/kernel/radeonkms.ko\n/boot/kernel/savage.ko\n/boot/kernel/sem.ko\n/boot/kernel/sfxge.ko\n/boot/kernel/siftr.ko\n/boot/kernel/sis.ko\n/boot/kernel/smbfs.ko\n/boot/kernel/snd_hda.ko\n/boot/kernel/snd_sb16.ko\n/boot/kernel/snd_uaudio.ko\n/boot/kernel/sound.ko\n/boot/kernel/sppp.ko\n/boot/kernel/systrace.ko\n/boot/kernel/systrace_freebsd32.ko\n/boot/kernel/systrace_linux.ko\n/boot/kernel/systrace_linux32.ko\n/boot/kernel/sysvmsg.ko\n/boot/kernel/sysvsem.ko\n/boot/kernel/sysvshm.ko\n/boot/kernel/t3_tom.ko\n/boot/kernel/t4_tom.ko\n/boot/kernel/tdfx.ko\n/boot/kernel/tmpfs.ko\n/boot/kernel/udf.ko\n/boot/kernel/ufs.ko\n/boot/kernel/uinput.ko\n/boot/kernel/ukbd.ko\n/boot/kernel/unionfs.ko\n/boot/kernel/usb.ko\n/boot/kernel/usb_quirk.ko\n/boot/kernel/via.ko\n/boot/kernel/virtio_balloon.ko\n/boot/kernel/vmm.ko\n/boot/kernel/vxge.ko\n/boot/kernel/wlan.ko\n/boot/kernel/zfs.ko\n/lib/libcrypto.so.8\n/lib/libkvm.so.7\n/lib/libutil.so.9\n/rescue/[\n/rescue/atmconfig\n/rescue/badsect\n/rescue/bsdlabel\n/rescue/bunzip2\n/rescue/bzcat\n/rescue/bzip2\n/rescue/camcontrol\n/rescue/cat\n/rescue/ccdconfig\n/rescue/chflags\n/rescue/chgrp\n/rescue/chio\n/rescue/chmod\n/rescue/chown\n/rescue/chroot\n/rescue/clri\n/rescue/cp\n/rescue/csh\n/rescue/date\n/rescue/dd\n/rescue/devfs\n/rescue/df\n/rescue/dhclient\n/rescue/disklabel\n/rescue/dmesg\n/rescue/dump\n/rescue/dumpfs\n/rescue/dumpon\n/rescue/echo\n/rescue/ed\n/rescue/ex\n/rescue/expr\n/rescue/fastboot\n/rescue/fasthalt\n/rescue/fdisk\n/rescue/fsck\n/rescue/fsck_4.2bsd\n/rescue/fsck_ffs\n/rescue/fsck_msdosfs\n/rescue/fsck_ufs\n/rescue/fsdb\n/rescue/fsirand\n/rescue/gbde\n/rescue/geom\n/rescue/getfacl\n/rescue/glabel\n/rescue/gpart\n/rescue/groups\n/rescue/gunzip\n/rescue/gzcat\n/rescue/gzip\n/rescue/halt\n/rescue/head\n/rescue/hostname\n/rescue/id\n/rescue/ifconfig\n/rescue/init\n/rescue/ipf\n/rescue/iscsictl\n/rescue/iscsid\n/rescue/kenv\n/rescue/kill\n/rescue/kldconfig\n/rescue/kldload\n/rescue/kldstat\n/rescue/kldunload\n/rescue/ldconfig\n/rescue/less\n/rescue/link\n/rescue/ln\n/rescue/ls\n/rescue/lzcat\n/rescue/lzma\n/rescue/md5\n/rescue/mdconfig\n/rescue/mdmfs\n/rescue/mkdir\n/rescue/mknod\n/rescue/more\n/rescue/mount\n/rescue/mount_cd9660\n/rescue/mount_msdosfs\n/rescue/mount_nfs\n/rescue/mount_nullfs\n/rescue/mount_udf\n/rescue/mount_unionfs\n/rescue/mt\n/rescue/mv\n/rescue/nc\n/rescue/newfs\n/rescue/newfs_msdos\n/rescue/nos-tun\n/rescue/pgrep\n/rescue/ping\n/rescue/ping6\n/rescue/pkill\n/rescue/poweroff\n/rescue/ps\n/rescue/pwd\n/rescue/rcorder\n/rescue/rcp\n/rescue/rdump\n/rescue/realpath\n/rescue/reboot\n/rescue/red\n/rescue/rescue\n/rescue/restore\n/rescue/rm\n/rescue/rmdir\n/rescue/route\n/rescue/routed\n/rescue/rrestore\n/rescue/rtquery\n/rescue/rtsol\n/rescue/savecore\n/rescue/sed\n/rescue/setfacl\n/rescue/sh\n/rescue/shutdown\n/rescue/sleep\n/rescue/spppcontrol\n/rescue/stty\n/rescue/swapon\n/rescue/sync\n/rescue/sysctl\n/rescue/tail\n/rescue/tar\n/rescue/tcsh\n/rescue/tee\n/rescue/test\n/rescue/tunefs\n/rescue/umount\n/rescue/unlink\n/rescue/unlzma\n/rescue/unxz\n/rescue/vi\n/rescue/whoami\n/rescue/xz\n/rescue/xzcat\n/rescue/zcat\n/rescue/zdb\n/rescue/zfs\n/rescue/zpool\n/sbin/ipresend\n/usr/bin/file\n/usr/bin/fstat\n/usr/bin/fuser\n/usr/bin/gcore\n/usr/bin/kdump\n/usr/bin/kgdb\n/usr/bin/killall\n/usr/bin/limits\n/usr/bin/netstat\n/usr/bin/ntpq\n/usr/bin/openssl\n/usr/bin/procstat\n/usr/bin/sockstat\n/usr/bin/systat\n/usr/bin/top\n/usr/bin/truss\n/usr/bin/uptime\n/usr/bin/vmstat\n/usr/bin/w\n/usr/include/machine/asmacros.h\n/usr/include/machine/frame.h\n/usr/include/machine/intr_machdep.h\n/usr/include/machine/md_var.h\n/usr/include/machine/pcb.h\n/usr/include/machine/pcpu.h\n/usr/include/machine/pmap.h\n/usr/include/machine/smp.h\n/usr/include/magic.h\n/usr/include/openssl/ssl.h\n/usr/include/sys/cpuctl.h\n/usr/include/x86/apicvar.h\n/usr/include/x86/specialreg.h\n/usr/include/x86/x86_smp.h\n/usr/include/x86/x86_var.h\n/usr/lib/debug/bin/pkill.debug\n/usr/lib/debug/bin/ps.debug\n/usr/lib/debug/boot/kernel/aesni.ko.debug\n/usr/lib/debug/boot/kernel/agp.ko.debug\n/usr/lib/debug/boot/kernel/alq.ko.debug\n/usr/lib/debug/boot/kernel/aout.ko.debug\n/usr/lib/debug/boot/kernel/arcmsr.ko.debug\n/usr/lib/debug/boot/kernel/autofs.ko.debug\n/usr/lib/debug/boot/kernel/cam.ko.debug\n/usr/lib/debug/boot/kernel/cd9660.ko.debug\n/usr/lib/debug/boot/kernel/cloudabi.ko.debug\n/usr/lib/debug/boot/kernel/cloudabi32.ko.debug\n/usr/lib/debug/boot/kernel/cloudabi64.ko.debug\n/usr/lib/debug/boot/kernel/coretemp.ko.debug\n/usr/lib/debug/boot/kernel/cpuctl.ko.debug\n/usr/lib/debug/boot/kernel/cpufreq.ko.debug\n/usr/lib/debug/boot/kernel/crypto.ko.debug\n/usr/lib/debug/boot/kernel/ctl.ko.debug\n/usr/lib/debug/boot/kernel/cuse.ko.debug\n/usr/lib/debug/boot/kernel/cxgbei.ko.debug\n/usr/lib/debug/boot/kernel/drm.ko.debug\n/usr/lib/debug/boot/kernel/drm2.ko.debug\n/usr/lib/debug/boot/kernel/dtrace.ko.debug\n/usr/lib/debug/boot/kernel/efirt.ko.debug\n/usr/lib/debug/boot/kernel/ext2fs.ko.debug\n/usr/lib/debug/boot/kernel/fasttrap.ko.debug\n/usr/lib/debug/boot/kernel/fdescfs.ko.debug\n/usr/lib/debug/boot/kernel/filemon.ko.debug\n/usr/lib/debug/boot/kernel/firmware.ko.debug\n/usr/lib/debug/boot/kernel/fuse.ko.debug\n/usr/lib/debug/boot/kernel/geom_eli.ko.debug\n/usr/lib/debug/boot/kernel/geom_journal.ko.debug\n/usr/lib/debug/boot/kernel/geom_md.ko.debug\n/usr/lib/debug/boot/kernel/geom_mirror.ko.debug\n/usr/lib/debug/boot/kernel/geom_raid.ko.debug\n/usr/lib/debug/boot/kernel/geom_raid3.ko.debug\n/usr/lib/debug/boot/kernel/geom_sched.ko.debug\n/usr/lib/debug/boot/kernel/geom_uzip.ko.debug\n/usr/lib/debug/boot/kernel/hpt27xx.ko.debug\n/usr/lib/debug/boot/kernel/hptmv.ko.debug\n/usr/lib/debug/boot/kernel/hptnr.ko.debug\n/usr/lib/debug/boot/kernel/hptrr.ko.debug\n/usr/lib/debug/boot/kernel/hv_utils.ko.debug\n/usr/lib/debug/boot/kernel/hv_vmbus.ko.debug\n/usr/lib/debug/boot/kernel/hwpmc.ko.debug\n/usr/lib/debug/boot/kernel/i915.ko.debug\n/usr/lib/debug/boot/kernel/i915kms.ko.debug\n/usr/lib/debug/boot/kernel/if_an.ko.debug\n/usr/lib/debug/boot/kernel/if_ath.ko.debug\n/usr/lib/debug/boot/kernel/if_aue.ko.debug\n/usr/lib/debug/boot/kernel/if_axe.ko.debug\n/usr/lib/debug/boot/kernel/if_axge.ko.debug\n/usr/lib/debug/boot/kernel/if_bnxt.ko.debug\n/usr/lib/debug/boot/kernel/if_bridge.ko.debug\n/usr/lib/debug/boot/kernel/if_cas.ko.debug\n/usr/lib/debug/boot/kernel/if_ena.ko.debug\n/usr/lib/debug/boot/kernel/if_gif.ko.debug\n/usr/lib/debug/boot/kernel/if_gre.ko.debug\n/usr/lib/debug/boot/kernel/if_iwi.ko.debug\n/usr/lib/debug/boot/kernel/if_ix.ko.debug\n/usr/lib/debug/boot/kernel/if_ixl.ko.debug\n/usr/lib/debug/boot/kernel/if_ixlv.ko.debug\n/usr/lib/debug/boot/kernel/if_ixv.ko.debug\n/usr/lib/debug/boot/kernel/if_lagg.ko.debug\n/usr/lib/debug/boot/kernel/if_lmc.ko.debug\n/usr/lib/debug/boot/kernel/if_me.ko.debug\n/usr/lib/debug/boot/kernel/if_mos.ko.debug\n/usr/lib/debug/boot/kernel/if_ndis.ko.debug\n/usr/lib/debug/boot/kernel/if_nxge.ko.debug\n/usr/lib/debug/boot/kernel/if_qlnxe.ko.debug\n/usr/lib/debug/boot/kernel/if_rue.ko.debug\n/usr/lib/debug/boot/kernel/if_run.ko.debug\n/usr/lib/debug/boot/kernel/if_smsc.ko.debug\n/usr/lib/debug/boot/kernel/if_stf.ko.debug\n/usr/lib/debug/boot/kernel/if_tun.ko.debug\n/usr/lib/debug/boot/kernel/if_udav.ko.debug\n/usr/lib/debug/boot/kernel/if_ure.ko.debug\n/usr/lib/debug/boot/kernel/if_vlan.ko.debug\n/usr/lib/debug/boot/kernel/if_vxlan.ko.debug\n/usr/lib/debug/boot/kernel/ig4.ko.debug\n/usr/lib/debug/boot/kernel/ip_mroute.ko.debug\n/usr/lib/debug/boot/kernel/ipl.ko.debug\n/usr/lib/debug/boot/kernel/ipsec.ko.debug\n/usr/lib/debug/boot/kernel/iscsi.ko.debug\n/usr/lib/debug/boot/kernel/iscsi_initiator.ko.debug\n/usr/lib/debug/boot/kernel/ismt.ko.debug\n/usr/lib/debug/boot/kernel/kernel.debug\n/usr/lib/debug/boot/kernel/kgssapi.ko.debug\n/usr/lib/debug/boot/kernel/krpc.ko.debug\n/usr/lib/debug/boot/kernel/ksyms.ko.debug\n/usr/lib/debug/boot/kernel/linprocfs.ko.debug\n/usr/lib/debug/boot/kernel/linsysfs.ko.debug\n/usr/lib/debug/boot/kernel/linux.ko.debug\n/usr/lib/debug/boot/kernel/linux64.ko.debug\n/usr/lib/debug/boot/kernel/linux_common.ko.debug\n/usr/lib/debug/boot/kernel/linuxkpi.ko.debug\n/usr/lib/debug/boot/kernel/mac_biba.ko.debug\n/usr/lib/debug/boot/kernel/mac_lomac.ko.debug\n/usr/lib/debug/boot/kernel/mac_mls.ko.debug\n/usr/lib/debug/boot/kernel/mach64.ko.debug\n/usr/lib/debug/boot/kernel/mem.ko.debug\n/usr/lib/debug/boot/kernel/mfi.ko.debug\n/usr/lib/debug/boot/kernel/mga.ko.debug\n/usr/lib/debug/boot/kernel/mlx5.ko.debug\n/usr/lib/debug/boot/kernel/mlx5en.ko.debug\n/usr/lib/debug/boot/kernel/mpr.ko.debug\n/usr/lib/debug/boot/kernel/mps.ko.debug\n/usr/lib/debug/boot/kernel/mqueuefs.ko.debug\n/usr/lib/debug/boot/kernel/mrsas.ko.debug\n/usr/lib/debug/boot/kernel/msdosfs.ko.debug\n/usr/lib/debug/boot/kernel/ndis.ko.debug\n/usr/lib/debug/boot/kernel/netgraph.ko.debug\n/usr/lib/debug/boot/kernel/nfscl.ko.debug\n/usr/lib/debug/boot/kernel/nfscommon.ko.debug\n/usr/lib/debug/boot/kernel/nfsd.ko.debug\n/usr/lib/debug/boot/kernel/nfslock.ko.debug\n/usr/lib/debug/boot/kernel/nfslockd.ko.debug\n/usr/lib/debug/boot/kernel/nfssvc.ko.debug\n/usr/lib/debug/boot/kernel/ng_btsocket.ko.debug\n/usr/lib/debug/boot/kernel/ng_eiface.ko.debug\n/usr/lib/debug/boot/kernel/ng_ether.ko.debug\n/usr/lib/debug/boot/kernel/ng_iface.ko.debug\n/usr/lib/debug/boot/kernel/ng_ip_input.ko.debug\n/usr/lib/debug/boot/kernel/ng_ksocket.ko.debug\n/usr/lib/debug/boot/kernel/ng_socket.ko.debug\n/usr/lib/debug/boot/kernel/nullfs.ko.debug\n/usr/lib/debug/boot/kernel/nvme.ko.debug\n/usr/lib/debug/boot/kernel/opensolaris.ko.debug\n/usr/lib/debug/boot/kernel/padlock.ko.debug\n/usr/lib/debug/boot/kernel/padlock_rng.ko.debug\n/usr/lib/debug/boot/kernel/pf.ko.debug\n/usr/lib/debug/boot/kernel/pfsync.ko.debug\n/usr/lib/debug/boot/kernel/procfs.ko.debug\n/usr/lib/debug/boot/kernel/profile.ko.debug\n/usr/lib/debug/boot/kernel/proto.ko.debug\n/usr/lib/debug/boot/kernel/pseudofs.ko.debug\n/usr/lib/debug/boot/kernel/r128.ko.debug\n/usr/lib/debug/boot/kernel/radeon.ko.debug\n/usr/lib/debug/boot/kernel/radeonkms.ko.debug\n/usr/lib/debug/boot/kernel/savage.ko.debug\n/usr/lib/debug/boot/kernel/sem.ko.debug\n/usr/lib/debug/boot/kernel/sfxge.ko.debug\n/usr/lib/debug/boot/kernel/siftr.ko.debug\n/usr/lib/debug/boot/kernel/sis.ko.debug\n/usr/lib/debug/boot/kernel/smbfs.ko.debug\n/usr/lib/debug/boot/kernel/snd_hda.ko.debug\n/usr/lib/debug/boot/kernel/snd_sb16.ko.debug\n/usr/lib/debug/boot/kernel/snd_uaudio.ko.debug\n/usr/lib/debug/boot/kernel/sound.ko.debug\n/usr/lib/debug/boot/kernel/sppp.ko.debug\n/usr/lib/debug/boot/kernel/systrace.ko.debug\n/usr/lib/debug/boot/kernel/systrace_freebsd32.ko.debug\n/usr/lib/debug/boot/kernel/systrace_linux.ko.debug\n/usr/lib/debug/boot/kernel/systrace_linux32.ko.debug\n/usr/lib/debug/boot/kernel/sysvmsg.ko.debug\n/usr/lib/debug/boot/kernel/sysvsem.ko.debug\n/usr/lib/debug/boot/kernel/sysvshm.ko.debug\n/usr/lib/debug/boot/kernel/t3_tom.ko.debug\n/usr/lib/debug/boot/kernel/t4_tom.ko.debug\n/usr/lib/debug/boot/kernel/tdfx.ko.debug\n/usr/lib/debug/boot/kernel/tmpfs.ko.debug\n/usr/lib/debug/boot/kernel/udf.ko.debug\n/usr/lib/debug/boot/kernel/ufs.ko.debug\n/usr/lib/debug/boot/kernel/uinput.ko.debug\n/usr/lib/debug/boot/kernel/ukbd.ko.debug\n/usr/lib/debug/boot/kernel/unionfs.ko.debug\n/usr/lib/debug/boot/kernel/usb.ko.debug\n/usr/lib/debug/boot/kernel/usb_quirk.ko.debug\n/usr/lib/debug/boot/kernel/via.ko.debug\n/usr/lib/debug/boot/kernel/virtio_balloon.ko.debug\n/usr/lib/debug/boot/kernel/vmm.ko.debug\n/usr/lib/debug/boot/kernel/vxge.ko.debug\n/usr/lib/debug/boot/kernel/wlan.ko.debug\n/usr/lib/debug/boot/kernel/zfs.ko.debug\n/usr/lib/debug/lib/libcrypto.so.8.debug\n/usr/lib/debug/lib/libkvm.so.7.debug\n/usr/lib/debug/lib/libutil.so.9.debug\n/usr/lib/debug/sbin/ipresend.debug\n/usr/lib/debug/usr/bin/file.debug\n/usr/lib/debug/usr/bin/fstat.debug\n/usr/lib/debug/usr/bin/gcore.debug\n/usr/lib/debug/usr/bin/kdump.debug\n/usr/lib/debug/usr/bin/kgdb.debug\n/usr/lib/debug/usr/bin/killall.debug\n/usr/lib/debug/usr/bin/limits.debug\n/usr/lib/debug/usr/bin/netstat.debug\n/usr/lib/debug/usr/bin/ntpq.debug\n/usr/lib/debug/usr/bin/openssl.debug\n/usr/lib/debug/usr/bin/procstat.debug\n/usr/lib/debug/usr/bin/sockstat.debug\n/usr/lib/debug/usr/bin/systat.debug\n/usr/lib/debug/usr/bin/top.debug\n/usr/lib/debug/usr/bin/truss.debug\n/usr/lib/debug/usr/bin/vmstat.debug\n/usr/lib/debug/usr/bin/w.debug\n/usr/lib/debug/usr/lib/libmagic.so.4.debug\n/usr/lib/debug/usr/lib/libprocstat.so.1.debug\n/usr/lib/debug/usr/lib/librtld_db.so.2.debug\n/usr/lib/debug/usr/lib/libssl.so.8.debug\n/usr/lib/debug/usr/lib/libsysdecode.so.5.debug\n/usr/lib/debug/usr/lib/snmp_hostres.so.6.debug\n/usr/lib/debug/usr/lib32/libcrypto.so.8.debug\n/usr/lib/debug/usr/lib32/libmagic.so.4.debug\n/usr/lib/debug/usr/lib32/libssl.so.8.debug\n/usr/lib/debug/usr/lib32/libsysdecode.so.5.debug\n/usr/lib/debug/usr/libexec/sendmail/sendmail.debug\n/usr/lib/debug/usr/sbin/cpucontrol.debug\n/usr/lib/debug/usr/sbin/hostapd.debug\n/usr/lib/debug/usr/sbin/jail.debug\n/usr/lib/debug/usr/sbin/ntp-keygen.debug\n/usr/lib/debug/usr/sbin/ntpd.debug\n/usr/lib/debug/usr/sbin/ntpdate.debug\n/usr/lib/debug/usr/sbin/ntpdc.debug\n/usr/lib/debug/usr/sbin/ntptime.debug\n/usr/lib/debug/usr/sbin/pmcstat.debug\n/usr/lib/debug/usr/sbin/sntp.debug\n/usr/lib/debug/usr/sbin/sshd.debug\n/usr/lib/debug/usr/sbin/wpa_supplicant.debug\n/usr/lib/libcrypto.a\n/usr/lib/libcrypto_p.a\n/usr/lib/libkvm.a\n/usr/lib/libkvm_p.a\n/usr/lib/libmagic.a\n/usr/lib/libmagic.so.4\n/usr/lib/libmagic_p.a\n/usr/lib/libprocstat.a\n/usr/lib/libprocstat.so.1\n/usr/lib/libprocstat_p.a\n/usr/lib/librtld_db.so.2\n/usr/lib/libssl.a\n/usr/lib/libssl.so.8\n/usr/lib/libssl_p.a\n/usr/lib/libsysdecode.a\n/usr/lib/libsysdecode.so.5\n/usr/lib/libsysdecode_p.a\n/usr/lib/snmp_hostres.so.6\n/usr/lib32/libcrypto.a\n/usr/lib32/libcrypto.so.8\n/usr/lib32/libcrypto_p.a\n/usr/lib32/libmagic.a\n/usr/lib32/libmagic.so.4\n/usr/lib32/libmagic_p.a\n/usr/lib32/libssl.a\n/usr/lib32/libssl.so.8\n/usr/lib32/libssl_p.a\n/usr/lib32/libsysdecode.a\n/usr/lib32/libsysdecode.so.5\n/usr/lib32/libsysdecode_p.a\n/usr/libexec/sendmail/sendmail\n/usr/sbin/cpucontrol\n/usr/sbin/hostapd\n/usr/sbin/jail\n/usr/sbin/ntp-keygen\n/usr/sbin/ntpd\n/usr/sbin/ntpdate\n/usr/sbin/ntpdc\n/usr/sbin/ntptime\n/usr/sbin/pmcstat\n/usr/sbin/sntp\n/usr/sbin/sshd\n/usr/sbin/wpa_supplicant\n/usr/share/doc/ntp/access.html\n/usr/share/doc/ntp/accopt.html\n/usr/share/doc/ntp/authentic.html\n/usr/share/doc/ntp/drivers/driver18.html\n/usr/share/doc/ntp/drivers/driver40.html\n/usr/share/doc/ntp/keygen.html\n/usr/share/doc/ntp/miscopt.html\n/usr/share/doc/ntp/monopt.html\n/usr/share/doc/ntp/ntp-keygen.html\n/usr/share/doc/ntp/ntp.conf.html\n/usr/share/doc/ntp/ntp.keys.html\n/usr/share/doc/ntp/ntpq.html\n/usr/share/doc/ntp/ntpsnmpd.html\n/usr/share/man/man1/file.1.gz\n/usr/share/man/man3/libmagic.3.gz\n/usr/share/man/man5/magic.5.gz\n/usr/share/man/man5/ntp.conf.5.gz\n/usr/share/man/man5/ntp.keys.5.gz\n/usr/share/man/man8/cpucontrol.8.gz\n/usr/share/man/man8/ntp-keygen.8.gz\n/usr/share/man/man8/ntpd.8.gz\n/usr/share/man/man8/ntpdc.8.gz\n/usr/share/man/man8/ntpq.8.gz\n/usr/share/man/man8/sntp.8.gz\n/usr/share/man/mandoc.db\n/usr/share/misc/magic\n/usr/share/misc/magic.mgc\n/usr/share/zoneinfo/Africa/Bissau\n/usr/share/zoneinfo/Africa/Juba\n/usr/share/zoneinfo/Africa/Khartoum\n/usr/share/zoneinfo/Africa/Sao_Tome\n/usr/share/zoneinfo/Africa/Windhoek\n/usr/share/zoneinfo/America/Adak\n/usr/share/zoneinfo/America/Anchorage\n/usr/share/zoneinfo/America/Campo_Grande\n/usr/share/zoneinfo/America/Cuiaba\n/usr/share/zoneinfo/America/Detroit\n/usr/share/zoneinfo/America/Grand_Turk\n/usr/share/zoneinfo/America/Jamaica\n/usr/share/zoneinfo/America/Juneau\n/usr/share/zoneinfo/America/La_Paz\n/usr/share/zoneinfo/America/Metlakatla\n/usr/share/zoneinfo/America/Montevideo\n/usr/share/zoneinfo/America/Nome\n/usr/share/zoneinfo/America/Sao_Paulo\n/usr/share/zoneinfo/America/Sitka\n/usr/share/zoneinfo/America/Yakutat\n/usr/share/zoneinfo/Antarctica/Casey\n/usr/share/zoneinfo/Asia/Famagusta\n/usr/share/zoneinfo/Asia/Gaza\n/usr/share/zoneinfo/Asia/Hebron\n/usr/share/zoneinfo/Asia/Kolkata\n/usr/share/zoneinfo/Asia/Macau\n/usr/share/zoneinfo/Asia/Pyongyang\n/usr/share/zoneinfo/Asia/Tokyo\n/usr/share/zoneinfo/Asia/Yangon\n/usr/share/zoneinfo/Asia/Yerevan\n/usr/share/zoneinfo/Atlantic/Azores\n/usr/share/zoneinfo/Atlantic/Cape_Verde\n/usr/share/zoneinfo/Atlantic/Madeira\n/usr/share/zoneinfo/Europe/Bratislava\n/usr/share/zoneinfo/Europe/Dublin\n/usr/share/zoneinfo/Europe/Lisbon\n/usr/share/zoneinfo/Europe/Prague\n/usr/share/zoneinfo/Pacific/Apia\n/usr/share/zoneinfo/Pacific/Enderbury\n/usr/share/zoneinfo/Pacific/Fiji\n/usr/share/zoneinfo/Pacific/Kiritimati\n/usr/share/zoneinfo/Pacific/Midway\n/usr/share/zoneinfo/Pacific/Pago_Pago\n/usr/share/zoneinfo/Pacific/Tongatapu\n/usr/share/zoneinfo/zone.tab",
        "stdout_lines": [
            "src component not installed, skipped",
            "Looking up update.FreeBSD.org mirrors... 3 mirrors found.",
            "Fetching metadata signature for 11.1-RELEASE from update4.freebsd.org... done.",
            "Fetching metadata index... done.",
            "Inspecting system... done.",
            "Preparing to download files... done.",
            "",
            "The following files will be added as part of updating to 11.1-RELEASE-p10:",
            "/boot/kernel/crypto.ko",
            "/boot/kernel/ctl.ko",
            "/boot/kernel/cuse.ko",
            "/boot/kernel/cxgbei.ko",
            "/boot/kernel/drm.ko",
            "/boot/kernel/drm2.ko",
            "/boot/kernel/dtrace.ko",
            "/boot/kernel/efirt.ko",
            "/boot/kernel/ext2fs.ko",
            "/boot/kernel/fasttrap.ko",
            "/boot/kernel/fdescfs.ko",
            "/boot/kernel/filemon.ko",
            "/boot/kernel/firmware.ko",
            "/boot/kernel/fuse.ko",
            "/boot/kernel/geom_eli.ko",
            "/boot/kernel/geom_journal.ko",
            "/boot/kernel/geom_md.ko",
            "/boot/kernel/geom_mirror.ko",
            "/boot/kernel/geom_raid.ko",
            "/boot/kernel/geom_raid3.ko",
            "/boot/kernel/geom_sched.ko",
            "/boot/kernel/geom_uzip.ko",
            "/boot/kernel/hpt27xx.ko",
            "/boot/kernel/hptmv.ko",
            "/boot/kernel/hptnr.ko",
            "/boot/kernel/hptrr.ko",
            "/boot/kernel/hv_utils.ko",
            "/boot/kernel/hv_vmbus.ko",
            "/boot/kernel/hwpmc.ko",
            "/boot/kernel/i915.ko",
            "/boot/kernel/i915kms.ko",
            "/boot/kernel/if_an.ko",
            "/boot/kernel/if_ath.ko",
            "/boot/kernel/if_aue.ko",
            "/boot/kernel/if_axe.ko",
            "/boot/kernel/if_axge.ko",
            "/boot/kernel/if_bnxt.ko",
            "/boot/kernel/if_bridge.ko",
            "/boot/kernel/if_cas.ko",
            "/boot/kernel/if_ena.ko",
            "/boot/kernel/if_gif.ko",
            "/boot/kernel/if_gre.ko",
            "/boot/kernel/if_iwi.ko",
            "/boot/kernel/if_ix.ko",
            "/boot/kernel/if_ixl.ko",
            "/boot/kernel/if_ixlv.ko",
            "/boot/kernel/if_ixv.ko",
            "/boot/kernel/if_lagg.ko",
            "/boot/kernel/if_lmc.ko",
            "/boot/kernel/if_me.ko",
            "/boot/kernel/if_mos.ko",
            "/boot/kernel/if_ndis.ko",
            "/boot/kernel/if_nxge.ko",
            "/boot/kernel/if_qlnxe.ko",
            "/boot/kernel/if_rue.ko",
            "/boot/kernel/if_run.ko",
            "/boot/kernel/if_smsc.ko",
            "/boot/kernel/if_stf.ko",
            "/boot/kernel/if_tun.ko",
            "/boot/kernel/if_udav.ko",
            "/boot/kernel/if_ure.ko",
            "/boot/kernel/if_vlan.ko",
            "/boot/kernel/if_vxlan.ko",
            "/boot/kernel/ig4.ko",
            "/boot/kernel/ip_mroute.ko",
            "/boot/kernel/ipl.ko",
            "/boot/kernel/ipsec.ko",
            "/boot/kernel/iscsi.ko",
            "/boot/kernel/iscsi_initiator.ko",
            "/boot/kernel/ismt.ko",
            "/boot/kernel/kernel",
            "/boot/kernel/kgssapi.ko",
            "/boot/kernel/krpc.ko",
            "/boot/kernel/ksyms.ko",
            "/boot/kernel/linprocfs.ko",
            "/boot/kernel/linsysfs.ko",
            "/boot/kernel/linux.ko",
            "/boot/kernel/linux64.ko",
            "/boot/kernel/linux_common.ko",
            "/boot/kernel/linuxkpi.ko",
            "/boot/kernel/mac_biba.ko",
            "/boot/kernel/mac_lomac.ko",
            "/boot/kernel/mac_mls.ko",
            "/boot/kernel/mach64.ko",
            "/boot/kernel/mem.ko",
            "/boot/kernel/mfi.ko",
            "/boot/kernel/mga.ko",
            "/boot/kernel/mlx5.ko",
            "/boot/kernel/mlx5en.ko",
            "/boot/kernel/mpr.ko",
            "/boot/kernel/mps.ko",
            "/boot/kernel/mqueuefs.ko",
            "/boot/kernel/mrsas.ko",
            "/boot/kernel/msdosfs.ko",
            "/boot/kernel/ndis.ko",
            "/boot/kernel/netgraph.ko",
            "/boot/kernel/nfscl.ko",
            "/boot/kernel/nfscommon.ko",
            "/boot/kernel/nfsd.ko",
            "/boot/kernel/nfslock.ko",
            "/boot/kernel/nfslockd.ko",
            "/boot/kernel/nfssvc.ko",
            "/boot/kernel/ng_btsocket.ko",
            "/boot/kernel/ng_eiface.ko",
            "/boot/kernel/ng_ether.ko",
            "/boot/kernel/ng_iface.ko",
            "/boot/kernel/ng_ip_input.ko",
            "/boot/kernel/ng_ksocket.ko",
            "/boot/kernel/ng_socket.ko",
            "/boot/kernel/nullfs.ko",
            "/boot/kernel/nvme.ko",
            "/boot/kernel/opensolaris.ko",
            "/boot/kernel/padlock.ko",
            "/boot/kernel/padlock_rng.ko",
            "/boot/kernel/pf.ko",
            "/boot/kernel/pfsync.ko",
            "/boot/kernel/procfs.ko",
            "/boot/kernel/profile.ko",
            "/boot/kernel/proto.ko",
            "/boot/kernel/pseudofs.ko",
            "/boot/kernel/r128.ko",
            "/boot/kernel/radeon.ko",
            "/boot/kernel/radeonkms.ko",
            "/boot/kernel/savage.ko",
            "/boot/kernel/sem.ko",
            "/boot/kernel/sfxge.ko",
            "/boot/kernel/siftr.ko",
            "/boot/kernel/sis.ko",
            "/boot/kernel/smbfs.ko",
            "/boot/kernel/snd_hda.ko",
            "/boot/kernel/snd_sb16.ko",
            "/boot/kernel/snd_uaudio.ko",
            "/boot/kernel/sound.ko",
            "/boot/kernel/sppp.ko",
            "/boot/kernel/systrace.ko",
            "/boot/kernel/systrace_freebsd32.ko",
            "/boot/kernel/systrace_linux.ko",
            "/boot/kernel/systrace_linux32.ko",
            "/boot/kernel/sysvmsg.ko",
            "/boot/kernel/sysvsem.ko",
            "/boot/kernel/sysvshm.ko",
            "/boot/kernel/t3_tom.ko",
            "/boot/kernel/t4_tom.ko",
            "/boot/kernel/tdfx.ko",
            "/boot/kernel/tmpfs.ko",
            "/boot/kernel/udf.ko",
            "/boot/kernel/ufs.ko",
            "/boot/kernel/uinput.ko",
            "/boot/kernel/ukbd.ko",
            "/boot/kernel/unionfs.ko",
            "/boot/kernel/usb.ko",
            "/boot/kernel/usb_quirk.ko",
            "/boot/kernel/via.ko",
            "/boot/kernel/virtio_balloon.ko",
            "/boot/kernel/vmm.ko",
            "/boot/kernel/vxge.ko",
            "/boot/kernel/wlan.ko",
            "/boot/kernel/zfs.ko",
            "/lib/libcrypto.so.8",
            "/lib/libkvm.so.7",
            "/lib/libutil.so.9",
            "/rescue/[",
            "/rescue/atmconfig",
            "/rescue/badsect",
            "/rescue/bsdlabel",
            "/rescue/bunzip2",
            "/rescue/bzcat",
            "/rescue/bzip2",
            "/rescue/camcontrol",
            "/rescue/cat",
            "/rescue/ccdconfig",
            "/rescue/chflags",
            "/rescue/chgrp",
            "/rescue/chio",
            "/rescue/chmod",
            "/rescue/chown",
            "/rescue/chroot",
            "/rescue/clri",
            "/rescue/cp",
            "/rescue/csh",
            "/rescue/date",
            "/rescue/dd",
            "/rescue/devfs",
            "/rescue/df",
            "/rescue/dhclient",
            "/rescue/disklabel",
            "/rescue/dmesg",
            "/rescue/dump",
            "/rescue/dumpfs",
            "/rescue/dumpon",
            "/rescue/echo",
            "/rescue/ed",
            "/rescue/ex",
            "/rescue/expr",
            "/rescue/fastboot",
            "/rescue/fasthalt",
            "/rescue/fdisk",
            "/rescue/fsck",
            "/rescue/fsck_4.2bsd",
            "/rescue/fsck_ffs",
            "/rescue/fsck_msdosfs",
            "/rescue/fsck_ufs",
            "/rescue/fsdb",
            "/rescue/fsirand",
            "/rescue/gbde",
            "/rescue/geom",
            "/rescue/getfacl",
            "/rescue/glabel",
            "/rescue/gpart",
            "/rescue/groups",
            "/rescue/gunzip",
            "/rescue/gzcat",
            "/rescue/gzip",
            "/rescue/halt",
            "/rescue/head",
            "/rescue/hostname",
            "/rescue/id",
            "/rescue/ifconfig",
            "/rescue/init",
            "/rescue/ipf",
            "/rescue/iscsictl",
            "/rescue/iscsid",
            "/rescue/kenv",
            "/rescue/kill",
            "/rescue/kldconfig",
            "/rescue/kldload",
            "/rescue/kldstat",
            "/rescue/kldunload",
            "/rescue/ldconfig",
            "/rescue/less",
            "/rescue/link",
            "/rescue/ln",
            "/rescue/ls",
            "/rescue/lzcat",
            "/rescue/lzma",
            "/rescue/md5",
            "/rescue/mdconfig",
            "/rescue/mdmfs",
            "/rescue/mkdir",
            "/rescue/mknod",
            "/rescue/more",
            "/rescue/mount",
            "/rescue/mount_cd9660",
            "/rescue/mount_msdosfs",
            "/rescue/mount_nfs",
            "/rescue/mount_nullfs",
            "/rescue/mount_udf",
            "/rescue/mount_unionfs",
            "/rescue/mt",
            "/rescue/mv",
            "/rescue/nc",
            "/rescue/newfs",
            "/rescue/newfs_msdos",
            "/rescue/nos-tun",
            "/rescue/pgrep",
            "/rescue/ping",
            "/rescue/ping6",
            "/rescue/pkill",
            "/rescue/poweroff",
            "/rescue/ps",
            "/rescue/pwd",
            "/rescue/rcorder",
            "/rescue/rcp",
            "/rescue/rdump",
            "/rescue/realpath",
            "/rescue/reboot",
            "/rescue/red",
            "/rescue/rescue",
            "/rescue/restore",
            "/rescue/rm",
            "/rescue/rmdir",
            "/rescue/route",
            "/rescue/routed",
            "/rescue/rrestore",
            "/rescue/rtquery",
            "/rescue/rtsol",
            "/rescue/savecore",
            "/rescue/sed",
            "/rescue/setfacl",
            "/rescue/sh",
            "/rescue/shutdown",
            "/rescue/sleep",
            "/rescue/spppcontrol",
            "/rescue/stty",
            "/rescue/swapon",
            "/rescue/sync",
            "/rescue/sysctl",
            "/rescue/tail",
            "/rescue/tar",
            "/rescue/tcsh",
            "/rescue/tee",
            "/rescue/test",
            "/rescue/tunefs",
            "/rescue/umount",
            "/rescue/unlink",
            "/rescue/unlzma",
            "/rescue/unxz",
            "/rescue/vi",
            "/rescue/whoami",
            "/rescue/xz",
            "/rescue/xzcat",
            "/rescue/zcat",
            "/rescue/zdb",
            "/rescue/zfs",
            "/rescue/zpool",
            "/sbin/ipresend",
            "/usr/bin/file",
            "/usr/bin/fstat",
            "/usr/bin/fuser",
            "/usr/bin/gcore",
            "/usr/bin/kdump",
            "/usr/bin/kgdb",
            "/usr/bin/killall",
            "/usr/bin/limits",
            "/usr/bin/netstat",
            "/usr/bin/ntpq",
            "/usr/bin/openssl",
            "/usr/bin/procstat",
            "/usr/bin/sockstat",
            "/usr/bin/systat",
            "/usr/bin/top",
            "/usr/bin/truss",
            "/usr/bin/uptime",
            "/usr/bin/vmstat",
            "/usr/bin/w",
            "/usr/include/machine/asmacros.h",
            "/usr/include/machine/frame.h",
            "/usr/include/machine/intr_machdep.h",
            "/usr/include/machine/md_var.h",
            "/usr/include/machine/pcb.h",
            "/usr/include/machine/pcpu.h",
            "/usr/include/machine/pmap.h",
            "/usr/include/machine/smp.h",
            "/usr/include/magic.h",
            "/usr/include/openssl/ssl.h",
            "/usr/include/sys/cpuctl.h",
            "/usr/include/x86/apicvar.h",
            "/usr/include/x86/specialreg.h",
            "/usr/include/x86/x86_smp.h",
            "/usr/include/x86/x86_var.h",
            "/usr/lib/debug/bin/pkill.debug",
            "/usr/lib/debug/bin/ps.debug",
            "/usr/lib/debug/boot/kernel/aesni.ko.debug",
            "/usr/lib/debug/boot/kernel/agp.ko.debug",
            "/usr/lib/debug/boot/kernel/alq.ko.debug",
            "/usr/lib/debug/boot/kernel/aout.ko.debug",
            "/usr/lib/debug/boot/kernel/arcmsr.ko.debug",
            "/usr/lib/debug/boot/kernel/autofs.ko.debug",
            "/usr/lib/debug/boot/kernel/cam.ko.debug",
            "/usr/lib/debug/boot/kernel/cd9660.ko.debug",
            "/usr/lib/debug/boot/kernel/cloudabi.ko.debug",
            "/usr/lib/debug/boot/kernel/cloudabi32.ko.debug",
            "/usr/lib/debug/boot/kernel/cloudabi64.ko.debug",
            "/usr/lib/debug/boot/kernel/coretemp.ko.debug",
            "/usr/lib/debug/boot/kernel/cpuctl.ko.debug",
            "/usr/lib/debug/boot/kernel/cpufreq.ko.debug",
            "/usr/lib/debug/boot/kernel/crypto.ko.debug",
            "/usr/lib/debug/boot/kernel/ctl.ko.debug",
            "/usr/lib/debug/boot/kernel/cuse.ko.debug",
            "/usr/lib/debug/boot/kernel/cxgbei.ko.debug",
            "/usr/lib/debug/boot/kernel/drm.ko.debug",
            "/usr/lib/debug/boot/kernel/drm2.ko.debug",
            "/usr/lib/debug/boot/kernel/dtrace.ko.debug",
            "/usr/lib/debug/boot/kernel/efirt.ko.debug",
            "/usr/lib/debug/boot/kernel/ext2fs.ko.debug",
            "/usr/lib/debug/boot/kernel/fasttrap.ko.debug",
            "/usr/lib/debug/boot/kernel/fdescfs.ko.debug",
            "/usr/lib/debug/boot/kernel/filemon.ko.debug",
            "/usr/lib/debug/boot/kernel/firmware.ko.debug",
            "/usr/lib/debug/boot/kernel/fuse.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_eli.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_journal.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_md.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_mirror.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_raid.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_raid3.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_sched.ko.debug",
            "/usr/lib/debug/boot/kernel/geom_uzip.ko.debug",
            "/usr/lib/debug/boot/kernel/hpt27xx.ko.debug",
            "/usr/lib/debug/boot/kernel/hptmv.ko.debug",
            "/usr/lib/debug/boot/kernel/hptnr.ko.debug",
            "/usr/lib/debug/boot/kernel/hptrr.ko.debug",
            "/usr/lib/debug/boot/kernel/hv_utils.ko.debug",
            "/usr/lib/debug/boot/kernel/hv_vmbus.ko.debug",
            "/usr/lib/debug/boot/kernel/hwpmc.ko.debug",
            "/usr/lib/debug/boot/kernel/i915.ko.debug",
            "/usr/lib/debug/boot/kernel/i915kms.ko.debug",
            "/usr/lib/debug/boot/kernel/if_an.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ath.ko.debug",
            "/usr/lib/debug/boot/kernel/if_aue.ko.debug",
            "/usr/lib/debug/boot/kernel/if_axe.ko.debug",
            "/usr/lib/debug/boot/kernel/if_axge.ko.debug",
            "/usr/lib/debug/boot/kernel/if_bnxt.ko.debug",
            "/usr/lib/debug/boot/kernel/if_bridge.ko.debug",
            "/usr/lib/debug/boot/kernel/if_cas.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ena.ko.debug",
            "/usr/lib/debug/boot/kernel/if_gif.ko.debug",
            "/usr/lib/debug/boot/kernel/if_gre.ko.debug",
            "/usr/lib/debug/boot/kernel/if_iwi.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ix.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ixl.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ixlv.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ixv.ko.debug",
            "/usr/lib/debug/boot/kernel/if_lagg.ko.debug",
            "/usr/lib/debug/boot/kernel/if_lmc.ko.debug",
            "/usr/lib/debug/boot/kernel/if_me.ko.debug",
            "/usr/lib/debug/boot/kernel/if_mos.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ndis.ko.debug",
            "/usr/lib/debug/boot/kernel/if_nxge.ko.debug",
            "/usr/lib/debug/boot/kernel/if_qlnxe.ko.debug",
            "/usr/lib/debug/boot/kernel/if_rue.ko.debug",
            "/usr/lib/debug/boot/kernel/if_run.ko.debug",
            "/usr/lib/debug/boot/kernel/if_smsc.ko.debug",
            "/usr/lib/debug/boot/kernel/if_stf.ko.debug",
            "/usr/lib/debug/boot/kernel/if_tun.ko.debug",
            "/usr/lib/debug/boot/kernel/if_udav.ko.debug",
            "/usr/lib/debug/boot/kernel/if_ure.ko.debug",
            "/usr/lib/debug/boot/kernel/if_vlan.ko.debug",
            "/usr/lib/debug/boot/kernel/if_vxlan.ko.debug",
            "/usr/lib/debug/boot/kernel/ig4.ko.debug",
            "/usr/lib/debug/boot/kernel/ip_mroute.ko.debug",
            "/usr/lib/debug/boot/kernel/ipl.ko.debug",
            "/usr/lib/debug/boot/kernel/ipsec.ko.debug",
            "/usr/lib/debug/boot/kernel/iscsi.ko.debug",
            "/usr/lib/debug/boot/kernel/iscsi_initiator.ko.debug",
            "/usr/lib/debug/boot/kernel/ismt.ko.debug",
            "/usr/lib/debug/boot/kernel/kernel.debug",
            "/usr/lib/debug/boot/kernel/kgssapi.ko.debug",
            "/usr/lib/debug/boot/kernel/krpc.ko.debug",
            "/usr/lib/debug/boot/kernel/ksyms.ko.debug",
            "/usr/lib/debug/boot/kernel/linprocfs.ko.debug",
            "/usr/lib/debug/boot/kernel/linsysfs.ko.debug",
            "/usr/lib/debug/boot/kernel/linux.ko.debug",
            "/usr/lib/debug/boot/kernel/linux64.ko.debug",
            "/usr/lib/debug/boot/kernel/linux_common.ko.debug",
            "/usr/lib/debug/boot/kernel/linuxkpi.ko.debug",
            "/usr/lib/debug/boot/kernel/mac_biba.ko.debug",
            "/usr/lib/debug/boot/kernel/mac_lomac.ko.debug",
            "/usr/lib/debug/boot/kernel/mac_mls.ko.debug",
            "/usr/lib/debug/boot/kernel/mach64.ko.debug",
            "/usr/lib/debug/boot/kernel/mem.ko.debug",
            "/usr/lib/debug/boot/kernel/mfi.ko.debug",
            "/usr/lib/debug/boot/kernel/mga.ko.debug",
            "/usr/lib/debug/boot/kernel/mlx5.ko.debug",
            "/usr/lib/debug/boot/kernel/mlx5en.ko.debug",
            "/usr/lib/debug/boot/kernel/mpr.ko.debug",
            "/usr/lib/debug/boot/kernel/mps.ko.debug",
            "/usr/lib/debug/boot/kernel/mqueuefs.ko.debug",
            "/usr/lib/debug/boot/kernel/mrsas.ko.debug",
            "/usr/lib/debug/boot/kernel/msdosfs.ko.debug",
            "/usr/lib/debug/boot/kernel/ndis.ko.debug",
            "/usr/lib/debug/boot/kernel/netgraph.ko.debug",
            "/usr/lib/debug/boot/kernel/nfscl.ko.debug",
            "/usr/lib/debug/boot/kernel/nfscommon.ko.debug",
            "/usr/lib/debug/boot/kernel/nfsd.ko.debug",
            "/usr/lib/debug/boot/kernel/nfslock.ko.debug",
            "/usr/lib/debug/boot/kernel/nfslockd.ko.debug",
            "/usr/lib/debug/boot/kernel/nfssvc.ko.debug",
            "/usr/lib/debug/boot/kernel/ng_btsocket.ko.debug",
            "/usr/lib/debug/boot/kernel/ng_eiface.ko.debug",
            "/usr/lib/debug/boot/kernel/ng_ether.ko.debug",
            "/usr/lib/debug/boot/kernel/ng_iface.ko.debug",
            "/usr/lib/debug/boot/kernel/ng_ip_input.ko.debug",
            "/usr/lib/debug/boot/kernel/ng_ksocket.ko.debug",
            "/usr/lib/debug/boot/kernel/ng_socket.ko.debug",
            "/usr/lib/debug/boot/kernel/nullfs.ko.debug",
            "/usr/lib/debug/boot/kernel/nvme.ko.debug",
            "/usr/lib/debug/boot/kernel/opensolaris.ko.debug",
            "/usr/lib/debug/boot/kernel/padlock.ko.debug",
            "/usr/lib/debug/boot/kernel/padlock_rng.ko.debug",
            "/usr/lib/debug/boot/kernel/pf.ko.debug",
            "/usr/lib/debug/boot/kernel/pfsync.ko.debug",
            "/usr/lib/debug/boot/kernel/procfs.ko.debug",
            "/usr/lib/debug/boot/kernel/profile.ko.debug",
            "/usr/lib/debug/boot/kernel/proto.ko.debug",
            "/usr/lib/debug/boot/kernel/pseudofs.ko.debug",
            "/usr/lib/debug/boot/kernel/r128.ko.debug",
            "/usr/lib/debug/boot/kernel/radeon.ko.debug",
            "/usr/lib/debug/boot/kernel/radeonkms.ko.debug",
            "/usr/lib/debug/boot/kernel/savage.ko.debug",
            "/usr/lib/debug/boot/kernel/sem.ko.debug",
            "/usr/lib/debug/boot/kernel/sfxge.ko.debug",
            "/usr/lib/debug/boot/kernel/siftr.ko.debug",
            "/usr/lib/debug/boot/kernel/sis.ko.debug",
            "/usr/lib/debug/boot/kernel/smbfs.ko.debug",
            "/usr/lib/debug/boot/kernel/snd_hda.ko.debug",
            "/usr/lib/debug/boot/kernel/snd_sb16.ko.debug",
            "/usr/lib/debug/boot/kernel/snd_uaudio.ko.debug",
            "/usr/lib/debug/boot/kernel/sound.ko.debug",
            "/usr/lib/debug/boot/kernel/sppp.ko.debug",
            "/usr/lib/debug/boot/kernel/systrace.ko.debug",
            "/usr/lib/debug/boot/kernel/systrace_freebsd32.ko.debug",
            "/usr/lib/debug/boot/kernel/systrace_linux.ko.debug",
            "/usr/lib/debug/boot/kernel/systrace_linux32.ko.debug",
            "/usr/lib/debug/boot/kernel/sysvmsg.ko.debug",
            "/usr/lib/debug/boot/kernel/sysvsem.ko.debug",
            "/usr/lib/debug/boot/kernel/sysvshm.ko.debug",
            "/usr/lib/debug/boot/kernel/t3_tom.ko.debug",
            "/usr/lib/debug/boot/kernel/t4_tom.ko.debug",
            "/usr/lib/debug/boot/kernel/tdfx.ko.debug",
            "/usr/lib/debug/boot/kernel/tmpfs.ko.debug",
            "/usr/lib/debug/boot/kernel/udf.ko.debug",
            "/usr/lib/debug/boot/kernel/ufs.ko.debug",
            "/usr/lib/debug/boot/kernel/uinput.ko.debug",
            "/usr/lib/debug/boot/kernel/ukbd.ko.debug",
            "/usr/lib/debug/boot/kernel/unionfs.ko.debug",
            "/usr/lib/debug/boot/kernel/usb.ko.debug",
            "/usr/lib/debug/boot/kernel/usb_quirk.ko.debug",
            "/usr/lib/debug/boot/kernel/via.ko.debug",
            "/usr/lib/debug/boot/kernel/virtio_balloon.ko.debug",
            "/usr/lib/debug/boot/kernel/vmm.ko.debug",
            "/usr/lib/debug/boot/kernel/vxge.ko.debug",
            "/usr/lib/debug/boot/kernel/wlan.ko.debug",
            "/usr/lib/debug/boot/kernel/zfs.ko.debug",
            "/usr/lib/debug/lib/libcrypto.so.8.debug",
            "/usr/lib/debug/lib/libkvm.so.7.debug",
            "/usr/lib/debug/lib/libutil.so.9.debug",
            "/usr/lib/debug/sbin/ipresend.debug",
            "/usr/lib/debug/usr/bin/file.debug",
            "/usr/lib/debug/usr/bin/fstat.debug",
            "/usr/lib/debug/usr/bin/gcore.debug",
            "/usr/lib/debug/usr/bin/kdump.debug",
            "/usr/lib/debug/usr/bin/kgdb.debug",
            "/usr/lib/debug/usr/bin/killall.debug",
            "/usr/lib/debug/usr/bin/limits.debug",
            "/usr/lib/debug/usr/bin/netstat.debug",
            "/usr/lib/debug/usr/bin/ntpq.debug",
            "/usr/lib/debug/usr/bin/openssl.debug",
            "/usr/lib/debug/usr/bin/procstat.debug",
            "/usr/lib/debug/usr/bin/sockstat.debug",
            "/usr/lib/debug/usr/bin/systat.debug",
            "/usr/lib/debug/usr/bin/top.debug",
            "/usr/lib/debug/usr/bin/truss.debug",
            "/usr/lib/debug/usr/bin/vmstat.debug",
            "/usr/lib/debug/usr/bin/w.debug",
            "/usr/lib/debug/usr/lib/libmagic.so.4.debug",
            "/usr/lib/debug/usr/lib/libprocstat.so.1.debug",
            "/usr/lib/debug/usr/lib/librtld_db.so.2.debug",
            "/usr/lib/debug/usr/lib/libssl.so.8.debug",
            "/usr/lib/debug/usr/lib/libsysdecode.so.5.debug",
            "/usr/lib/debug/usr/lib/snmp_hostres.so.6.debug",
            "/usr/lib/debug/usr/lib32/libcrypto.so.8.debug",
            "/usr/lib/debug/usr/lib32/libmagic.so.4.debug",
            "/usr/lib/debug/usr/lib32/libssl.so.8.debug",
            "/usr/lib/debug/usr/lib32/libsysdecode.so.5.debug",
            "/usr/lib/debug/usr/libexec/sendmail/sendmail.debug",
            "/usr/lib/debug/usr/sbin/cpucontrol.debug",
            "/usr/lib/debug/usr/sbin/hostapd.debug",
            "/usr/lib/debug/usr/sbin/jail.debug",
            "/usr/lib/debug/usr/sbin/ntp-keygen.debug",
            "/usr/lib/debug/usr/sbin/ntpd.debug",
            "/usr/lib/debug/usr/sbin/ntpdate.debug",
            "/usr/lib/debug/usr/sbin/ntpdc.debug",
            "/usr/lib/debug/usr/sbin/ntptime.debug",
            "/usr/lib/debug/usr/sbin/pmcstat.debug",
            "/usr/lib/debug/usr/sbin/sntp.debug",
            "/usr/lib/debug/usr/sbin/sshd.debug",
            "/usr/lib/debug/usr/sbin/wpa_supplicant.debug",
            "/usr/lib/libcrypto.a",
            "/usr/lib/libcrypto_p.a",
            "/usr/lib/libkvm.a",
            "/usr/lib/libkvm_p.a",
            "/usr/lib/libmagic.a",
            "/usr/lib/libmagic.so.4",
            "/usr/lib/libmagic_p.a",
            "/usr/lib/libprocstat.a",
            "/usr/lib/libprocstat.so.1",
            "/usr/lib/libprocstat_p.a",
            "/usr/lib/librtld_db.so.2",
            "/usr/lib/libssl.a",
            "/usr/lib/libssl.so.8",
            "/usr/lib/libssl_p.a",
            "/usr/lib/libsysdecode.a",
            "/usr/lib/libsysdecode.so.5",
            "/usr/lib/libsysdecode_p.a",
            "/usr/lib/snmp_hostres.so.6",
            "/usr/lib32/libcrypto.a",
            "/usr/lib32/libcrypto.so.8",
            "/usr/lib32/libcrypto_p.a",
            "/usr/lib32/libmagic.a",
            "/usr/lib32/libmagic.so.4",
            "/usr/lib32/libmagic_p.a",
            "/usr/lib32/libssl.a",
            "/usr/lib32/libssl.so.8",
            "/usr/lib32/libssl_p.a",
            "/usr/lib32/libsysdecode.a",
            "/usr/lib32/libsysdecode.so.5",
            "/usr/lib32/libsysdecode_p.a",
            "/usr/libexec/sendmail/sendmail",
            "/usr/sbin/cpucontrol",
            "/usr/sbin/hostapd",
            "/usr/sbin/jail",
            "/usr/sbin/ntp-keygen",
            "/usr/sbin/ntpd",
            "/usr/sbin/ntpdate",
            "/usr/sbin/ntpdc",
            "/usr/sbin/ntptime",
            "/usr/sbin/pmcstat",
            "/usr/sbin/sntp",
            "/usr/sbin/sshd",
            "/usr/sbin/wpa_supplicant",
            "/usr/share/doc/ntp/access.html",
            "/usr/share/doc/ntp/accopt.html",
            "/usr/share/doc/ntp/authentic.html",
            "/usr/share/doc/ntp/drivers/driver18.html",
            "/usr/share/doc/ntp/drivers/driver40.html",
            "/usr/share/doc/ntp/keygen.html",
            "/usr/share/doc/ntp/miscopt.html",
            "/usr/share/doc/ntp/monopt.html",
            "/usr/share/doc/ntp/ntp-keygen.html",
            "/usr/share/doc/ntp/ntp.conf.html",
            "/usr/share/doc/ntp/ntp.keys.html",
            "/usr/share/doc/ntp/ntpq.html",
            "/usr/share/doc/ntp/ntpsnmpd.html",
            "/usr/share/man/man1/file.1.gz",
            "/usr/share/man/man3/libmagic.3.gz",
            "/usr/share/man/man5/magic.5.gz",
            "/usr/share/man/man5/ntp.conf.5.gz",
            "/usr/share/man/man5/ntp.keys.5.gz",
            "/usr/share/man/man8/cpucontrol.8.gz",
            "/usr/share/man/man8/ntp-keygen.8.gz",
            "/usr/share/man/man8/ntpd.8.gz",
            "/usr/share/man/man8/ntpdc.8.gz",
            "/usr/share/man/man8/ntpq.8.gz",
            "/usr/share/man/man8/sntp.8.gz",
            "/usr/share/man/mandoc.db",
            "/usr/share/misc/magic",
            "/usr/share/misc/magic.mgc",
            "/usr/share/zoneinfo/Africa/Bissau",
            "/usr/share/zoneinfo/Africa/Juba",
            "/usr/share/zoneinfo/Africa/Khartoum",
            "/usr/share/zoneinfo/Africa/Sao_Tome",
            "/usr/share/zoneinfo/Africa/Windhoek",
            "/usr/share/zoneinfo/America/Adak",
            "/usr/share/zoneinfo/America/Anchorage",
            "/usr/share/zoneinfo/America/Campo_Grande",
            "/usr/share/zoneinfo/America/Cuiaba",
            "/usr/share/zoneinfo/America/Detroit",
            "/usr/share/zoneinfo/America/Grand_Turk",
            "/usr/share/zoneinfo/America/Jamaica",
            "/usr/share/zoneinfo/America/Juneau",
            "/usr/share/zoneinfo/America/La_Paz",
            "/usr/share/zoneinfo/America/Metlakatla",
            "/usr/share/zoneinfo/America/Montevideo",
            "/usr/share/zoneinfo/America/Nome",
            "/usr/share/zoneinfo/America/Sao_Paulo",
            "/usr/share/zoneinfo/America/Sitka",
            "/usr/share/zoneinfo/America/Yakutat",
            "/usr/share/zoneinfo/Antarctica/Casey",
            "/usr/share/zoneinfo/Asia/Famagusta",
            "/usr/share/zoneinfo/Asia/Gaza",
            "/usr/share/zoneinfo/Asia/Hebron",
            "/usr/share/zoneinfo/Asia/Kolkata",
            "/usr/share/zoneinfo/Asia/Macau",
            "/usr/share/zoneinfo/Asia/Pyongyang",
            "/usr/share/zoneinfo/Asia/Tokyo",
            "/usr/share/zoneinfo/Asia/Yangon",
            "/usr/share/zoneinfo/Asia/Yerevan",
            "/usr/share/zoneinfo/Atlantic/Azores",
            "/usr/share/zoneinfo/Atlantic/Cape_Verde",
            "/usr/share/zoneinfo/Atlantic/Madeira",
            "/usr/share/zoneinfo/Europe/Bratislava",
            "/usr/share/zoneinfo/Europe/Dublin",
            "/usr/share/zoneinfo/Europe/Lisbon",
            "/usr/share/zoneinfo/Europe/Prague",
            "/usr/share/zoneinfo/Pacific/Apia",
            "/usr/share/zoneinfo/Pacific/Enderbury",
            "/usr/share/zoneinfo/Pacific/Fiji",
            "/usr/share/zoneinfo/Pacific/Kiritimati",
            "/usr/share/zoneinfo/Pacific/Midway",
            "/usr/share/zoneinfo/Pacific/Pago_Pago",
            "/usr/share/zoneinfo/Pacific/Tongatapu",
            "/usr/share/zoneinfo/zone.tab"
        ]
    }
}

TASK [freebsd-update : Install FreeBSD updates] ****************************************************
skipping: [freebsd5]
fatal: [freebsd6]: FAILED! => {"changed": true, "cmd": ["freebsd-update", "install", "--not-running-from-cron"], "delta": "0:00:00.089303", "end": "2018-05-11 21:31:49.372977", "msg": "non-zero return code", "rc": 1, "start": "2018-05-11 21:31:49.283674", "stderr": "", "stderr_lines": [], "stdout": "src component not installed, skipped\nNo updates are available to install.\nRun '/usr/sbin/freebsd-update fetch' first.", "stdout_lines": ["src component not installed, skipped", "No updates are available to install.", "Run '/usr/sbin/freebsd-update fetch' first."]}

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]

TASK [freebsd-update : Upgrade FreeBSD packages - dry-run] *****************************************
skipping: [freebsd5]

TASK [freebsd-update : Upgrade FreeBSD packages] ***************************************************
ok: [freebsd5]

TASK [freebsd-update : debug] **********************************************************************
skipping: [freebsd5]

PLAY RECAP *****************************************************************************************
freebsd5                   : ok=4    changed=0    unreachable=0    failed=0   
freebsd6                   : ok=4    changed=1    unreachable=0    failed=1   
ubuntu1                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu2                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu3                    : ok=2    changed=0    unreachable=0    failed=0   
ubuntu4                    : ok=2    changed=0    unreachable=0    failed=0

The upgrade seemed to get further, I'm not sure why. But it still reports a failure.

I ran ansible-playbook os_upgrade.yml again after the failure above and it seems to success.

Finally finished without error.

x-post: https://github.com/stationgroup/ansible-experiments/pull/3 https://github.com/stationgroup/ansible-experiments/issues/4 https://github.com/stationgroup/ansible-experiments/issues/1

reelsense commented 6 years ago

⚠️ MOVED TO #4

srgvg commented 6 years ago

The provisioning problem I mentioned: A clean Vagrant up ends at the ubuntu3 node:

==> ubuntu3: Checking for guest additions in VM...
    ubuntu3: The guest additions on this VM do not match the installed version of
    ubuntu3: VirtualBox! In most cases this is fine, but in rare cases it can
    ubuntu3: prevent things such as shared folders from working properly. If you see
    ubuntu3: shared folder errors, please make sure the guest additions within the
    ubuntu3: virtual machine match the version of VirtualBox you have installed on
    ubuntu3: your host and reload your VM.
    ubuntu3: 
    ubuntu3: Guest Additions Version: 5.2.10
    ubuntu3: VirtualBox Version: 5.1
==> ubuntu3: Setting hostname...
==> ubuntu3: Configuring and enabling network interfaces...
The following SSH command responded with a non-zero exit status.
Vagrant assumes that this means the command failed!

/sbin/ifdown 'enp0s8' || true
/sbin/ip addr flush dev 'enp0s8'
# Remove any previous network modifications from the interfaces file
sed -e '/^#VAGRANT-BEGIN/,$ d' /etc/network/interfaces > /tmp/vagrant-network-interfaces.pre
sed -ne '/^#VAGRANT-END/,$ p' /etc/network/interfaces | tac | sed -e '/^#VAGRANT-END/,$ d' | tac > /tmp/vagrant-network-interfaces.post

cat \
  /tmp/vagrant-network-interfaces.pre \
  /tmp/vagrant-network-entry \
  /tmp/vagrant-network-interfaces.post \
  > /etc/network/interfaces

rm -f /tmp/vagrant-network-interfaces.pre
rm -f /tmp/vagrant-network-entry
rm -f /tmp/vagrant-network-interfaces.post

/sbin/ifup 'enp0s8'

Stdout from the command:

Stderr from the command:

mesg: ttyname failed: Inappropriate ioctl for device
bash: line 3: /sbin/ifdown: No such file or directory
bash: line 19: /sbin/ifup: No such file or directory
...

Given you don't seem to encounter this, I checked and installed the latest upstream versions of virtualbox and vagrant, and those seem to solve this.

As for the freebsd boxes, I still have got an issue that they took more time to come up, provisioning erroring on a timeout. Solved by adding freebsd5.vm.boot_timeout = 600 to the Vagrantfile.

reelsense commented 6 years ago

The long first boot on the FreeBSD VMs is from the freebsd-update install and reboot they perform after first provisioning.