[Ubuntu 20.04] ElasticSearch_install 7.5.1

[MattiZNX]

Hello guys, I'm currently trying to install ElasticSearch 7.5.1 on my cluster (that has 6.7.2 running) but I faced some problem. Even if I've setup my recipe with

elasticsearch_install 'elasticsearch' do type 'package' version '7.5.0' action :install end

During the install I receive a really bad log (that we can summarize on a HTTP 404), sorry for long log trace

Running Chef on 10.0.1.5...
Installing Berkshelf cookbooks to 'cookbooks'...
Resolving cookbook dependencies...
Fetching 'sab-elasticsearch' from source at site-cookbooks/sab-elasticsearch
Using apt (7.1.1)
Using ark (4.0.0)
Using build-essential (8.2.1)
Using chef-sugar (5.0.1)
Using elasticsearch (4.0.5)
Using homebrew (5.0.8)
Using java (3.2.1)
Using mingw (2.1.0)
Using sab-elasticsearch (1.0.0) from source at site-cookbooks/sab-elasticsearch
Using seven_zip (3.1.0)
Using windows (5.3.0)
Using yum (5.1.0)
Vendoring apt (7.1.1) to cookbooks/apt
Vendoring ark (4.0.0) to cookbooks/ark
Vendoring build-essential (8.2.1) to cookbooks/build-essential
Vendoring chef-sugar (5.0.1) to cookbooks/chef-sugar
Vendoring elasticsearch (4.0.5) to cookbooks/elasticsearch
Vendoring homebrew (5.0.8) to cookbooks/homebrew
Vendoring java (3.2.1) to cookbooks/java
Vendoring mingw (2.1.0) to cookbooks/mingw
Vendoring sab-elasticsearch (1.0.0) to cookbooks/sab-elasticsearch
Vendoring seven_zip (3.1.0) to cookbooks/seven_zip
Vendoring windows (5.3.0) to cookbooks/windows
Vendoring yum (5.1.0) to cookbooks/yum
Uploading the kitchen...
Generating solo config...
Running Chef: sudo chef-solo -c ~/chef-solo/solo.rb -j ~/chef-solo/dna.json
Starting Chef Client, version 14.15.6
resolving cookbooks for run list: ["sab-elasticsearch"]
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
[2021-10-21T10:07:33+00:00] WARN: Child with name 'sab-elasticsearch' found in multiple directories: /home/elsadmin/chef-solo/cookbooks-2/sab-elasticsearch and /home/elsadmin/chef-solo/cookbooks-3/sab-elasticsearch
Synchronizing Cookbooks:
  - apt (7.1.1)
  - sab-elasticsearch (1.0.0)
  - java (3.2.1)
  - yum (5.1.0)
  - elasticsearch (4.0.5)
  - windows (5.3.0)
  - homebrew (5.0.8)
  - chef-sugar (5.0.1)
  - build-essential (8.2.1)
  - seven_zip (3.1.0)
  - ark (4.0.0)
  - mingw (2.1.0)
Installing Cookbook Gems:
Compiling Cookbooks...
Converging 23 resources
Recipe: apt::default
  * file[/var/lib/apt/periodic/update-success-stamp] action nothing (skipped due to action :nothing)
  * apt_update[periodic] action periodic (up to date)
  * execute[apt-get update] action nothing (skipped due to action :nothing)
  * execute[apt-get autoremove] action nothing (skipped due to action :nothing)
  * execute[apt-get autoclean] action nothing (skipped due to action :nothing)
  * directory[/var/cache/local] action create (up to date)
  * directory[/var/cache/local/preseeding] action create (up to date)
  * template[/etc/apt/apt.conf.d/10dpkg-options] action create (up to date)
  * template[/etc/apt/apt.conf.d/10recommends] action create (up to date)
  * apt_package[apt-transport-https, gnupg, dirmngr] action install (up to date)
Recipe: java::notify
  * log[jdk-version-changed] action nothing (skipped due to action :nothing)
Recipe: java::openjdk
  * apt_repository[openjdk-r-ppa] action add
    * execute[apt-cache gencaches] action nothing (skipped due to action :nothing)
    * apt_update[openjdk-r-ppa] action nothing (skipped due to action :nothing)
    * execute[install-key DA1A4A13543B466853BAF164EB9B1D8886F44E2A] action run (skipped due to not_if)
    * file[/etc/apt/sources.list.d/openjdk-r-ppa.list] action create (up to date)
     (up to date)
  * apt_package[openjdk-11-jdk, openjdk-11-jre-headless] action install (up to date)
  * java_alternatives[set-java-alternatives] action set (up to date)
Recipe: java::default_java_symlink
  * link[/usr/lib/jvm/default-java] action create (up to date)
Recipe: java::set_java_home
  * directory[/etc/profile.d] action create (up to date)
  * template[/etc/profile.d/jdk.sh] action create (up to date)
Recipe: sab-elasticsearch::elasticsearch
  * elasticsearch_user[elasticsearch] action create
    * group[elasticsearch] action create (up to date)
    * linux_user[elasticsearch] action create (up to date)
     (up to date)
  * group[elasticsearch] action nothing (skipped due to action :nothing)
  * linux_user[elasticsearch] action nothing (skipped due to action :nothing)
  * directory[/media/datadrive0] action create (up to date)
  * elasticsearch_install[elasticsearch] action install[2021-10-21T10:07:37+00:00] WARN: No checksum was provided for https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.5.0.deb, this may download a new package on every chef run!

    * remote_file[/home/elsadmin/chef-solo/local-mode-cache/cache/elasticsearch-7.5.0.deb] action create[2021-10-21T10:07:37+00:00] WARN: remote_file[/home/elsadmin/chef-solo/local-mode-cache/cache/elasticsearch-7.5.0.deb] cannot be downloaded from https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.5.0.deb: 404 "Not Found"

      ================================================================================
      Error executing action `create` on resource 'remote_file[/home/elsadmin/chef-solo/local-mode-cache/cache/elasticsearch-7.5.0.deb]'
      ================================================================================

      Net::HTTPServerException
      ------------------------
      404 "Not Found"

      Cookbook Trace:
      ---------------
      /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb:119:in `install_package_wrapper_action'
      /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb:16:in `action_install'

      Resource Declaration:
      ---------------------
      # In /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb

      113:     remote_file_r = remote_file "#{Chef::Config[:file_cache_path]}/#{filename}" do
      114:       source found_download_url
      115:       checksum checksum
      116:       mode '0644'
      117:       action :nothing
      118:     end
      119:     remote_file_r.run_action(:create)

      Compiled Resource:
      ------------------
      # Declared in /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb:113:in `install_package_wrapper_action'

      remote_file("/home/elsadmin/chef-solo/local-mode-cache/cache/elasticsearch-7.5.0.deb") do
        action [:nothing]
        default_guard_interpreter :default
        source ["https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.5.0.deb"]
        declared_type :remote_file
        cookbook_name "sab-elasticsearch"
        checksum nil
        mode "0644"
        remote_domain nil
        remote_user nil
        path "/home/elsadmin/chef-solo/local-mode-cache/cache/elasticsearch-7.5.0.deb"
        owner nil
        group nil
        headers {}
        verifications []
      end

      System Info:
      ------------
      chef_version=14.15.6
      platform=ubuntu
      platform_version=20.04
      ruby=ruby 2.5.8p224 (2020-03-31 revision 67882) [x86_64-linux]
      program_name=/usr/bin/chef-solo
      executable=/opt/chef/bin/chef-solo

    ================================================================================
    Error executing action `install` on resource 'elasticsearch_install[elasticsearch]'
    ================================================================================

    Net::HTTPServerException
    ------------------------
    remote_file[/home/elsadmin/chef-solo/local-mode-cache/cache/elasticsearch-7.5.0.deb] (/home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb line 113) had an error: Net::HTTPServerException: 404 "Not Found"

    Cookbook Trace:
    ---------------
    /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb:119:in `install_package_wrapper_action'
    /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb:16:in `action_install'

    Resource Declaration:
    ---------------------
    # In /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/sab-elasticsearch/recipes/elasticsearch.rb

     23: elasticsearch_install 'elasticsearch' do
     24:   type 'package'
     25:   version '7.5.0'
     26:   action :install
     27: end
     28:

    Compiled Resource:
    ------------------
    # Declared in /home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/sab-elasticsearch/recipes/elasticsearch.rb:23:in `from_file'

    elasticsearch_install("elasticsearch") do
      action [:install]
      default_guard_interpreter :default
      declared_type :elasticsearch_install
      cookbook_name "sab-elasticsearch"
      recipe_name "elasticsearch"
      type "package"
      version "7.5.0"
    end

    System Info:
    ------------
    chef_version=14.15.6
    platform=ubuntu
    platform_version=20.04
    ruby=ruby 2.5.8p224 (2020-03-31 revision 67882) [x86_64-linux]
    program_name=/usr/bin/chef-solo
    executable=/opt/chef/bin/chef-solo

Running handlers:
[2021-10-21T10:07:37+00:00] ERROR: Running exception handlers
Running handlers complete
[2021-10-21T10:07:37+00:00] ERROR: Exception handlers complete
Chef Client failed. 0 resources updated in 05 seconds
[2021-10-21T10:07:37+00:00] FATAL: Stacktrace dumped to /home/elsadmin/chef-solo/local-mode-cache/cache/chef-stacktrace.out
[2021-10-21T10:07:37+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2021-10-21T10:07:37+00:00] FATAL: Net::HTTPServerException: elasticsearch_install[elasticsearch] (sab-elasticsearch::elasticsearch line 23) had an error: Net::HTTPServerException: remote_file[/home/elsadmin/chef-solo/local-mode-cache/cache/elasticsearch-7.5.0.deb] (/home/elsadmin/chef-solo/local-mode-cache/cache/cookbooks/elasticsearch/libraries/provider_install.rb line 113) had an error: Net::HTTPServerException: 404 "Not Found"
ERROR: RuntimeError: chef-solo failed. See output above.
elsadmin@QESjumphostvm:~/git/ActionBoardInfrastructure/sab_elastic_config$ nano site-cookbooks/sab-elasticsearch/recipes/elasticsearch.rb

[damacus]

That looks like you're trying to download elasticsearch from an incorrect URL hence the 404. Closing as this doesn't look like a problem related to the cookbook.

If you need further assistance, please reach out on the Chef Community Slack