Corymbia / eucalyptus

Eucalyptus Cloud-computing Platform
https://eucalyptus.cloud/
Other
117 stars 22 forks source link

Issue with install 5.1 #284

Open dazza76 opened 3 years ago

dazza76 commented 3 years ago

Used fresh install minimal install of centos 7.9 no mods and ran as root bash <(curl -Ls https://get.eucalyptus.cloud) Install failed with

fatal: [host1]: FAILED! => {"attempts": 5, "changed": true, "cmd": "set -eu\neval $(clcadmin-assume-system-credentials)\nif ! euctl services.imaging.worker.image services.loadbalancing.worker.image | grep \"[ae]mi-\" ; then\n esi-install-image --force --remove-all\nfi\nesi-install-image --install-default\n", "delta": "0:00:19.340381", "end": "2021-05-13 20:40:46.944538", "failed_when_result": true, "msg": "non-zero return code", "rc": 1, "start": "2021-05-13 20:40:27.604157", "stderr": "", "stderr_lines": [], "stdout": "Checking if image 'eucalyptus-service-image-v5.0.101' is already installed...\nFound tarball /usr/share/eucalyptus/service-images/eucalyptus-service-image-5.0.101.tar.xz\nChecking env variables\nDecompressing tarball: /usr/share/eucalyptus/service-images/eucalyptus-service-image-5.0.101.tar.xz\nInstalling image from eucalyptus-service-image.raw\nBundling, uploading and registering image to bucket: eucalyptus-service-image-v5.0.101\nError: Unable to install imaging worker due to:\neuca-install-image: error (AccessDenied): Unable to parse date.", "stdout_lines": ["Checking if image 'eucalyptus-service-image-v5.0.101' is already installed...", "Found tarball /usr/share/eucalyptus/service-images/eucalyptus-service-image-5.0.101.tar.xz", "Checking env variables", "Decompressing tarball: /usr/share/eucalyptus/service-images/eucalyptus-service-image-5.0.101.tar.xz", "Installing image from eucalyptus-service-image.raw", "Bundling, uploading and registering image to bucket: eucalyptus-service-image-v5.0.101", "Error: Unable to install imaging worker due to:", "euca-install-image: error (AccessDenied): Unable to parse date."]}

Any thoughts

sjones4 commented 3 years ago

Perhaps an issue caused by the locale or timezone? if you can share any further details of the system it may allow the issue to be reproduced (e.g. ls -l /etc/localtime)

You could check if you have the expected version of euca2ools and dependencies installed:

# yum info euca2ools python-requestbuilder
...
Installed Packages
Name        : euca2ools
Arch        : noarch
Version     : 3.4.1
Release     : 1.el7
Size        : 2.4 M
Repo        : installed
From repo   : epel
Summary     : Eucalyptus/AWS-compatible command line tools
URL         : https://github.com/eucalyptus/euca2ools
License     : BSD
Description : Euca2ools are command line tools used to interact with Eucalyptus,
            : a service overlay designed to be interface-compatible with Amazon Web
            : Services (AWS), as well as AWS itself.

Name        : python-requestbuilder
Arch        : noarch
Version     : 0.7.1
Release     : 1.el7
Size        : 322 k
Repo        : installed
From repo   : epel
Summary     : Command line-driven HTTP request builder
URL         : https://github.com/boto/requestbuilder
License     : ISC
Description : Requestbuilder is a framework for creating command line tools that send
            : HTTP requests simply and quickly.

If that does not help then you could try editing the faststart generated /root/faststart_inventory.yml file and adding this to the vars section:

  cloud_service_image_rpm: no

which causes the service image to be installed in a slightly different way. You can re-run the install using something like:

ansible-playbook -i /root/faststart_inventory.yml /usr/share/eucalyptus-ansible/playbook_vpcmido.yml
dazza76 commented 3 years ago

Thanks for the response . I have done a fresh install with UTC lrwxrwxrwx. 1 root root 25 May 16 04:04 /etc/localtime -> ../usr/share/zoneinfo/UTC and also checked yum info euca2ools python-requestbuilder I have the same version as above

Hunting through the log files I have found in cloud-error.log Sun. May 16 04:18:20 2021 ERROR [S3Authentication:web-services-worker-pool-57] [com.eucalyptus.objectstorage.pipeline.auth.S3Authentication.parseDate(S3Authentication.java):239] Cannot parse date: Sun, 16 May 2021 04:18:19 -0000

Restarting eucalyptus-cloud shows May 16 04:16:50 kvm.XXX.net.au systemd[1]: Started Eucalyptus cloud web services. May 16 04:16:50 kvm.XXX.net.au eucalyptus-cloud[52754]: Starting Eucalyptus Cloud v5.1.0 May 16 04:16:52 kvm.XXX.net.au eucalyptus-cloud[52754]: WARNING: An illegal reflective access operation has occurred May 16 04:16:52 kvm.XXX.net.au eucalyptus-cloud[52754]: WARNING: Illegal reflective access by org.codehaus.groovy.vmplugin.v7.Java7$1 (file:/usr/share/eucalyptus/lib/groovy-2.5.4.jar) to constructor java.lang.invoke....lang.Class,int) May 16 04:16:52 kvm.XXX.net.au eucalyptus-cloud[52754]: WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.vmplugin.v7.Java7$1 May 16 04:16:52 kvm.XXX.net.au eucalyptus-cloud[52754]: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations May 16 04:16:52 kvm.XXX.net.au eucalyptus-cloud[52754]: WARNING: All illegal access operations will be denied in a future release

and debug shows

n. May 16 04:43:14 2021 WARN [Topology:eucalyptus-bootstrap-ephemeralconfiguration-bootstrap-topology-external-worker-73] START:DISABLED arn:euca:bootstrap:api.10.0.0.20:loadbalancing:api.10.0.0.20.loadbalancing/ NOTREADY->DISABLED=NOTREADY [LoadBalancingServiceBootstrapper.enable( ): returned false, terminating bootstrap for component: loadbalancing]

Sun. May 16 04:43:14 2021 WARN [Topology:eucalyptus-bootstrap-ephemeralconfiguration-bootstrap-topology-external-worker-74] START:DISABLED arn:euca:eucalyptus::imagingbackend:10.0.0.20/ NOTREADY->DISABLED=NOTREADY [ImagingBackendServicePropertyBootstrapper.enable( ): returned false, terminating bootstrap for component: imagingbackend]

sjones4 commented 3 years ago

Here is what is seen during a successful s3 interaction:

2021-05-16 15:37:09,363 DEBUG   S3 request  header: Date: Sun, 16 May 2021 22:37:09 -0000

so it is not clear why you see issues with the same date format.

You could check the java version:

# /usr/lib/jvm/jre-11/bin/java -version
openjdk version "11.0.11" 2021-04-20 LTS
OpenJDK Runtime Environment 18.9 (build 11.0.11+9-LTS)
OpenJDK 64-Bit Server VM 18.9 (build 11.0.11+9-LTS, mixed mode, sharing)

and the locale:

# cat /etc/locale.conf 
LANG="en_US.UTF-8"

You could run this for a quick test with full client debug output to see if that shows any further details around the issue:

# eval $(clcadmin-assume-system-credentials)
# head -c 20000000 /dev/urandom > random.dat
# euca-install-image  -n fake --virtualization-type hvm -i random.dat -r x86_64 -b fake-image --debug

if that is successful you can deregister the ami and delete the bucket:

# eval $(euca-generate-environment-config)
# euca-deregister ami-....
# aws --endpoint $S3_URL s3 rb --force s3://fake-image/