search

wazuh / wazuh-qa

Wazuh - Quality Assurance
GNU General Public License v2.0
63 stars 30 forks source link

Investigate and document tests - Stress test #4276

Closed verdx closed 7 months ago

verdx commented 1 year ago
Parent issue https://github.com/wazuh/wazuh-qa/issues/4241
Pipeline state :yellow_circle:
Tests state :green_circle:
Jenkins links https://ci.wazuh.info/job/Test_stress/
https://ci.wazuh.info/job/Test_stress_gh/
https://ci.wazuh.info/job/Test_stress_AIX/
https://ci.wazuh.info/job/Test_stress_tier/
https://ci.wazuh.info/job/Test_stress_vagrant/
Branch used 4.4

Description

This issue aims to analyze and document all about the Stress test. Working state and parameters of the different pipelines mainly.

State

There are four different pipelines related to the Stress tests:

There is another pipeline, which runs a tier of tests, but it has been covered in https://github.com/wazuh/wazuh-qa/issues/4280

Tests launched - :red_circle: Test_stress_gh https://ci.wazuh.info/job/Test_stress_gh/1152/console - :green_circle: Test_stress: https://ci.wazuh.info/job/Test_stress/4077 - :red_circle: Test_stress_vagrant: https://ci.wazuh.info/job/Test_stress_Vagrant/132 - :red_circle: Test_stress_tier: https://ci.wazuh.info/job/Test_stress_tier/70/
verdx commented 1 year ago

:green_circle: Test_stress_gh

Description

This test supposedly launches a stress test for the Test_duration and can create an issue or put a comment on one in repos wazuh or wazuh-jenkins. Most of the parameters are related to this.

It is called by Test_stress to create the issue or add the commentary

State

A test has been manually launched and failed, but when it has been called from the Test_stress or the Test_stress_tier, it works correctly.

Parameters

verdx commented 1 year ago

:green_circle: Test_stress

Description

This test launches the test defined on the wazuh-jenkins repository on the machines specified for the time of TEST_DURATION. It creates a report and calls Test_stress_gh to create an issue or add a comment to an existing one on wazuh or wazuh-jenkins. It uses as parameters different configurations for the different modules that have been selected, as well as the necessary parameters so that Test_stress_gh can be called.

State

The pipeline works correctly when launched, and it has been used correctly in all recent release testings. The results are copied to the Footprint test issues of the release candidates testing. For example: https://github.com/wazuh/wazuh/issues/16570

Parameters

verdx commented 1 year ago

:yellow_circle: Test_stress_AIX

Description

This test launches the test defined on the wazuh-jenkins repository on the machines specified for the time of TEST_DURATION. It creates a report and calls Test_stress_gh to create an issue or add a comment to an existing one on wazuh or wazuh-jenkins. It uses as parameters different configurations for the different modules that have been selected, as well as the necessary parameters so that Test_stress_gh can be called. Instead of launching machines in EC2, this pipeline takes an IP and a user and password to connect to a previously created machine.

State

The pipeline is being developed in issue https://github.com/wazuh/wazuh-jenkins/issues/4653, now in review.

Parameters

verdx commented 1 year ago

:yellow_circle: Test_stress_vagrant

Description

This test launches the test defined on the wazuh-jenkins repository on the machines specified for the time of TEST_DURATION. It creates a report and calls Test_stress_gh to create an issue or add a comment to an existing one on wazuh or wazuh-jenkins. It uses as parameters different configurations for the different modules that have been selected, as well as the necessary parameters so that Test_stress_gh can be called. Instead of launching machines in EC2, this pipeline creates vagrant hosts so that macOS and Solaris can be tested.

State

The pipeline generally works, as seen in previous launches, but when tested, both individually and with the tier it has failed with an error connecting to one of the vagrant machines.

Pipeline error git rev-parse --resolve-git-dir /var/jenkins_home/workspace/Test_stress_Vagrant@script/86202ef893c1d7e3c001dc2cd130264d3e4e0b25b354760766f9a35d869ea80b/.git # timeout=10 18:29:33 Fetching changes from the remote Git repository 18:29:33 > git config remote.origin.url git@github.com:wazuh/wazuh-jenkins.git # timeout=10 18:29:33 Using shallow fetch with depth 1 18:29:33 Fetching upstream changes from git@github.com:wazuh/wazuh-jenkins.git 18:29:33 > git --version # timeout=10 18:29:33 > git --version # 'git version 2.30.2' 18:29:33 using GIT_SSH to set credentials Jenkins private key - Used to access Git Hub (QCP8NC) 18:29:33 > git fetch --tags --force --progress --depth=1 -- git@github.com:wazuh/wazuh-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 18:29:34 > git rev-parse origin/master^{commit} # timeout=10 18:29:34 Checking out Revision 242fe604427499f3fc68db21bc6a96bab1215163 (origin/master) 18:29:34 > git config core.sparsecheckout # timeout=10 18:29:34 > git checkout -f 242fe604427499f3fc68db21bc6a96bab1215163 # timeout=10 18:29:34 Commit message: "Merge pull request #5341 from wazuh/5327-remove-minor-version-master-reference-tomaster" 18:29:34 > git rev-list --no-walk af1352205cdc3213e858d0099c31edbd304a02cf # timeout=10 18:29:34 Loading library jenkins-shared-library@master 18:29:34 Attempting to resolve master from remote references... 18:29:34 > git --version # timeout=10 18:29:34 > git --version # 'git version 2.30.2' 18:29:34 using GIT_SSH to set credentials Jenkins private key - Used to access Git Hub (QCP8NC) 18:29:34 > git ls-remote -h -t -- git@github.com:wazuh/wazuh-jenkins.git # timeout=10 18:29:34 Found match: refs/heads/master revision 242fe604427499f3fc68db21bc6a96bab1215163 18:29:34 The recommended git tool is: git 18:29:34 using credential a0e39f8a-9ecb-41d6-8192-ad57c6316513 18:29:34 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/Test_stress_Vagrant@libs/f6aa726bdd3a634db6df8ca3e5a3b0121d6a666c715344522b13b5cf35ffa04a/.git # timeout=10 18:29:34 Fetching changes from the remote Git repository 18:29:34 > git config remote.origin.url git@github.com:wazuh/wazuh-jenkins.git # timeout=10 18:29:34 Fetching without tags 18:29:34 Fetching upstream changes from git@github.com:wazuh/wazuh-jenkins.git 18:29:34 > git --version # timeout=10 18:29:34 > git --version # 'git version 2.30.2' 18:29:34 using GIT_SSH to set credentials Jenkins private key - Used to access Git Hub (QCP8NC) 18:29:34 > git fetch --no-tags --force --progress -- git@github.com:wazuh/wazuh-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 18:29:36 Checking out Revision 242fe604427499f3fc68db21bc6a96bab1215163 (master) 18:29:36 > git config core.sparsecheckout # timeout=10 18:29:36 > git checkout -f 242fe604427499f3fc68db21bc6a96bab1215163 # timeout=10 18:29:36 Commit message: "Merge pull request #5341 from wazuh/5327-remove-minor-version-master-reference-tomaster" 18:29:38 [Pipeline] Start of Pipeline 18:29:38 [Pipeline] node 18:29:38 Running on [EC2 (JenkinsCloud) - AL2_v.11.4_OnDemand (i-05f77a9ca6e8340ae)](https://ci.wazuh.info/computer/EC2%20%28JenkinsCloud%29%20%2D%20AL2%5Fv.11.4%5FOnDemand%20%28i%2D05f77a9ca6e8340ae%29/) in /home/ec2-user/workspace/Test_stress_Vagrant 18:29:38 [Pipeline] { 18:29:38 [Pipeline] stage 18:29:38 [Pipeline] { (Initializing environment) 18:29:38 [Pipeline] cleanWs 18:29:38 [WS-CLEANUP] Deleting project workspace... 18:29:38 [WS-CLEANUP] Deferred wipeout is used... 18:29:38 [WS-CLEANUP] done 18:29:38 [Pipeline] retry 18:29:38 [Pipeline] { 18:29:38 [Pipeline] checkout 18:29:38 The recommended git tool is: git 18:29:38 using credential a0e39f8a-9ecb-41d6-8192-ad57c6316513 18:29:38 Cloning the remote Git repository 18:29:38 Using shallow clone with depth 1 18:29:38 Cloning repository git@github.com:wazuh/wazuh-jenkins.git 18:29:38 > git init /home/ec2-user/workspace/Test_stress_Vagrant # timeout=10 18:29:38 Fetching upstream changes from git@github.com:wazuh/wazuh-jenkins.git 18:29:38 > git --version # timeout=10 18:29:38 > git --version # 'git version 2.32.0' 18:29:38 using GIT_SSH to set credentials Jenkins private key - Used to access Git Hub (QCP8NC) 18:29:38 > git fetch --tags --force --progress --depth=1 -- git@github.com:wazuh/wazuh-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 18:30:00 Avoid second fetch 18:30:00 Checking out Revision 242fe604427499f3fc68db21bc6a96bab1215163 (origin/master) 18:30:01 Commit message: "Merge pull request #5341 from wazuh/5327-remove-minor-version-master-reference-tomaster" 18:30:01 [Pipeline] } 18:30:01 [Pipeline] // retry 18:30:00 > git config remote.origin.url git@github.com:wazuh/wazuh-jenkins.git # timeout=10 18:30:00 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 18:30:00 > git rev-parse origin/master^{commit} # timeout=10 18:30:00 > git config core.sparsecheckout # timeout=10 18:30:01 > git checkout -f 242fe604427499f3fc68db21bc6a96bab1215163 # timeout=10 18:30:02 [Pipeline] fileExists 18:30:02 [Pipeline] sh 18:30:02 + mkdir -p data 18:30:03 [Pipeline] sh 18:30:03 ++ id -un 18:30:03 ++ id -gn 18:30:03 + sudo chown -R ec2-user:ec2-user data 18:30:03 [Pipeline] fileExists 18:30:03 [Pipeline] sh 18:30:03 + mkdir -p artifacts 18:30:03 [Pipeline] sh 18:30:03 ++ id -un 18:30:03 ++ id -gn 18:30:03 + sudo chown -R ec2-user:ec2-user artifacts 18:30:04 [Pipeline] echo 18:30:04 -- WARNING: wazuh.getS3Path is deprecated, use s3Helper.getS3Path() instead -- 18:30:04 [Pipeline] withCredentials 18:30:04 Masking supported pattern matches of $key 18:30:04 [Pipeline] { 18:30:04 [Pipeline] writeFile 18:30:04 [Pipeline] writeFile 18:30:04 [Pipeline] } 18:30:04 [Pipeline] // withCredentials 18:30:04 [Pipeline] sh 18:30:04 ++ id -un 18:30:04 ++ id -gn 18:30:04 + sudo chown -R ec2-user:ec2-user quality/python-packages/jenkins_utils 18:30:04 [Pipeline] sh 18:30:05 + sudo cp -r quality/python-packages/jenkins_utils quality/tests/stress/scripts 18:30:05 [Pipeline] sh 18:30:05 ++ id -un 18:30:05 ++ id -gn 18:30:05 + sudo chown -R ec2-user:ec2-user quality/tests/stress/scripts 18:30:05 [Pipeline] } 18:30:05 [Pipeline] // stage 18:30:05 [Pipeline] stage 18:30:05 [Pipeline] { (Deploy instances) 18:30:05 [Pipeline] parallel 18:30:05 [Pipeline] { (Branch: 0) 18:30:05 [Pipeline] retry 18:30:05 [Pipeline] { 18:30:05 [Pipeline] echo 18:30:05 Trying to deploy aws_instance instance at us-east-1a zone 18:30:05 [Pipeline] fileExists 18:30:05 [Pipeline] sh 18:30:05 + mkdir -p quality/deployments/terraform/instance/ami-0e65b7ce2dab78ec9-0/ 18:30:05 [Pipeline] sh 18:30:06 ++ id -un 18:30:06 ++ id -gn 18:30:06 + sudo chown -R ec2-user:ec2-user quality/deployments/terraform/instance/ami-0e65b7ce2dab78ec9-0/ 18:30:06 [Pipeline] dir 18:30:06 Running in /home/ec2-user/workspace/Test_stress_Vagrant/quality/deployments/terraform/instance 18:30:06 [Pipeline] { 18:30:06 [Pipeline] sh 18:30:06 ++ id -un 18:30:06 ++ id -gn 18:30:06 + sudo chown -R ec2-user:ec2-user provider.tf 18:30:06 [Pipeline] sh 18:30:06 + sudo cp -r provider.tf ami-0e65b7ce2dab78ec9-0/ 18:30:06 [Pipeline] sh 18:30:07 ++ id -un 18:30:07 ++ id -gn 18:30:07 + sudo chown -R ec2-user:ec2-user ami-0e65b7ce2dab78ec9-0/ 18:30:07 [Pipeline] sh 18:30:07 ++ id -un 18:30:07 ++ id -gn 18:30:07 + sudo chown -R ec2-user:ec2-user vars.tf 18:30:07 [Pipeline] sh 18:30:07 + sudo cp -r vars.tf ami-0e65b7ce2dab78ec9-0/ 18:30:07 [Pipeline] sh 18:30:08 ++ id -un 18:30:08 ++ id -gn 18:30:08 + sudo chown -R ec2-user:ec2-user ami-0e65b7ce2dab78ec9-0/ 18:30:08 [Pipeline] sh 18:30:08 ++ id -un 18:30:08 ++ id -gn 18:30:08 + sudo chown -R ec2-user:ec2-user ondemand.tf 18:30:08 [Pipeline] sh 18:30:08 + sudo cp -r ondemand.tf ami-0e65b7ce2dab78ec9-0/ 18:30:08 [Pipeline] sh 18:30:09 ++ id -un 18:30:09 ++ id -gn 18:30:09 + sudo chown -R ec2-user:ec2-user ami-0e65b7ce2dab78ec9-0/ 18:30:09 [Pipeline] } 18:30:09 [Pipeline] // dir 18:30:09 [Pipeline] dir 18:30:09 Running in /home/ec2-user/workspace/Test_stress_Vagrant/quality/deployments/terraform/instance/ami-0e65b7ce2dab78ec9-0 18:30:09 [Pipeline] { 18:30:09 [Pipeline] writeFile 18:30:09 [Pipeline] } 18:30:09 [Pipeline] // dir 18:30:09 [Pipeline] dir 18:30:09 Running in /home/ec2-user/workspace/Test_stress_Vagrant/quality/deployments/terraform/instance/ami-0e65b7ce2dab78ec9-0 18:30:09 [Pipeline] { 18:30:09 [Pipeline] sh 18:30:09 + terraform init 18:30:24 [Pipeline] sh 18:30:24 + terraform apply -auto-approve 18:30:28 aws_instance.instance[0]: Creating... 18:30:38 aws_instance.instance[0]: Still creating... [10s elapsed] 18:30:40 aws_instance.instance[0]: Creation complete after 12s [id=i-05fa5035e27b09293] 18:30:40 18:30:40 Apply complete! Resources: 1 added, 0 changed, 0 destroyed. 18:30:40 [Pipeline] sh 18:30:41 + terraform show 18:30:42 # aws_instance.instance[0]: 18:30:42 resource "aws_instance" "instance" { 18:30:42 ami = "ami-0e65b7ce2dab78ec9" 18:30:42 arn = "arn:aws:ec2:us-east-1:966237403726:instance/i-05fa5035e27b09293" 18:30:42 associate_public_ip_address = true 18:30:42 availability_zone = "us-east-1a" 18:30:42 cpu_core_count = 1 18:30:42 cpu_threads_per_core = 2 18:30:42 disable_api_termination = false 18:30:42 ebs_optimized = false 18:30:42 get_password_data = false 18:30:42 hibernation = false 18:30:42 iam_instance_profile = "Jenkins" 18:30:42 id = "i-05fa5035e27b09293" 18:30:42 instance_state = "running" 18:30:42 instance_type = "t3a.medium" 18:30:42 ipv6_address_count = 0 18:30:42 ipv6_addresses = [] 18:30:42 key_name = "Ephemeral" 18:30:42 monitoring = false 18:30:42 primary_network_interface_id = "eni-0ea386ff1bf93d5e8" 18:30:42 private_dns = "ip-172-31-4-178.ec2.internal" 18:30:42 private_ip = "172.31.4.178" 18:30:42 public_dns = "ec2-34-231-242-179.compute-1.amazonaws.com" 18:30:42 public_ip = "34.231.242.179" 18:30:42 secondary_private_ips = [] 18:30:42 security_groups = [ 18:30:42 "default", 18:30:42 ] 18:30:42 source_dest_check = true 18:30:42 subnet_id = "subnet-064e4e7b320dc5c2d" 18:30:42 tags = { 18:30:42 "Name" = "[Terraform][https://ci.wazuh.info/]Test_stress_Vagrant_B132_manager" 18:30:42 "team" = "CICD" 18:30:42 } 18:30:42 tenancy = "default" 18:30:42 vpc_security_group_ids = [ 18:30:42 "sg-005cff996b335d497", 18:30:42 ] 18:30:42 18:30:42 credit_specification { 18:30:42 cpu_credits = "unlimited" 18:30:42 } 18:30:42 18:30:42 enclave_options { 18:30:42 enabled = false 18:30:42 } 18:30:42 18:30:42 metadata_options { 18:30:42 http_endpoint = "enabled" 18:30:42 http_put_response_hop_limit = 1 18:30:42 http_tokens = "optional" 18:30:42 } 18:30:42 18:30:42 root_block_device { 18:30:42 delete_on_termination = true 18:30:42 device_name = "/dev/sda1" 18:30:42 encrypted = false 18:30:42 iops = 750 18:30:42 throughput = 0 18:30:42 volume_id = "vol-0e46cbd86f0d66bc6" 18:30:42 volume_size = 250 18:30:42 volume_type = "gp2" 18:30:42 } 18:30:42 } 18:30:42 [Pipeline] readJSON 18:30:42 [Pipeline] } 18:30:42 [Pipeline] // dir 18:30:42 [Pipeline] writeJSON 18:30:42 [Pipeline] sh 18:30:42 + aws --region us-east-1 ec2 create-tags --cli-input-json [file://create_tags_Test_stress_Vagrant_B132_0.json](file:///) 18:30:55 [Pipeline] sh 18:30:55 + sudo rm -rf create_tags_Test_stress_Vagrant_B132_0.json 18:30:55 [Pipeline] writeJSON 18:30:55 [Pipeline] sh 18:30:55 + aws --region us-east-1 ec2 create-tags --cli-input-json [file://create_tags_Test_stress_Vagrant_B132_0.json](file:///) 18:30:57 [Pipeline] sh 18:30:57 + sudo rm -rf create_tags_Test_stress_Vagrant_B132_0.json 18:30:57 [Pipeline] writeJSON 18:30:57 [Pipeline] sh 18:30:57 + aws --region us-east-1 ec2 create-tags --cli-input-json [file://create_tags_Test_stress_Vagrant_B132_0.json](file:///) 18:30:59 [Pipeline] sh 18:30:59 + sudo rm -rf create_tags_Test_stress_Vagrant_B132_0.json 18:30:59 [Pipeline] writeJSON 18:30:59 [Pipeline] sh 18:30:59 + aws --region us-east-1 ec2 create-tags --cli-input-json [file://create_tags_Test_stress_Vagrant_B132_0.json](file:///) 18:31:01 [Pipeline] sh 18:31:01 + sudo rm -rf create_tags_Test_stress_Vagrant_B132_0.json 18:31:01 [Pipeline] writeJSON 18:31:01 [Pipeline] sh 18:31:01 + aws --region us-east-1 ec2 create-tags --cli-input-json [file://create_tags_Test_stress_Vagrant_B132_0.json](file:///) 18:31:03 [Pipeline] sh 18:31:03 + sudo rm -rf create_tags_Test_stress_Vagrant_B132_0.json 18:31:03 [Pipeline] writeJSON 18:31:03 [Pipeline] sh 18:31:03 + aws --region us-east-1 ec2 create-tags --cli-input-json [file://create_tags_Test_stress_Vagrant_B132_0.json](file:///) 18:31:05 [Pipeline] sh 18:31:05 + sudo rm -rf create_tags_Test_stress_Vagrant_B132_0.json 18:31:05 [Pipeline] retry 18:31:05 [Pipeline] { 18:31:05 [Pipeline] sleep ([show](https://ci.wazuh.info/job/Test_stress_Vagrant/132/console#)) 18:31:25 [Pipeline] timeout 18:31:25 Timeout set to expire in 10 sec 18:31:25 [Pipeline] { 18:31:25 [Pipeline] sh 18:31:25 + nc -vz -w 10 172.31.4.178 22 18:31:25 Ncat: Version 7.50 ( https://nmap.org/ncat ) 18:31:25 Ncat: Connection refused. 18:31:25 [Pipeline] } 18:31:25 [Pipeline] // timeout 18:31:25 [Pipeline] } 18:31:25 ERROR: script returned exit code 1 18:31:25 Retrying 18:31:25 [Pipeline] { 18:31:25 [Pipeline] sleep 18:31:25 Sleeping for 20 sec 18:31:45 [Pipeline] timeout 18:31:45 Timeout set to expire in 10 sec 18:31:45 [Pipeline] { 18:31:45 [Pipeline] sh 18:31:46 + nc -vz -w 10 172.31.4.178 22 18:31:46 Ncat: Version 7.50 ( https://nmap.org/ncat ) 18:31:46 Ncat: Connected to 172.31.4.178:22. 18:31:46 Ncat: 0 bytes sent, 0 bytes received in 0.01 seconds. 18:31:46 [Pipeline] } 18:31:46 [Pipeline] // timeout 18:31:46 [Pipeline] } 18:31:46 [Pipeline] // retry 18:31:46 [Pipeline] } 18:31:46 [Pipeline] // retry 18:31:46 [Pipeline] } 18:31:46 [Pipeline] // parallel 18:31:46 [Pipeline] sh 18:31:47 + aws --region us-east-1 secretsmanager get-secret-value --secret-id github_credentials 18:31:48 [Pipeline] readJSON 18:31:48 [Pipeline] readJSON 18:31:48 [Pipeline] sh 18:31:48 + set +x 18:31:48 % Total % Received % Xferd Average Speed Time Time Time Current 18:31:48 Dload Upload Total Spent Left Speed 18:31:48 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 14 100 14 0 0 105 0 --:--:-- --:--:-- --:--:-- 106 18:31:48 [Pipeline] readJSON 18:31:48 [Pipeline] } 18:31:48 [Pipeline] // stage 18:31:48 [Pipeline] stage 18:31:48 [Pipeline] { (Destroy evidences) 18:31:49 [Pipeline] ansiblePlaybook 18:31:49 [Test_stress_Vagrant] $ sshpass ******** ansible-playbook quality/deployments/ansible/destroy_vagrant.yaml -i macos_ansible_host -u jenkins -k -e environment_path=/Library/Frameworks/Python.framework/Versions/3.8/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/CMake.app/Contents/bin -e build_dir=tmp/Test_stress_Vagrant_B132_macos_agent -e vagrant_name=macos-1015 -vvv 18:31:56 ansible-playbook 2.9.10 18:31:56 config file = /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg 18:31:56 configured module search path = ['/home/ec2-user/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] 18:31:56 ansible python module location = /usr/local/lib/python3.7/site-packages/ansible 18:31:56 executable location = /usr/local/bin/ansible-playbook 18:31:56 python version = 3.7.10 (default, Jun 3 2021, 00:02:01) [GCC 7.3.1 20180712 (Red Hat 7.3.1-13)] 18:31:56 Using /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg as config file 18:31:56 host_list declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:31:56 Skipping due to inventory source not existing or not being readable by the current user 18:31:56 script declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:31:56 auto declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:31:56 Skipping due to inventory source not existing or not being readable by the current user 18:31:56 yaml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:31:56 Skipping due to inventory source not existing or not being readable by the current user 18:31:56 ini declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:31:56 Skipping due to inventory source not existing or not being readable by the current user 18:31:56 toml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:31:56 [WARNING]: Unable to parse 18:31:56 /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as an inventory 18:31:56 source 18:31:56 [WARNING]: No inventory was parsed, only implicit localhost is available 18:31:56 [WARNING]: provided hosts list is empty, only localhost is available. Note that 18:31:56 the implicit localhost does not match 'all' 18:32:00 18:32:00 PLAYBOOK: destroy_vagrant.yaml ************************************************* 18:32:00 1 plays in quality/deployments/ansible/destroy_vagrant.yaml 18:32:00 18:32:00 PLAY [all] ********************************************************************* 18:32:00 skipping: no hosts matched 18:32:00 18:32:00 PLAY RECAP ********************************************************************* 18:32:00 18:32:00 Playbook run took 0 days, 0 hours, 0 minutes, 0 seconds 18:32:00 [Pipeline] ansiblePlaybook 18:32:00 [Test_stress_Vagrant] $ sshpass ******** ansible-playbook ansible-playbooks/remove_item.yaml -i macos_ansible_host -u jenkins -k -vvv 18:32:01 ansible-playbook 2.9.10 18:32:01 config file = /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg 18:32:01 configured module search path = ['/home/ec2-user/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] 18:32:01 ansible python module location = /usr/local/lib/python3.7/site-packages/ansible 18:32:01 executable location = /usr/local/bin/ansible-playbook 18:32:01 python version = 3.7.10 (default, Jun 3 2021, 00:02:01) [GCC 7.3.1 20180712 (Red Hat 7.3.1-13)] 18:32:01 Using /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg as config file 18:32:01 host_list declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:32:01 Skipping due to inventory source not existing or not being readable by the current user 18:32:01 script declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:32:01 auto declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:32:01 Skipping due to inventory source not existing or not being readable by the current user 18:32:01 yaml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:32:01 Skipping due to inventory source not existing or not being readable by the current user 18:32:01 ini declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:32:01 Skipping due to inventory source not existing or not being readable by the current user 18:32:01 toml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as it did not pass its verify_file() method 18:32:01 [WARNING]: Unable to parse 18:32:01 /home/ec2-user/workspace/Test_stress_Vagrant/macos_ansible_host as an inventory 18:32:01 source 18:32:01 [WARNING]: No inventory was parsed, only implicit localhost is available 18:32:01 [WARNING]: provided hosts list is empty, only localhost is available. Note that 18:32:01 the implicit localhost does not match 'all' 18:32:06 18:32:06 PLAYBOOK: remove_item.yaml ***************************************************** 18:32:06 1 plays in ansible-playbooks/remove_item.yaml 18:32:06 18:32:06 PLAY [all] ********************************************************************* 18:32:06 skipping: no hosts matched 18:32:06 18:32:06 PLAY RECAP ********************************************************************* 18:32:06 18:32:06 Playbook run took 0 days, 0 hours, 0 minutes, 0 seconds 18:32:06 [Pipeline] ansiblePlaybook 18:32:06 [Test_stress_Vagrant] $ sshpass ******** ansible-playbook quality/deployments/ansible/destroy_vagrant.yaml -i solaris_ansible_host -u jenkins -k -e environment_path=/Library/Frameworks/Python.framework/Versions/3.8/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/CMake.app/Contents/bin -e build_dir=tmp/Test_stress_Vagrant_B132_solaris_agent -e vagrant_name=solaris-11 -vvv 18:32:07 ansible-playbook 2.9.10 18:32:07 config file = /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg 18:32:07 configured module search path = ['/home/ec2-user/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] 18:32:07 ansible python module location = /usr/local/lib/python3.7/site-packages/ansible 18:32:07 executable location = /usr/local/bin/ansible-playbook 18:32:07 python version = 3.7.10 (default, Jun 3 2021, 00:02:01) [GCC 7.3.1 20180712 (Red Hat 7.3.1-13)] 18:32:07 Using /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg as config file 18:32:07 host_list declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:07 Skipping due to inventory source not existing or not being readable by the current user 18:32:07 script declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:07 auto declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:07 Skipping due to inventory source not existing or not being readable by the current user 18:32:07 yaml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:07 Skipping due to inventory source not existing or not being readable by the current user 18:32:07 ini declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:07 Skipping due to inventory source not existing or not being readable by the current user 18:32:07 toml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:07 [WARNING]: Unable to parse 18:32:07 /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as an 18:32:07 inventory source 18:32:07 [WARNING]: No inventory was parsed, only implicit localhost is available 18:32:07 [WARNING]: provided hosts list is empty, only localhost is available. Note that 18:32:07 the implicit localhost does not match 'all' 18:32:08 18:32:08 PLAYBOOK: destroy_vagrant.yaml ************************************************* 18:32:08 1 plays in quality/deployments/ansible/destroy_vagrant.yaml 18:32:08 18:32:08 PLAY [all] ********************************************************************* 18:32:08 skipping: no hosts matched 18:32:08 18:32:08 PLAY RECAP ********************************************************************* 18:32:08 18:32:08 Playbook run took 0 days, 0 hours, 0 minutes, 0 seconds 18:32:08 [Pipeline] ansiblePlaybook 18:32:08 [Test_stress_Vagrant] $ sshpass ******** ansible-playbook ansible-playbooks/remove_item.yaml -i solaris_ansible_host -u jenkins -k -vvv 18:32:09 ansible-playbook 2.9.10 18:32:09 config file = /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg 18:32:09 configured module search path = ['/home/ec2-user/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules'] 18:32:09 ansible python module location = /usr/local/lib/python3.7/site-packages/ansible 18:32:09 executable location = /usr/local/bin/ansible-playbook 18:32:09 python version = 3.7.10 (default, Jun 3 2021, 00:02:01) [GCC 7.3.1 20180712 (Red Hat 7.3.1-13)] 18:32:09 Using /home/ec2-user/workspace/Test_stress_Vagrant/ansible.cfg as config file 18:32:09 host_list declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:09 Skipping due to inventory source not existing or not being readable by the current user 18:32:09 script declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:09 auto declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:09 Skipping due to inventory source not existing or not being readable by the current user 18:32:09 yaml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:09 Skipping due to inventory source not existing or not being readable by the current user 18:32:09 ini declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:09 Skipping due to inventory source not existing or not being readable by the current user 18:32:09 toml declined parsing /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as it did not pass its verify_file() method 18:32:09 [WARNING]: Unable to parse 18:32:09 /home/ec2-user/workspace/Test_stress_Vagrant/solaris_ansible_host as an 18:32:09 inventory source 18:32:09 [WARNING]: No inventory was parsed, only implicit localhost is available 18:32:09 [WARNING]: provided hosts list is empty, only localhost is available. Note that 18:32:09 the implicit localhost does not match 'all' 18:32:11 18:32:11 PLAYBOOK: remove_item.yaml ***************************************************** 18:32:11 1 plays in ansible-playbooks/remove_item.yaml 18:32:11 18:32:11 PLAY [all] ********************************************************************* 18:32:11 skipping: no hosts matched 18:32:11 18:32:11 PLAY RECAP ********************************************************************* 18:32:11 18:32:11 Playbook run took 0 days, 0 hours, 0 minutes, 0 seconds 18:32:11 [Pipeline] parallel 18:32:11 [Pipeline] { (Branch: 0) 18:32:11 [Pipeline] dir 18:32:11 Running in /home/ec2-user/workspace/Test_stress_Vagrant/quality/deployments/terraform/instance/ami-0e65b7ce2dab78ec9-0 18:32:11 [Pipeline] { 18:32:11 [Pipeline] timeout 18:32:11 Timeout set to expire in 20 min 18:32:11 [Pipeline] { 18:32:11 [Pipeline] sh 18:32:11 + terraform destroy -auto-approve 18:32:14 aws_instance.instance[0]: Refreshing state... [id=i-05fa5035e27b09293] 18:32:15 aws_instance.instance[0]: Destroying... [id=i-05fa5035e27b09293] 18:32:25 aws_instance.instance[0]: Still destroying... [id=i-05fa5035e27b09293, 10s elapsed] 18:32:29 aws_instance.instance[0]: Destruction complete after 13s 18:32:29 18:32:29 Destroy complete! Resources: 1 destroyed. 18:32:29 [Pipeline] } 18:32:29 [Pipeline] // timeout 18:32:29 [Pipeline] } 18:32:30 [Pipeline] // dir 18:32:30 [Pipeline] sh 18:32:30 + sudo rm -rf quality/deployments/terraform/instance/ami-0e65b7ce2dab78ec9-0/ 18:32:30 [Pipeline] } 18:32:30 [Pipeline] // parallel 18:32:30 [Pipeline] cleanWs 18:32:30 [WS-CLEANUP] Deleting project workspace... 18:32:30 [WS-CLEANUP] Deferred wipeout is used... 18:32:30 [WS-CLEANUP] done 18:32:30 [Pipeline] } 18:32:30 [Pipeline] // stage 18:32:30 [Pipeline] } 18:32:30 [Pipeline] // node 18:32:30 [Pipeline] End of Pipeline 18:32:30 hudson.remoting.ProxyException: net.sf.json.JSONException: Invalid JSON String 18:32:30 at net.sf.json.JSONSerializer.toJSON(JSONSerializer.java:143) 18:32:30 at net.sf.json.JSONSerializer.toJSON(JSONSerializer.java:103) 18:32:30 at net.sf.json.JSONSerializer.toJSON(JSONSerializer.java:84) 18:32:30 at org.jenkinsci.plugins.pipeline.utility.steps.json.ReadJSONStepExecution.doRun(ReadJSONStepExecution.java:87) 18:32:30 at org.jenkinsci.plugins.pipeline.utility.steps.AbstractFileOrTextStepExecution.run(AbstractFileOrTextStepExecution.java:29) 18:32:30 at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47) 18:32:30 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) 18:32:30 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) 18:32:30 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) 18:32:30 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 18:32:30 at java.base/java.lang.Thread.run(Thread.java:829) 18:32:30 Finished: FAILURE ```

Parameters

verdx commented 1 year ago

Update 05/07/23

The tests have been finished and the three pipelines have been analyzed and described.

juliamagan commented 1 year ago

The parameters are displayed but not explained. It would be useful to add general information on what these stress tests consist of, what they test.

davidjiglesias commented 8 months ago

This is going to be done and continued as part of the Jenkins redesign followed by the refactor of Footprint (Performance testing tier 1).