openshift-eng / elliott

Apache License 2.0
15 stars 28 forks source link

ART-4398 Associate CVE mapping for golang-builder CVEs #464

Closed thegreyd closed 1 year ago

thegreyd commented 1 year ago

https://issues.redhat.com/browse/ART-4398

Summary

Right now we are not associating builds with golang CVEs. With this PR, we will start associating all golang build images with golang CVEs except etcd image. This is because etcd is built with a different go version (which is behind what our images use), and in most cases CVEs would be associated with our main go builder version. So for now a warning is displayed if etcd build is detected saying "manually associate etcd build with CVE".

Handling the etcd case was proving to be quite confusing, so I've ommitted that to be handled as a followup. This PR gets us much closer from where we are today.

Test

openshift-bot commented 1 year ago

Build #1

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 create: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev177+gd5adcfe.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.12,async-timeout==4.0.2,attrs==22.1.0,Brotli==1.0.9,cchardet==2.1.7,certifi==2022.9.24,cffi==1.15.1,charset-normalizer==2.1.1,click==8.1.3,coverage==6.5.0,cryptography==38.0.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool @ git+http://github.com/thegreyd/errata-tool.git@bad2cb9c3321a1179f018cd9ddcf1d51d634290b,exceptiongroup==1.0.4,filelock==3.8.0,flake8==5.0.4,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.10.1,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.30.1,krb5==0.4.1,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.2,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==21.3,platformdirs==2.5.4,pluggy==1.0.0,ply==3.11,py==1.11.0,pycares==4.2.2,pycodestyle==2.9.1,pycparser==2.21,pyflakes==2.5.0,pygit2==1.10.1,pylint==2.15.5,pyparsing==3.0.9,pyspnego==0.6.3,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev177%2Bgd5adcfe.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==3.27.1,typing_extensions==4.4.0,urllib3==1.26.12,virtualenv==20.16.7,wrapt==1.14.1,yarl==1.8.1
py38 run-test-pre: PYTHONHASHSEED='881690455'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
................................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
........................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py:39: RuntimeWarning: coroutine 'AsyncMockMixin._execute_mock_call' was never awaited
  resp.raise_for_status()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
..F.................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py:263: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
  logger.warn(f"Bug {warning_bug} has CVE number in summary but does not have tracker keywords")
Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
...........................................
======================================================================
FAIL: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 158, in test_compute_cve_package_exclusions
    self.assertEqual(actual, expected)
AssertionError: {'CVE[39 chars]': {'d': 0, 'a': 0, 'b': 0}} != {'CVE[39 chars]': {'a': 0, 'b': 0, 'd': 0}, 'CVE-2099-3': {'a[25 chars]: 0}}
- {'CVE-2099-1': {'c': 0, 'd': 0}, 'CVE-2099-2': {'a': 0, 'b': 0, 'd': 0}}
+ {'CVE-2099-1': {'c': 0, 'd': 0},
+  'CVE-2099-2': {'a': 0, 'b': 0, 'd': 0},
+  'CVE-2099-3': {'a': 0, 'b': 0, 'c': 0, 'd': 0}}

----------------------------------------------------------------------
Ran 168 tests in 0.707s

FAILED (failures=1)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #2

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev179+g160cfea.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.12,async-timeout==4.0.2,attrs==22.1.0,Brotli==1.0.9,cchardet==2.1.7,certifi==2022.9.24,cffi==1.15.1,charset-normalizer==2.1.1,click==8.1.3,coverage==6.5.0,cryptography==38.0.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool @ git+http://github.com/thegreyd/errata-tool.git@bad2cb9c3321a1179f018cd9ddcf1d51d634290b,exceptiongroup==1.0.4,filelock==3.8.0,flake8==5.0.4,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.10.1,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.30.1,krb5==0.4.1,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.2,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==21.3,platformdirs==2.5.4,pluggy==1.0.0,ply==3.11,py==1.11.0,pycares==4.2.2,pycodestyle==2.9.1,pycparser==2.21,pyflakes==2.5.0,pygit2==1.10.1,pylint==2.15.5,pyparsing==3.0.9,pyspnego==0.6.3,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev179%2Bg160cfea.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==3.27.1,typing_extensions==4.4.0,urllib3==1.26.12,virtualenv==20.16.7,wrapt==1.14.1,yarl==1.8.1
py38 run-test-pre: PYTHONHASHSEED='3451240003'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
........F........................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
........................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py:39: RuntimeWarning: coroutine 'AsyncMockMixin._execute_mock_call' was never awaited
  resp.raise_for_status()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
.E.E.................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py:263: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
  logger.warn(f"Bug {warning_bug} has CVE number in summary but does not have tracker keywords")
Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
............E...............................
======================================================================
ERROR: test_associate_builds_with_cves (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 200, in test_associate_builds_with_cves
    actual = get_event_loop().run_until_complete(AsyncErrataUtils.associate_builds_with_cves(api, 1, attached_builds, cve_components, dry_run=False))
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 182, in associate_builds_with_cves
    expected_cve_packages_exclusions = cls.compute_cve_package_exclusions(attached_builds, cve_components_mapping)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 113, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 157, in test_compute_cve_package_exclusions
    actual = AsyncErrataUtils.compute_cve_package_exclusions(attached_builds, cve_components)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 113, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_get_nvr_golang (tests.test_get_golang_versions_cli.TestGetGolangVersionsCli)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_get_golang_versions_cli.py", line 64, in test_get_nvr_golang
    get_golang_versions_cli.get_nvrs_golang(nvrs_list, logger)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/get_golang_versions_cli.py", line 77, in get_nvrs_golang
    util.pretty_print_nvrs_go(go_nvr_map)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/flexmock/_api.py", line 522, in mock_method
    raise MethodSignatureError(error_msg)
flexmock.exceptions.MethodSignatureError: Arguments for call pretty_print_nvrs_go did not match expectations:
  Received call:    pretty_print_nvrs_go({'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}})
  Expected call[1]: pretty_print_nvrs_go(go_nvr_map={'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}, 'podman-container': {'nvr': ('podman-container', 'v1.4', 'el7'), 'go': '1.15'}})

======================================================================
FAIL: test_associate_builds_with_cves_bz (tests.test_attach_cve_flaws_cli.TestAttachCVEFlawsCLI)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_attach_cve_flaws_cli.py", line 102, in test_associate_builds_with_cves_bz
    fake_urils_associate_builds_with_cves.assert_awaited_once_with(errata_api, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'd', 'b'}, 'CVE-2099-3': {'a', 'd', 'b', 'c'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2245, in assert_awaited_once_with
    return self.assert_awaited_with(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2233, in assert_awaited_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected await not found.
Expected: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='140546569988032'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'d', 'a', 'b'}, 'CVE-2099-3': {'d', 'a', 'b', 'c'}, 'CVE-2099-2': {'e', 'c'}}, dry_run=False)
Actual: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='140546569988032'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fd37e562670>, 'components': {'d', 'a', 'b'}}, 'CVE-2099-3': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fd37e5625e0>, 'components': {'d', 'a', 'b', 'c'}}, 'CVE-2099-2': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fd37e562250>, 'components': {'e', 'c'}}}, dry_run=False)

----------------------------------------------------------------------
Ran 168 tests in 0.810s

FAILED (failures=1, errors=3)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #3

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev180+g314b80a.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.12,async-timeout==4.0.2,attrs==22.1.0,Brotli==1.0.9,cchardet==2.1.7,certifi==2022.9.24,cffi==1.15.1,charset-normalizer==2.1.1,click==8.1.3,coverage==6.5.0,cryptography==38.0.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool @ git+http://github.com/thegreyd/errata-tool.git@bad2cb9c3321a1179f018cd9ddcf1d51d634290b,exceptiongroup==1.0.4,filelock==3.8.0,flake8==5.0.4,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.10.1,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.30.1,krb5==0.4.1,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.2,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==21.3,platformdirs==2.5.4,pluggy==1.0.0,ply==3.11,py==1.11.0,pycares==4.2.2,pycodestyle==2.9.1,pycparser==2.21,pyflakes==2.5.0,pygit2==1.10.1,pylint==2.15.5,pyparsing==3.0.9,pyspnego==0.6.3,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev180%2Bg314b80a.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==3.27.1,typing_extensions==4.4.0,urllib3==1.26.12,virtualenv==20.16.7,wrapt==1.14.1,yarl==1.8.1
py38 run-test-pre: PYTHONHASHSEED='2954458132'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
........F........................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
........................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py:41: RuntimeWarning: coroutine 'AsyncMockMixin._execute_mock_call' was never awaited
  resp.raise_for_status()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
.E.E.................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py:263: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
  logger.warn(f"Bug {warning_bug} has CVE number in summary but does not have tracker keywords")
Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
............E...............................
======================================================================
ERROR: test_associate_builds_with_cves (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 200, in test_associate_builds_with_cves
    actual = get_event_loop().run_until_complete(AsyncErrataUtils.associate_builds_with_cves(api, 1, attached_builds, cve_components, dry_run=False))
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 230, in associate_builds_with_cves
    expected_cve_packages_exclusions = cls.compute_cve_package_exclusions(attached_builds, cve_components_mapping)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 115, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 157, in test_compute_cve_package_exclusions
    actual = AsyncErrataUtils.compute_cve_package_exclusions(attached_builds, cve_components)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 115, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_get_nvr_golang (tests.test_get_golang_versions_cli.TestGetGolangVersionsCli)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_get_golang_versions_cli.py", line 64, in test_get_nvr_golang
    get_golang_versions_cli.get_nvrs_golang(nvrs_list, logger)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/get_golang_versions_cli.py", line 77, in get_nvrs_golang
    util.pretty_print_nvrs_go(go_nvr_map)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/flexmock/_api.py", line 522, in mock_method
    raise MethodSignatureError(error_msg)
flexmock.exceptions.MethodSignatureError: Arguments for call pretty_print_nvrs_go did not match expectations:
  Received call:    pretty_print_nvrs_go({'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}})
  Expected call[1]: pretty_print_nvrs_go(go_nvr_map={'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}, 'podman-container': {'nvr': ('podman-container', 'v1.4', 'el7'), 'go': '1.15'}})

======================================================================
FAIL: test_associate_builds_with_cves_bz (tests.test_attach_cve_flaws_cli.TestAttachCVEFlawsCLI)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_attach_cve_flaws_cli.py", line 102, in test_associate_builds_with_cves_bz
    fake_urils_associate_builds_with_cves.assert_awaited_once_with(errata_api, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'd', 'b'}, 'CVE-2099-3': {'a', 'd', 'b', 'c'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2245, in assert_awaited_once_with
    return self.assert_awaited_with(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2233, in assert_awaited_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected await not found.
Expected: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='139970760517616'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'd', 'b'}, 'CVE-2099-3': {'a', 'd', 'b', 'c'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
Actual: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='139970760517616'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f4d6f341250>, 'components': {'a', 'd', 'b'}}, 'CVE-2099-3': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f4d6f341490>, 'components': {'a', 'd', 'b', 'c'}}, 'CVE-2099-2': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f4d6f3410d0>, 'components': {'c', 'e'}}}, dry_run=False)

----------------------------------------------------------------------
Ran 168 tests in 0.715s

FAILED (failures=1, errors=3)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #4

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev181+gc1100cf.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.12,async-timeout==4.0.2,attrs==22.1.0,Brotli==1.0.9,cchardet==2.1.7,certifi==2022.9.24,cffi==1.15.1,charset-normalizer==2.1.1,click==8.1.3,coverage==6.5.0,cryptography==38.0.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool @ git+http://github.com/thegreyd/errata-tool.git@bad2cb9c3321a1179f018cd9ddcf1d51d634290b,exceptiongroup==1.0.4,filelock==3.8.0,flake8==5.0.4,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.10.1,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.30.1,krb5==0.4.1,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.2,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==21.3,platformdirs==2.5.4,pluggy==1.0.0,ply==3.11,py==1.11.0,pycares==4.2.2,pycodestyle==2.9.1,pycparser==2.21,pyflakes==2.5.0,pygit2==1.10.1,pylint==2.15.5,pyparsing==3.0.9,pyspnego==0.6.3,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev181%2Bgc1100cf.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==3.27.1,typing_extensions==4.4.0,urllib3==1.26.12,virtualenv==20.16.7,wrapt==1.14.1,yarl==1.8.1
py38 run-test-pre: PYTHONHASHSEED='3291662333'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
........F........................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
........................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py:40: RuntimeWarning: coroutine 'AsyncMockMixin._execute_mock_call' was never awaited
  resp.raise_for_status()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
.E.E.................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py:263: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
  logger.warn(f"Bug {warning_bug} has CVE number in summary but does not have tracker keywords")
Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
............E...............................
======================================================================
ERROR: test_associate_builds_with_cves (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 200, in test_associate_builds_with_cves
    actual = get_event_loop().run_until_complete(AsyncErrataUtils.associate_builds_with_cves(api, 1, attached_builds, cve_components, dry_run=False))
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 229, in associate_builds_with_cves
    expected_cve_packages_exclusions = cls.compute_cve_package_exclusions(attached_builds, cve_components_mapping)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 114, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 157, in test_compute_cve_package_exclusions
    actual = AsyncErrataUtils.compute_cve_package_exclusions(attached_builds, cve_components)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 114, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_get_nvr_golang (tests.test_get_golang_versions_cli.TestGetGolangVersionsCli)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_get_golang_versions_cli.py", line 64, in test_get_nvr_golang
    get_golang_versions_cli.get_nvrs_golang(nvrs_list, logger)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/get_golang_versions_cli.py", line 77, in get_nvrs_golang
    util.pretty_print_nvrs_go(go_nvr_map)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/flexmock/_api.py", line 522, in mock_method
    raise MethodSignatureError(error_msg)
flexmock.exceptions.MethodSignatureError: Arguments for call pretty_print_nvrs_go did not match expectations:
  Received call:    pretty_print_nvrs_go({'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}})
  Expected call[1]: pretty_print_nvrs_go(go_nvr_map={'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}, 'podman-container': {'nvr': ('podman-container', 'v1.4', 'el7'), 'go': '1.15'}})

======================================================================
FAIL: test_associate_builds_with_cves_bz (tests.test_attach_cve_flaws_cli.TestAttachCVEFlawsCLI)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_attach_cve_flaws_cli.py", line 102, in test_associate_builds_with_cves_bz
    fake_urils_associate_builds_with_cves.assert_awaited_once_with(errata_api, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'd', 'b'}, 'CVE-2099-3': {'a', 'd', 'b', 'c'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2245, in assert_awaited_once_with
    return self.assert_awaited_with(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2233, in assert_awaited_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected await not found.
Expected: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='140362700523504'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'b', 'd'}, 'CVE-2099-3': {'c', 'a', 'b', 'd'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
Actual: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='140362700523504'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fa8aed74fa0>, 'components': {'a', 'b', 'd'}}, 'CVE-2099-3': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fa8aed74850>, 'components': {'c', 'a', 'b', 'd'}}, 'CVE-2099-2': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fa8aed74520>, 'components': {'c', 'e'}}}, dry_run=False)

----------------------------------------------------------------------
Ran 168 tests in 0.703s

FAILED (failures=1, errors=3)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #5

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev191+g73fbd3d.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.12,async-timeout==4.0.2,attrs==22.1.0,Brotli==1.0.9,cchardet==2.1.7,certifi==2022.9.24,cffi==1.15.1,charset-normalizer==2.1.1,click==8.1.3,coverage==6.5.0,cryptography==38.0.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.29.0,exceptiongroup==1.0.4,filelock==3.8.0,flake8==5.0.4,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.10.1,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.30.1,krb5==0.4.1,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.2,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==21.3,platformdirs==2.5.4,pluggy==1.0.0,ply==3.11,py==1.11.0,pycares==4.2.2,pycodestyle==2.9.1,pycparser==2.21,pyflakes==2.5.0,pygit2==1.10.1,pylint==2.15.5,pyparsing==3.0.9,pyspnego==0.6.3,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev191%2Bg73fbd3d.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==3.27.1,typing_extensions==4.4.0,urllib3==1.26.12,virtualenv==20.16.7,wrapt==1.14.1,yarl==1.8.1
py38 run-test-pre: PYTHONHASHSEED='308188591'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
........F........................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
........................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py:40: RuntimeWarning: coroutine 'AsyncMockMixin._execute_mock_call' was never awaited
  resp.raise_for_status()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
.E.E.................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py:263: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
  logger.warn(f"Bug {warning_bug} has CVE number in summary but does not have tracker keywords")
Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
............E...............................
======================================================================
ERROR: test_associate_builds_with_cves (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 200, in test_associate_builds_with_cves
    actual = get_event_loop().run_until_complete(AsyncErrataUtils.associate_builds_with_cves(api, 1, attached_builds, cve_components, dry_run=False))
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 229, in associate_builds_with_cves
    expected_cve_packages_exclusions = cls.compute_cve_package_exclusions(attached_builds, cve_components_mapping)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 114, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 157, in test_compute_cve_package_exclusions
    actual = AsyncErrataUtils.compute_cve_package_exclusions(attached_builds, cve_components)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 114, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_get_nvr_golang (tests.test_get_golang_versions_cli.TestGetGolangVersionsCli)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_get_golang_versions_cli.py", line 64, in test_get_nvr_golang
    get_golang_versions_cli.get_nvrs_golang(nvrs_list, logger)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/get_golang_versions_cli.py", line 77, in get_nvrs_golang
    util.pretty_print_nvrs_go(go_nvr_map)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/flexmock/_api.py", line 522, in mock_method
    raise MethodSignatureError(error_msg)
flexmock.exceptions.MethodSignatureError: Arguments for call pretty_print_nvrs_go did not match expectations:
  Received call:    pretty_print_nvrs_go({'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}})
  Expected call[1]: pretty_print_nvrs_go(go_nvr_map={'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}, 'podman-container': {'nvr': ('podman-container', 'v1.4', 'el7'), 'go': '1.15'}})

======================================================================
FAIL: test_associate_builds_with_cves_bz (tests.test_attach_cve_flaws_cli.TestAttachCVEFlawsCLI)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_attach_cve_flaws_cli.py", line 102, in test_associate_builds_with_cves_bz
    fake_urils_associate_builds_with_cves.assert_awaited_once_with(errata_api, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'd', 'b'}, 'CVE-2099-3': {'a', 'd', 'b', 'c'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2245, in assert_awaited_once_with
    return self.assert_awaited_with(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2233, in assert_awaited_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected await not found.
Expected: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='139759220561904'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'d', 'a', 'b'}, 'CVE-2099-3': {'d', 'c', 'a', 'b'}, 'CVE-2099-2': {'e', 'c'}}, dry_run=False)
Actual: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='139759220561904'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f1c2e7077f0>, 'components': {'d', 'a', 'b'}}, 'CVE-2099-3': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f1c2e7079d0>, 'components': {'d', 'c', 'a', 'b'}}, 'CVE-2099-2': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f1c2e707cd0>, 'components': {'e', 'c'}}}, dry_run=False)

----------------------------------------------------------------------
Ran 168 tests in 0.736s

FAILED (failures=1, errors=3)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #7

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev181+gc1100cf.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.13,async-timeout==4.0.2,attrs==22.1.0,Brotli==1.0.9,cchardet==2.1.7,certifi==2022.9.24,cffi==1.15.1,charset-normalizer==2.1.1,click==8.1.3,coverage==6.5.0,cryptography==38.0.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool @ git+http://github.com/thegreyd/errata-tool.git@bad2cb9c3321a1179f018cd9ddcf1d51d634290b,exceptiongroup==1.0.4,filelock==3.8.0,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.10.1,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.0,krb5==0.4.1,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.2,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==21.3,platformdirs==2.5.4,pluggy==1.0.0,ply==3.11,py==1.11.0,pycares==4.2.2,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.0,pygit2==1.10.1,pylint==2.15.6,pyparsing==3.0.9,pyspnego==0.6.3,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev181%2Bgc1100cf.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==3.27.1,typing_extensions==4.4.0,urllib3==1.26.13,virtualenv==20.16.7,wrapt==1.14.1,yarl==1.8.1
py38 run-test-pre: PYTHONHASHSEED='1820490411'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
........F........................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
........................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py:40: RuntimeWarning: coroutine 'AsyncMockMixin._execute_mock_call' was never awaited
  resp.raise_for_status()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
.E.E.................../mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py:263: DeprecationWarning: The 'warn' method is deprecated, use 'warning' instead
  logger.warn(f"Bug {warning_bug} has CVE number in summary but does not have tracker keywords")
Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
............E...............................
======================================================================
ERROR: test_associate_builds_with_cves (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 200, in test_associate_builds_with_cves
    actual = get_event_loop().run_until_complete(AsyncErrataUtils.associate_builds_with_cves(api, 1, attached_builds, cve_components, dry_run=False))
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 229, in associate_builds_with_cves
    expected_cve_packages_exclusions = cls.compute_cve_package_exclusions(attached_builds, cve_components_mapping)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 114, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 157, in test_compute_cve_package_exclusions
    actual = AsyncErrataUtils.compute_cve_package_exclusions(attached_builds, cve_components)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 114, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_get_nvr_golang (tests.test_get_golang_versions_cli.TestGetGolangVersionsCli)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_get_golang_versions_cli.py", line 64, in test_get_nvr_golang
    get_golang_versions_cli.get_nvrs_golang(nvrs_list, logger)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/get_golang_versions_cli.py", line 77, in get_nvrs_golang
    util.pretty_print_nvrs_go(go_nvr_map)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/flexmock/_api.py", line 522, in mock_method
    raise MethodSignatureError(error_msg)
flexmock.exceptions.MethodSignatureError: Arguments for call pretty_print_nvrs_go did not match expectations:
  Received call:    pretty_print_nvrs_go({'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}})
  Expected call[1]: pretty_print_nvrs_go(go_nvr_map={'openshift': {'nvr': ('openshift', 'v1.15', 'el8'), 'go': '1.16'}, 'podman-container': {'nvr': ('podman-container', 'v1.4', 'el7'), 'go': '1.15'}})

======================================================================
FAIL: test_associate_builds_with_cves_bz (tests.test_attach_cve_flaws_cli.TestAttachCVEFlawsCLI)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1346, in patched
    return func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_attach_cve_flaws_cli.py", line 102, in test_associate_builds_with_cves_bz
    fake_urils_associate_builds_with_cves.assert_awaited_once_with(errata_api, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'd', 'b'}, 'CVE-2099-3': {'a', 'd', 'b', 'c'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2245, in assert_awaited_once_with
    return self.assert_awaited_with(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2233, in assert_awaited_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected await not found.
Expected: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='139950686210032'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'a', 'b', 'd'}, 'CVE-2099-3': {'a', 'b', 'c', 'd'}, 'CVE-2099-2': {'e', 'c'}}, dry_run=False)
Actual: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='139950686210032'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f48c0e41910>, 'components': {'d', 'a', 'b'}}, 'CVE-2099-3': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f48c0e414c0>, 'components': {'d', 'a', 'c', 'b'}}, 'CVE-2099-2': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7f48c0e41160>, 'components': {'e', 'c'}}}, dry_run=False)

----------------------------------------------------------------------
Ran 168 tests in 0.942s

FAILED (failures=1, errors=3)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #9

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev209+ga1d7b43.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.13,async-timeout==4.0.2,asynctest==0.13.0,attrs==22.1.0,Brotli==1.0.9,cachetools==5.2.0,cchardet==2.1.7,certifi==2022.12.7,cffi==1.15.1,chardet==5.1.0,charset-normalizer==2.1.1,click==8.1.3,colorama==0.4.6,coverage==6.5.0,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.30.0,exceptiongroup==1.0.4,filelock==3.8.2,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.11.2,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.0,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.3,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==22.0,platformdirs==2.6.0,pluggy==1.0.0,ply==3.11,pycares==4.3.0,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.1,pygit2==1.10.1,pylint==2.15.8,pyproject_api==1.2.1,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev209%2Bga1d7b43.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==4.0.9,typing_extensions==4.4.0,urllib3==1.26.13,virtualenv==20.17.1,wrapt==1.14.1,yarl==1.8.2
py38 run-test-pre: PYTHONHASHSEED='4244470558'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
E.E.E.E.E.E.E.E..E.E.E.E.E.E.E.E.E...E.E.E.E.E.E.E.E.
======================================================================
ERROR: tests.test_assembly (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_assembly
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_assembly.py", line 5, in <module>
    from elliottlib.assembly import (assembly_basis_event, assembly_group_config,
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_assertion (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_assertion
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_assertion.py", line 13, in <module>
    from elliottlib import assertion
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_attach_cve_flaws_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_attach_cve_flaws_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_attach_cve_flaws_cli.py", line 6, in <module>
    from elliottlib.bzutil import BugzillaBug
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_brew (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_brew
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_brew.py", line 10, in <module>
    from elliottlib import exceptions, constants, brew, errata
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_build_finder (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_build_finder
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_build_finder.py", line 7, in <module>
    from elliottlib.build_finder import BuildFinder
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_bzutil (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_bzutil
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_bzutil.py", line 9, in <module>
    from elliottlib.bzutil import Bug, JIRABugTracker, BugzillaBugTracker, BugzillaBug, JIRABug, BugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_bzutil_bugzilla (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_bzutil_bugzilla
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_bzutil_bugzilla.py", line 2, in <module>
    from elliottlib.bzutil import BugzillaBugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_bzutil_jira (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_bzutil_jira
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_bzutil_jira.py", line 2, in <module>
    from elliottlib.bzutil import JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_errata (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_errata
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata.py", line 14, in <module>
    from elliottlib import errata, constants, brew, exceptions
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_errata_async (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_errata_async
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 4, in <module>
    from elliottlib.errata_async import AsyncErrataAPI, AsyncErrataUtils
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_exectools (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_exectools
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_exectools.py", line 13, in <module>
    from elliottlib import exectools
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_find_bugs_blocker_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_find_bugs_blocker_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_find_bugs_blocker_cli.py", line 4, in <module>
    import elliottlib.cli.find_bugs_blocker_cli
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_blocker_cli.py", line 5, in <module>
    from elliottlib.cli.find_bugs_sweep_cli import print_report, FindBugsMode
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py", line 9, in <module>
    from elliottlib.bzutil import BugTracker, Bug, JIRABug
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_find_bugs_qe_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_find_bugs_qe_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_find_bugs_qe_cli.py", line 5, in <module>
    from elliottlib.cli.common import cli, Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/common.py", line 7, in <module>
    from elliottlib import Runtime, constants, dotconfig, version
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_find_bugs_sweep_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_find_bugs_sweep_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_find_bugs_sweep_cli.py", line 6, in <module>
    from elliottlib.cli.find_bugs_sweep_cli import FindBugsMode
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_bugs_sweep_cli.py", line 9, in <module>
    from elliottlib.bzutil import BugTracker, Bug, JIRABug
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_find_builds_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_find_builds_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_find_builds_cli.py", line 2, in <module>
    from elliottlib.cli.find_builds_cli import _filter_out_inviable_builds, _find_shipped_builds
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/find_builds_cli.py", line 11, in <module>
    import elliottlib
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_get_golang_versions_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_get_golang_versions_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_get_golang_versions_cli.py", line 3, in <module>
    from elliottlib.cli import get_golang_versions_cli
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/get_golang_versions_cli.py", line 3, in <module>
    from elliottlib import errata, logutil, util
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_imagecfg (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_imagecfg
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_imagecfg.py", line 9, in <module>
    from elliottlib import imagecfg
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_pushd (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_pushd
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_pushd.py", line 10, in <module>
    from elliottlib import pushd
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_remove_bugs_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_remove_bugs_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_remove_bugs_cli.py", line 3, in <module>
    from elliottlib import errata
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_repair_bugs_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_repair_bugs_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_repair_bugs_cli.py", line 4, in <module>
    from elliottlib.cli.common import cli, Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/common.py", line 7, in <module>
    from elliottlib import Runtime, constants, dotconfig, version
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_rpmdiff (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_rpmdiff
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_rpmdiff.py", line 4, in <module>
    from elliottlib import rpmdiff, constants
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_tarball_sources (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_tarball_sources
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_tarball_sources.py", line 6, in <module>
    from elliottlib import tarball_sources
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_util (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_util
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_util.py", line 3, in <module>
    from elliottlib import util
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_verify_attached_bugs_cli (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_verify_attached_bugs_cli
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_verify_attached_bugs_cli.py", line 5, in <module>
    from elliottlib.cli.common import cli, Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/common.py", line 7, in <module>
    from elliottlib import Runtime, constants, dotconfig, version
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

======================================================================
ERROR: tests.test_verify_attached_operators (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: tests.test_verify_attached_operators
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/loader.py", line 436, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib64/python3.8/unittest/loader.py", line 377, in _get_module_from_name
    __import__(name)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_verify_attached_operators.py", line 5, in <module>
    from elliottlib.cli import verify_attached_operators_cli
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/cli/verify_attached_operators_cli.py", line 12, in <module>
    from elliottlib import brew, constants, exectools
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/__init__.py", line 7, in <module>
    from .runtime import Runtime
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/runtime.py", line 21, in <module>
    from elliottlib.bzutil import BugzillaBugTracker, JIRABugTracker
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/bzutil.py", line 1088, in <module>
    def approximate_cutoff_timestamp(basis_event: int, koji_api: ClientSession, metas: Iterable[Metadata]) -> float:
NameError: name 'Metadata' is not defined

----------------------------------------------------------------------
Ran 28 tests in 0.023s

FAILED (errors=25)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #10

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev211+gd5ca238.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.13,async-timeout==4.0.2,asynctest==0.13.0,attrs==22.1.0,Brotli==1.0.9,cachetools==5.2.0,cchardet==2.1.7,certifi==2022.12.7,cffi==1.15.1,chardet==5.1.0,charset-normalizer==2.1.1,click==8.1.3,colorama==0.4.6,coverage==6.5.0,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.30.0,exceptiongroup==1.0.4,filelock==3.8.2,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.11.2,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.0,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.3,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==22.0,platformdirs==2.6.0,pluggy==1.0.0,ply==3.11,pycares==4.3.0,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.1,pygit2==1.10.1,pylint==2.15.8,pyproject_api==1.2.1,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev211%2Bgd5ca238.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==4.0.9,typing_extensions==4.4.0,urllib3==1.26.13,virtualenv==20.17.1,wrapt==1.14.1,yarl==1.8.2
py38 run-test-pre: PYTHONHASHSEED='270779162'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
........F........................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
...........................E.E...................Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
.............../usr/lib64/python3.8/asyncio/base_events.py:654: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
  _warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
..............................
======================================================================
ERROR: test_associate_builds_with_cves (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/async_case.py", line 65, in _callTestMethod
    self._callMaybeAsync(method)
  File "/usr/lib64/python3.8/unittest/async_case.py", line 88, in _callMaybeAsync
    return self._asyncioTestLoop.run_until_complete(fut)
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/lib64/python3.8/unittest/async_case.py", line 102, in _asyncioLoopRunner
    ret = await awaitable
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1363, in patched
    return await func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 201, in test_associate_builds_with_cves
    actual = await AsyncErrataUtils.associate_builds_with_cves(api, 1, attached_builds, cve_components, dry_run=False)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 232, in associate_builds_with_cves
    expected_cve_packages_exclusions = cls.compute_cve_package_exclusions(attached_builds, cve_components_mapping)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 117, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/async_case.py", line 65, in _callTestMethod
    self._callMaybeAsync(method)
  File "/usr/lib64/python3.8/unittest/async_case.py", line 84, in _callMaybeAsync
    ret = func(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 158, in test_compute_cve_package_exclusions
    actual = AsyncErrataUtils.compute_cve_package_exclusions(attached_builds, cve_components)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 117, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
FAIL: test_associate_builds_with_cves_bz (tests.test_attach_cve_flaws_cli.TestAttachCVEFlawsCLI)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/asynctest/case.py", line 297, in run
    self._run_test_method(testMethod)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/asynctest/case.py", line 354, in _run_test_method
    self.loop.run_until_complete(result)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/asynctest/case.py", line 224, in wrapper
    return method(*args, **kwargs)
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1363, in patched
    return await func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_attach_cve_flaws_cli.py", line 104, in test_associate_builds_with_cves_bz
    fake_urils_associate_builds_with_cves.assert_awaited_once_with(
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2245, in assert_awaited_once_with
    return self.assert_awaited_with(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 2233, in assert_awaited_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected await not found.
Expected: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='140583624280576'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'b', 'a', 'd'}, 'CVE-2099-3': {'b', 'c', 'a', 'd'}, 'CVE-2099-2': {'c', 'e'}}, dry_run=False)
Actual: associate_builds_with_cves(<AsyncMock spec='AsyncErrataAPI' id='140583624280576'>, 12345, ['a-1.0.0-1.el8', 'b-1.0.0-1.el8', 'c-1.0.0-1.el8', 'd-1.0.0-1.el8', 'a-1.0.0-1.el7', 'e-1.0.0-1.el7', 'f-1.0.0-1.el7'], {'CVE-2099-1': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fdc2ced1eb0>, 'components': {'b', 'a', 'd'}}, 'CVE-2099-3': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fdc2ced1b80>, 'components': {'b', 'c', 'a', 'd'}}, 'CVE-2099-2': {'bug': <elliottlib.bzutil.BugzillaBug object at 0x7fdc2ced1c10>, 'components': {'c', 'e'}}}, dry_run=False)

----------------------------------------------------------------------
Ran 170 tests in 0.791s

FAILED (failures=1, errors=2)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #11

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev212+gd3db721.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.13,async-timeout==4.0.2,asynctest==0.13.0,attrs==22.1.0,Brotli==1.0.9,cachetools==5.2.0,cchardet==2.1.7,certifi==2022.12.7,cffi==1.15.1,chardet==5.1.0,charset-normalizer==2.1.1,click==8.1.3,colorama==0.4.6,coverage==6.5.0,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.30.0,exceptiongroup==1.0.4,filelock==3.8.2,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.11.2,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.0,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.3,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==22.0,platformdirs==2.6.0,pluggy==1.0.0,ply==3.11,pycares==4.3.0,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.1,pygit2==1.10.1,pylint==2.15.8,pyproject_api==1.2.1,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev212%2Bgd3db721.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.0.5,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==4.0.10,typing_extensions==4.4.0,urllib3==1.26.13,virtualenv==20.17.1,wrapt==1.14.1,yarl==1.8.2
py38 run-test-pre: PYTHONHASHSEED='4043626108'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
................................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................No flaw bugs could be found for these trackers: {'OCPBUGS-2'}
...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
...........................E.E...................Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
.............../usr/lib64/python3.8/asyncio/base_events.py:654: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
  _warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
..............................
======================================================================
ERROR: test_associate_builds_with_cves (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/async_case.py", line 65, in _callTestMethod
    self._callMaybeAsync(method)
  File "/usr/lib64/python3.8/unittest/async_case.py", line 88, in _callMaybeAsync
    return self._asyncioTestLoop.run_until_complete(fut)
  File "/usr/lib64/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/lib64/python3.8/unittest/async_case.py", line 102, in _asyncioLoopRunner
    ret = await awaitable
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/lib/python3.8/site-packages/mock/mock.py", line 1363, in patched
    return await func(*newargs, **newkeywargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 206, in test_associate_builds_with_cves
    actual = await AsyncErrataUtils.associate_builds_with_cves(api, 1, attached_builds, cve_components, dry_run=False)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 248, in associate_builds_with_cves
    expected_cve_packages_exclusions = cls.compute_cve_package_exclusions(attached_builds, cve_components_mapping)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 124, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

======================================================================
ERROR: test_compute_cve_package_exclusions (tests.test_errata_async.TestAsyncErrataUtils)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.8/unittest/async_case.py", line 65, in _callTestMethod
    self._callMaybeAsync(method)
  File "/usr/lib64/python3.8/unittest/async_case.py", line 84, in _callMaybeAsync
    ret = func(*args, **kwargs)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/tests/test_errata_async.py", line 163, in test_compute_cve_package_exclusions
    actual = AsyncErrataUtils.compute_cve_package_exclusions(attached_builds, cve_components)
  File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-464/elliottlib/errata_async.py", line 124, in compute_cve_package_exclusions
    components = cve_dict['components']
TypeError: 'set' object is not subscriptable

----------------------------------------------------------------------
Ran 170 tests in 0.768s

FAILED (errors=2)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR:   py38: commands failed
openshift-bot commented 1 year ago

Build #14

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 create: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev224+g4edbe5a.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.13.2,async-timeout==4.0.2,asynctest==0.13.0,attrs==22.2.0,Brotli==1.0.9,cachetools==5.2.1,cchardet==2.1.7,certifi==2022.12.7,cffi==1.15.1,chardet==5.1.0,charset-normalizer==2.1.1,click==8.1.3,colorama==0.4.6,coverage==7.0.5,cryptography==39.0.0,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.30.0,exceptiongroup==1.1.0,filelock==3.9.0,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.3,gssapi==1.8.2,idna==3.4,iniconfig==2.0.0,isort==5.11.4,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.1,krb5==0.4.1,lazy-object-proxy==1.9.0,mccabe==0.7.0,mock==5.0.1,multidict==6.0.4,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==23.0,platformdirs==2.6.2,pluggy==1.0.0,ply==3.11,pycares==4.3.0,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.1,pygit2==1.10.1,pylint==2.15.10,pyproject_api==1.4.0,pyspnego==0.7.0,pytest==7.2.1,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.2,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev224%2Bg4edbe5a.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.1.0,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==4.3.4,typing_extensions==4.4.0,urllib3==1.26.14,virtualenv==20.17.1,wrapt==1.14.1,yarl==1.8.2
py38 run-test-pre: PYTHONHASHSEED='4247960596'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
.............................................Cannot find any corresponding flaw bugs for these trackers: [13]. These trackers do not have a valid whiteboard component value: [12].
..BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..................../usr/lib64/python3.8/asyncio/base_events.py:654: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
  _warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
............................Bug(s) ['OCPBUGS-6', 'OCPBUGS-4', 'OCPBUGS-5'] have CVE in description but do not have TrackerBug labels. Please investigate.
.............................................
----------------------------------------------------------------------
Ran 167 tests in 0.746s

OK
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe3a408cee0>
py38 run-test: commands[1] | coverage report
Name                                              Stmts   Miss Branch BrPart  Cover
-----------------------------------------------------------------------------------
elliottlib/__init__.py                                8      2      2      1    70%
elliottlib/assembly.py                               92      9     54      7    89%
elliottlib/assertion.py                              11      0      6      0   100%
elliottlib/brew.py                                  328    188    134      5    36%
elliottlib/bug/__init__.py                            0      0      0      0   100%
elliottlib/build_finder.py                          114     12     74     15    86%
elliottlib/bzutil.py                                775    306    324     26    56%
elliottlib/cincinnati.py                             21     21      4      0     0%
elliottlib/cli/__init__.py                            0      0      0      0   100%
elliottlib/cli/__main__.py                          270    270     75      0     0%
elliottlib/cli/add_metadata_cli.py                   28     28      4      0     0%
elliottlib/cli/advisory_commons_cli.py               90     90     38      0     0%
elliottlib/cli/advisory_drop_cli.py                  37     37     14      0     0%
elliottlib/cli/advisory_images_cli.py                14     14      2      0     0%
elliottlib/cli/advisory_impetus_cli.py               22     22      6      0     0%
elliottlib/cli/attach_bugs_cli.py                    37     37     18      0     0%
elliottlib/cli/attach_cve_flaws_cli.py              130     66     58      9    45%
elliottlib/cli/change_state_cli.py                   44     44     16      0     0%
elliottlib/cli/cli_opts.py                           15      0     17      0   100%
elliottlib/cli/common.py                             48     12      6      1    69%
elliottlib/cli/create_cli.py                         70     70     20      0     0%
elliottlib/cli/create_placeholder_cli.py             36     36     12      0     0%
elliottlib/cli/create_textonly_cli.py                51     51      8      0     0%
elliottlib/cli/find_bugs_blocker_cli.py              43      4     10      3    87%
elliottlib/cli/find_bugs_qe_cli.py                   36      4      6      0    90%
elliottlib/cli/find_bugs_sweep_cli.py               204     32    116     20    81%
elliottlib/cli/find_builds_cli.py                   267    198    179      2    19%
elliottlib/cli/get_golang_versions_cli.py            56      8     32     10    80%
elliottlib/cli/list_cli.py                           14     14      2      0     0%
elliottlib/cli/puddle_advisories_cli.py              34     34      8      0     0%
elliottlib/cli/remove_bugs_cli.py                    46      6     14      6    80%
elliottlib/cli/repair_bugs_cli.py                    61      5     26      6    87%
elliottlib/cli/rhcos_cli.py                          93     93     52      0     0%
elliottlib/cli/rpmdiff_cli.py                       102    102     34      0     0%
elliottlib/cli/tag_builds_cli.py                    128    128     62      0     0%
elliottlib/cli/tarball_sources_cli.py                83     83     26      0     0%
elliottlib/cli/validate_rhsa.py                      45     45     16      0     0%
elliottlib/cli/verify_attached_bugs_cli.py          256     91    167     20    57%
elliottlib/cli/verify_attached_operators_cli.py     118     85     55      0    19%
elliottlib/cli/verify_cvp_cli.py                    165    165     78      0     0%
elliottlib/constants.py                              52      0      0      0   100%
elliottlib/cvp.py                                   216    216    113      0     0%
elliottlib/dotconfig.py                              54     11     30      6    75%
elliottlib/errata.py                                307    193    132      4    34%
elliottlib/errata_async.py                          142     10     58      9    90%
elliottlib/exceptions.py                             12      0      0      0   100%
elliottlib/exectools.py                              84     13     24      3    83%
elliottlib/gitdata.py                               171    137     76      0    14%
elliottlib/imagecfg.py                               21      2      0      0    90%
elliottlib/logutil.py                                 9      1      2      1    82%
elliottlib/metadata.py                              154     43     76     18    67%
elliottlib/model.py                                 105     22     30      2    79%
elliottlib/openshiftclient.py                        34     34      8      0     0%
elliottlib/pushd.py                                  21      0      2      0   100%
elliottlib/resultsdb.py                              28     28      4      0     0%
elliottlib/rhcos.py                                  63     63     16      0     0%
elliottlib/rpm_utils.py                              30     14     16      5    46%
elliottlib/rpmcfg.py                                  5      2      0      0    60%
elliottlib/rpmdiff.py                                31      0      0      0   100%
elliottlib/runtime.py                               278    202    106      2    22%
elliottlib/tarball_sources.py                        90     61     34      0    30%
elliottlib/util.py                                  297    139    110     15    50%
-----------------------------------------------------------------------------------
TOTAL                                              6196   3603   2612    196    39%
py38 run-test: commands[2] | flake8
___________________________________ summary ____________________________________
  py38: commands succeeded
  congratulations :)
openshift-bot commented 1 year ago

Build #15

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev226+g75b74ce.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.13.2,async-timeout==4.0.2,asynctest==0.13.0,attrs==22.2.0,Brotli==1.0.9,cachetools==5.2.1,cchardet==2.1.7,certifi==2022.12.7,cffi==1.15.1,chardet==5.1.0,charset-normalizer==2.1.1,click==8.1.3,colorama==0.4.6,coverage==7.0.5,cryptography==39.0.0,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.30.0,exceptiongroup==1.1.0,filelock==3.9.0,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.3,gssapi==1.8.2,idna==3.4,iniconfig==2.0.0,isort==5.11.4,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.1,krb5==0.4.1,lazy-object-proxy==1.9.0,mccabe==0.7.0,mock==5.0.1,multidict==6.0.4,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==23.0,platformdirs==2.6.2,pluggy==1.0.0,ply==3.11,pycares==4.3.0,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.1,pygit2==1.10.1,pylint==2.15.10,pyproject_api==1.4.0,pyspnego==0.7.0,pytest==7.2.1,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.2,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev226%2Bg75b74ce.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.1.0,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==4.3.4,typing_extensions==4.4.0,urllib3==1.26.14,virtualenv==20.17.1,wrapt==1.14.1,yarl==1.8.2
py38 run-test-pre: PYTHONHASHSEED='3636960952'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
.............................................Cannot find any corresponding flaw bugs for these trackers: [13]. These trackers do not have a valid whiteboard component value: [12].
..BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..................../usr/lib64/python3.8/asyncio/base_events.py:654: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
  _warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
............................Bug(s) ['OCPBUGS-5', 'OCPBUGS-6', 'OCPBUGS-4'] have CVE in description but do not have TrackerBug labels. Please investigate.
.............................................
----------------------------------------------------------------------
Ran 167 tests in 0.741s

OK
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc286254b20>
py38 run-test: commands[1] | coverage report
Name                                              Stmts   Miss Branch BrPart  Cover
-----------------------------------------------------------------------------------
elliottlib/__init__.py                                8      2      2      1    70%
elliottlib/assembly.py                               92      9     54      7    89%
elliottlib/assertion.py                              11      0      6      0   100%
elliottlib/brew.py                                  328    188    134      5    36%
elliottlib/bug/__init__.py                            0      0      0      0   100%
elliottlib/build_finder.py                          114     12     74     15    86%
elliottlib/bzutil.py                                770    302    320     26    56%
elliottlib/cincinnati.py                             21     21      4      0     0%
elliottlib/cli/__init__.py                            0      0      0      0   100%
elliottlib/cli/__main__.py                          270    270     75      0     0%
elliottlib/cli/add_metadata_cli.py                   28     28      4      0     0%
elliottlib/cli/advisory_commons_cli.py               90     90     38      0     0%
elliottlib/cli/advisory_drop_cli.py                  37     37     14      0     0%
elliottlib/cli/advisory_images_cli.py                14     14      2      0     0%
elliottlib/cli/advisory_impetus_cli.py               22     22      6      0     0%
elliottlib/cli/attach_bugs_cli.py                    37     37     18      0     0%
elliottlib/cli/attach_cve_flaws_cli.py              130     66     58      9    45%
elliottlib/cli/change_state_cli.py                   44     44     16      0     0%
elliottlib/cli/cli_opts.py                           15      0     17      0   100%
elliottlib/cli/common.py                             48     12      6      1    69%
elliottlib/cli/create_cli.py                         70     70     20      0     0%
elliottlib/cli/create_placeholder_cli.py             36     36     12      0     0%
elliottlib/cli/create_textonly_cli.py                51     51      8      0     0%
elliottlib/cli/find_bugs_blocker_cli.py              43      4     10      3    87%
elliottlib/cli/find_bugs_qe_cli.py                   36      4      6      0    90%
elliottlib/cli/find_bugs_sweep_cli.py               204     32    116     20    81%
elliottlib/cli/find_builds_cli.py                   267    198    179      2    19%
elliottlib/cli/get_golang_versions_cli.py            56      8     32     10    80%
elliottlib/cli/list_cli.py                           14     14      2      0     0%
elliottlib/cli/puddle_advisories_cli.py              34     34      8      0     0%
elliottlib/cli/remove_bugs_cli.py                    46      6     14      6    80%
elliottlib/cli/repair_bugs_cli.py                    61      5     26      6    87%
elliottlib/cli/rhcos_cli.py                          93     93     52      0     0%
elliottlib/cli/rpmdiff_cli.py                       102    102     34      0     0%
elliottlib/cli/tag_builds_cli.py                    128    128     62      0     0%
elliottlib/cli/tarball_sources_cli.py                83     83     26      0     0%
elliottlib/cli/validate_rhsa.py                      45     45     16      0     0%
elliottlib/cli/verify_attached_bugs_cli.py          256     91    167     20    57%
elliottlib/cli/verify_attached_operators_cli.py     118     85     55      0    19%
elliottlib/cli/verify_cvp_cli.py                    165    165     78      0     0%
elliottlib/constants.py                              52      0      0      0   100%
elliottlib/cvp.py                                   216    216    113      0     0%
elliottlib/dotconfig.py                              54     11     30      6    75%
elliottlib/errata.py                                309    195    132      4    34%
elliottlib/errata_async.py                          142     10     58      9    90%
elliottlib/exceptions.py                             12      0      0      0   100%
elliottlib/exectools.py                              84     13     24      3    83%
elliottlib/gitdata.py                               171    137     76      0    14%
elliottlib/imagecfg.py                               21      2      0      0    90%
elliottlib/logutil.py                                 9      1      2      1    82%
elliottlib/metadata.py                              154     43     76     18    67%
elliottlib/model.py                                 105     22     30      2    79%
elliottlib/openshiftclient.py                        34     34      8      0     0%
elliottlib/pushd.py                                  21      0      2      0   100%
elliottlib/resultsdb.py                              28     28      4      0     0%
elliottlib/rhcos.py                                  63     63     16      0     0%
elliottlib/rpm_utils.py                              30     14     16      5    46%
elliottlib/rpmcfg.py                                  5      2      0      0    60%
elliottlib/rpmdiff.py                                31      0      0      0   100%
elliottlib/runtime.py                               278    202    106      2    22%
elliottlib/tarball_sources.py                        90     61     34      0    30%
elliottlib/util.py                                  297    139    110     15    50%
-----------------------------------------------------------------------------------
TOTAL                                              6193   3601   2608    196    39%
py38 run-test: commands[2] | flake8
___________________________________ summary ____________________________________
  py38: commands succeeded
  congratulations :)
Ximinhan commented 1 year ago

/lgtm

openshift-bot commented 1 year ago

Build #16

GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/setup.py
py38 recreate: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev229+g80e6087.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.13.2,async-timeout==4.0.2,asynctest==0.13.0,attrs==22.2.0,Brotli==1.0.9,cachetools==5.2.1,cchardet==2.1.7,certifi==2022.12.7,cffi==1.15.1,chardet==5.1.0,charset-normalizer==2.1.1,click==8.1.3,colorama==0.4.6,coverage==7.0.5,cryptography==39.0.0,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.30.0,exceptiongroup==1.1.0,filelock==3.9.0,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.3,gssapi==1.8.2,idna==3.4,iniconfig==2.0.0,isort==5.11.4,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.1,krb5==0.4.1,lazy-object-proxy==1.9.0,mccabe==0.7.0,mock==5.0.1,multidict==6.0.4,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==23.0,platformdirs==2.6.2,pluggy==1.0.0,ply==3.11,pycares==4.3.0,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.1,pygit2==1.10.1,pylint==2.15.10,pyproject_api==1.5.0,pyspnego==0.7.0,pytest==7.2.1,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.2,requests-gssapi==1.2.3,requests-kerberos==0.14.0,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-464/.tox/.tmp/package/1/rh-elliott-2.0.14.dev229%2Bg80e6087.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.1.0,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==4.3.4,typing_extensions==4.4.0,urllib3==1.26.14,virtualenv==20.17.1,wrapt==1.14.1,yarl==1.8.2
py38 run-test-pre: PYTHONHASHSEED='3713363595'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
.............................................Cannot find any corresponding flaw bugs for these trackers: [13]. These trackers do not have a valid whiteboard component value: [12].
..BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....................changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..................../usr/lib64/python3.8/asyncio/base_events.py:654: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
  _warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
............................Bug(s) ['OCPBUGS-4', 'OCPBUGS-6', 'OCPBUGS-5'] have CVE in description but do not have TrackerBug labels. Please investigate.
.............................................
----------------------------------------------------------------------
Ran 167 tests in 0.708s

OK
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb96342b520>
py38 run-test: commands[1] | coverage report
Name                                              Stmts   Miss Branch BrPart  Cover
-----------------------------------------------------------------------------------
elliottlib/__init__.py                                8      2      2      1    70%
elliottlib/assembly.py                               92      9     54      7    89%
elliottlib/assertion.py                              11      0      6      0   100%
elliottlib/brew.py                                  328    188    134      5    36%
elliottlib/bug/__init__.py                            0      0      0      0   100%
elliottlib/build_finder.py                          114     12     74     15    86%
elliottlib/bzutil.py                                770    302    320     26    56%
elliottlib/cincinnati.py                             21     21      4      0     0%
elliottlib/cli/__init__.py                            0      0      0      0   100%
elliottlib/cli/__main__.py                          270    270     75      0     0%
elliottlib/cli/add_metadata_cli.py                   28     28      4      0     0%
elliottlib/cli/advisory_commons_cli.py               90     90     38      0     0%
elliottlib/cli/advisory_drop_cli.py                  37     37     14      0     0%
elliottlib/cli/advisory_images_cli.py                14     14      2      0     0%
elliottlib/cli/advisory_impetus_cli.py               22     22      6      0     0%
elliottlib/cli/attach_bugs_cli.py                    37     37     18      0     0%
elliottlib/cli/attach_cve_flaws_cli.py              130     66     58      9    45%
elliottlib/cli/change_state_cli.py                   44     44     16      0     0%
elliottlib/cli/cli_opts.py                           15      0     17      0   100%
elliottlib/cli/common.py                             48     12      6      1    69%
elliottlib/cli/create_cli.py                         70     70     20      0     0%
elliottlib/cli/create_placeholder_cli.py             36     36     12      0     0%
elliottlib/cli/create_textonly_cli.py                51     51      8      0     0%
elliottlib/cli/find_bugs_blocker_cli.py              43      4     10      3    87%
elliottlib/cli/find_bugs_qe_cli.py                   36      4      6      0    90%
elliottlib/cli/find_bugs_sweep_cli.py               207     33    118     21    81%
elliottlib/cli/find_builds_cli.py                   267    198    179      2    19%
elliottlib/cli/get_golang_versions_cli.py            56      8     32     10    80%
elliottlib/cli/list_cli.py                           14     14      2      0     0%
elliottlib/cli/puddle_advisories_cli.py              34     34      8      0     0%
elliottlib/cli/remove_bugs_cli.py                    46      6     14      6    80%
elliottlib/cli/repair_bugs_cli.py                    61      5     26      6    87%
elliottlib/cli/rhcos_cli.py                          93     93     52      0     0%
elliottlib/cli/rpmdiff_cli.py                       102    102     34      0     0%
elliottlib/cli/tag_builds_cli.py                    128    128     62      0     0%
elliottlib/cli/tarball_sources_cli.py                83     83     26      0     0%
elliottlib/cli/validate_rhsa.py                      45     45     16      0     0%
elliottlib/cli/verify_attached_bugs_cli.py          256     91    167     20    57%
elliottlib/cli/verify_attached_operators_cli.py     118     85     55      0    19%
elliottlib/cli/verify_cvp_cli.py                    165    165     78      0     0%
elliottlib/constants.py                              52      0      0      0   100%
elliottlib/cvp.py                                   216    216    113      0     0%
elliottlib/dotconfig.py                              54     11     30      6    75%
elliottlib/errata.py                                309    195    132      4    34%
elliottlib/errata_async.py                          142     10     58      9    90%
elliottlib/exceptions.py                             12      0      0      0   100%
elliottlib/exectools.py                              84     13     24      3    83%
elliottlib/gitdata.py                               171    137     76      0    14%
elliottlib/imagecfg.py                               21      2      0      0    90%
elliottlib/logutil.py                                 9      1      2      1    82%
elliottlib/metadata.py                              154     43     76     18    67%
elliottlib/model.py                                 105     22     30      2    79%
elliottlib/openshiftclient.py                        34     34      8      0     0%
elliottlib/pushd.py                                  21      0      2      0   100%
elliottlib/resultsdb.py                              28     28      4      0     0%
elliottlib/rhcos.py                                  63     63     16      0     0%
elliottlib/rpm_utils.py                              30     14     16      5    46%
elliottlib/rpmcfg.py                                  5      2      0      0    60%
elliottlib/rpmdiff.py                                31      0      0      0   100%
elliottlib/runtime.py                               278    202    106      2    22%
elliottlib/tarball_sources.py                        90     61     34      0    30%
elliottlib/util.py                                  297    139    110     15    50%
-----------------------------------------------------------------------------------
TOTAL                                              6196   3602   2610    197    39%
py38 run-test: commands[2] | flake8
___________________________________ summary ____________________________________
  py38: commands succeeded
  congratulations :)
openshift-ci[bot] commented 1 year ago

New changes are detected. LGTM label has been removed.