openshift-bot
commented
1 year ago Build #1
GLOB sdist-make: /mnt/workspace/jenkins/working/art-tools_elliott_PR-487/setup.py
py38 create: /mnt/workspace/jenkins/working/art-tools_elliott_PR-487/.tox/py38
py38 installdeps: -rrequirements-dev.txt
py38 inst: /mnt/workspace/jenkins/working/art-tools_elliott_PR-487/.tox/.tmp/package/1/rh-elliott-2.0.14.dev217+g2d204d6.zip
py38 installed: aiodns==3.0.0,aiohttp==3.8.3,aiosignal==1.3.1,astroid==2.12.13,async-timeout==4.0.2,asynctest==0.13.0,attrs==22.1.0,Brotli==1.0.9,cachetools==5.2.0,cchardet==2.1.7,certifi==2022.12.7,cffi==1.15.1,chardet==5.1.0,charset-normalizer==2.1.1,click==8.1.3,colorama==0.4.6,coverage==7.0.0,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.6,distlib==0.3.6,errata-tool==1.30.0,exceptiongroup==1.0.4,filelock==3.8.2,flake8==6.0.0,flexmock==0.11.3,frozenlist==1.3.3,future==0.18.2,gssapi==1.8.2,idna==3.4,iniconfig==1.1.1,isort==5.11.3,jira==3.4.1,jsonpath-rw==1.4.0,koji==1.31.0,lazy-object-proxy==1.8.0,mccabe==0.7.0,mock==4.0.3,multidict==6.0.3,mypy==0.991,mypy-extensions==0.4.3,oauthlib==3.2.2,packaging==22.0,platformdirs==2.6.0,pluggy==1.0.0,ply==3.11,pycares==4.3.0,pycodestyle==2.10.0,pycparser==2.21,pyflakes==3.0.1,pygit2==1.10.1,pylint==2.15.9,pyproject_api==1.2.1,pytest==7.2.0,python-bugzilla==3.2.0,python-dateutil==2.8.2,PyYAML==6.0,requests==2.28.1,requests-gssapi==1.2.3,requests-oauthlib==1.3.1,requests-toolbelt==0.10.1,rh-elliott @ file:///mnt/workspace/jenkins/working/art-tools_elliott_PR-487/.tox/.tmp/package/1/rh-elliott-2.0.14.dev217%2Bg2d204d6.zip,ruamel.yaml==0.17.21,ruamel.yaml.clib==0.2.7,semver==2.13.0,setuptools-scm==7.1.0,six==1.16.0,tenacity==8.1.0,tomli==2.0.1,tomlkit==0.11.6,tox==4.0.15,typing_extensions==4.4.0,urllib3==1.26.13,virtualenv==20.17.1,wrapt==1.14.1,yarl==1.8.2
py38 run-test-pre: PYTHONHASHSEED='1826518401'
py38 run-test: commands[0] | coverage run --branch --source elliottlib -m unittest discover -t . -s tests/
................................................BZ 9 is ignored because its status was MODIFIED at the moment of sweep cutoff (2021-06-30 12:30:00), however its status changed back to ['ASSIGNED'] afterwards
.....E.E...............E...changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
..changed 123 from status1 to status2
.123 is already on status1
.changed 123 from status1 to status2
...............................................Bug ['OCPBUGS-4', 'OCPBUGS-5'] has CVE number in summary but does not have tracker keywords
.............../usr/lib64/python3.8/asyncio/base_events.py:654: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
_warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
............................
======================================================================
ERROR: test_get_corresponding_flaw_bugs (tests.test_bzutil.TestBugzillaBugTracker)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-487/tests/test_bzutil.py", line 94, in test_get_corresponding_flaw_bugs
actual = BugTracker.get_corresponding_flaw_bugs(tracker_bugs, bug_tracker)
File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-487/elliottlib/bzutil.py", line 450, in get_corresponding_flaw_bugs
flaw_tracker_map[flaw_bug_ids[0]].append(t)
AttributeError: 'dict' object has no attribute 'append'
======================================================================
ERROR: test_get_corresponding_flaw_bugs_bz_strict (tests.test_bzutil.TestBugzillaBugTracker)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-487/tests/test_bzutil.py", line 114, in test_get_corresponding_flaw_bugs_bz_strict
self.assertRaisesRegex(
File "/usr/lib64/python3.8/unittest/case.py", line 1357, in assertRaisesRegex
return context.handle('assertRaisesRegex', args, kwargs)
File "/usr/lib64/python3.8/unittest/case.py", line 202, in handle
callable_obj(*args, **kwargs)
File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-487/elliottlib/bzutil.py", line 451, in get_corresponding_flaw_bugs
component = t.whiteboard_component
File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-487/elliottlib/bzutil.py", line 122, in __getattr__
return getattr(self.bug, attr)
AttributeError: 'MockClass' object has no attribute 'whiteboard_component'
======================================================================
ERROR: test_get_corresponding_flaw_bugs_jira (tests.test_bzutil.TestJIRABugTracker)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-487/tests/test_bzutil.py", line 57, in test_get_corresponding_flaw_bugs_jira
actual = BugTracker.get_corresponding_flaw_bugs(tracker_bugs, flaw_bug_tracker)
File "/mnt/workspace/jenkins/working/art-tools_elliott_PR-487/elliottlib/bzutil.py", line 450, in get_corresponding_flaw_bugs
flaw_tracker_map[flaw_bug_ids[0]].append(t)
AttributeError: 'dict' object has no attribute 'append'
----------------------------------------------------------------------
Ran 168 tests in 0.863s
FAILED (errors=3)
ERROR: InvocationError for command /mnt/workspace/jenkins/working/art-tools_elliott_PR-487/.tox/py38/bin/coverage run --branch --source elliottlib -m unittest discover -t . -s tests/ (exited with code 1)
___________________________________ summary ____________________________________
ERROR: py38: commands failed
https://issues.redhat.com/browse/ART-4347
Summary
Right now to determine if a CVE is first fix or not, we try to track all of its trackers and analyze them. With trackers now being split in jira and bugzilla, this has become a lot of effort. Luckily prodsec has their own api which has data on which components have been fixed for a cve - https://access.redhat.com/hydra/rest/securitydata/cve/CVE-2021-3121.json
affected_releaseis where fixed components are presentpackage_stateis where unfixed components are presentSo we could either filter out fixed components or search in unfixed components. I've found searching in unfixed components easier since the package name there is bare - compared to the released image / nvr in the fixed component info - therefore less amount of parsing errors.
Also validate tracker components name using brew.
The command overall is much faster now - compared to before.
Test
make testelliott -g openshift-4.12 --assembly rc.7 attach-cve-flaws --into-default-advisories --noopelliott -g openshift-4.12 --assembly rc.7 verify-attached-bugs --verify-flaws --no-verify-blocking-bugs --skip-multiple-advisories-check