search

openstack-charmers / zaza

A Python3-only functional test framework for Charms
Apache License 2.0
10 stars 46 forks source link

functest-run-suite -b does not run multiple bundles #614

Open mert-kirpici opened 12 months ago

mert-kirpici commented 12 months ago

here is an example workflow run where only one of the specified bundles were run. (the last one given on the command line)

the related tests.yaml file

ajkavanagh commented 12 months ago

here is an example workflow run where only one of the specified bundles were run. (the last one given on the command line)

the related tests.yaml file

I think it needs to be -b jammy -b focal for it to pick up the second bundle. i.e. the -b option is repeated, and a single one doesn't take a list of bundles.

mert-kirpici commented 12 months ago

I think it needs to be -b jammy -b focal for it to pick up the second bundle. i.e. the -b option is repeated, and a single one doesn't take a list of bundles.

Hi @ajkavanagh I also ran the tests as you mentioned, however it results in the same behavior. here is the workflow output for that case.

ajkavanagh commented 12 months ago

@mert-kirpici it looks like other nasty stuff is going on:

Error: -13 17:30:13 [ERROR] Error in watcher
Traceback (most recent call last):
  File "/home/runner/work/charm-prometheus-juju-exporter/charm-prometheus-juju-exporter/.tox/func31/lib/python3.10/site-packages/juju/model.py", line 1207, in _all_watcher
    old_obj, new_obj = self.state.apply_delta(entity)
  File "/home/runner/work/charm-prometheus-juju-exporter/charm-prometheus-juju-exporter/.tox/func31/lib/python3.10/site-packages/juju/model.py", line 216, in apply_delta
    entity = self.get_entity(delta.entity, delta.get_id())
  File "/home/runner/work/charm-prometheus-juju-exporter/charm-prometheus-juju-exporter/.tox/func31/lib/python3.10/site-packages/juju/model.py", line 240, in get_entity
    return entity_class(
  File "/home/runner/work/charm-prometheus-juju-exporter/charm-prometheus-juju-exporter/.tox/func31/lib/python3.10/site-packages/juju/action.py", line 9, in __init__
    self._status = self.data['status']
TypeError: 'NoneType' object is not subscriptable

These are happening in juju; I'm not sure if this is throwing out the error handling in zaza and causing it to not run the next bundle.