googleapis / python-aiplatform

A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.
Apache License 2.0
615 stars 328 forks source link

tests.system.aiplatform.test_pipeline_job.TestPipelineJob: test_add_pipeline_job_to_experiment failed #2315

Closed flaky-bot[bot] closed 3 months ago

flaky-bot[bot] commented 1 year ago

Note: #1958 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.


commit: 2235305c7714835ff331e5294f90a6a23e31391d buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: cb2a56306029f9fcdd176c4e5210688545007c11 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: 910c22aeb78edc88c0829a098540597bed093c45 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: 05c1912adceb09d63d8b51cc56ff7f52fc679594 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: 8271301454814b233a630d1c18ebe5e4833fcec2 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: afd0461c99fc540f8cbdf4f806f209c5796cfc83 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: d698602e15fa3f617f1ac31e28951c452399a816 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: bd4628658720654eb95c117be6a8476ba964c7b4 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: 946b1ab382f9ebb17be2a9aa4845addb7b2e3064 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 11 months ago

commit: 23dae360031967adcd4261579c3fe860b2771958 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: c22220ef5db440020331634f5e25199c575cc886 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 7d667f9f8be264bb36e3d720caa0d8210aec5d6b buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: e1cedbacf9bc8eff6828684e66a2180f835ece8d buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: c648620625034b130762bbb2cd9743c57de197f4 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: b9c90489d8e6dda8804f872d9236551e8fafec36 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: f9782007c58ee11fe276c373d8d7ac6c2b0cb249 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: fc50c9d955cd2c3cfbfd38daa6656ecc2aa09d58 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 3af9f78095416ae57d97b3fe20f6f1f06d700132 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 69a67f203627e4ee7d5980ce874d4db1e6af5dd8 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 603cdbe389ec551e47ef8a331c9a0f944095c97c buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 06bf487e51e26dfa1cab3f6d87c9f3afd45e0e2c buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: f04ca35894e09bbe75d47a65bf540e95df6fe610 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 8db915636bb7c7cb6a258a60c07b1b68275f3094 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 9fedd34d004a60c7105c066085a296bc12b28138 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 9b7525987e05f6b63300440267fcdefea4caf35c buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 7aaffe505aa8e7bff86af5a3674085b8ff822107 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: e76abd3901644f99ec6850b35e155d8b2c54008a buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: 587df744e2b6c4b3e1a96ff69937697fe80a97be buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: bf1be87ef518df93328e50a659dd17b37aa42bf9 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 11 months ago

commit: eaf5d816a7a752373243033ea98146d70987ce18 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 1704db8000bce2732bf0219a2f7da3e2b9379048 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: e45cbb17e7940363e74c6b86ca072cd646b737da buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 794434856713b4aab6aa32e8dd37b3d767136c78 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 0c371a4bd0adca8bec41dca6ef95e8a1011404f4 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 598d57d24ea613130a74bf7db86c757a668626b8 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: b4cdb05b12b82d3b9f605382828e3f854d985951 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: c19b6c3e88293f231aae0c9939e41c9e0f064ee7 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 9a26ce0db5588c9958e26f6bd6256a18536bd449 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: cbe3a0de14a2ee189df07f445545f68fa4bdd4ae buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: eb6071fe567ef80ba5490b9eaae0cedd6958aac5 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: d23999b970e4f673095609a1cbac98a30465c887 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 11e29138a814e84971c5f2545fe42bf769c954dc buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 1ff90ac8c21901b9525926a442b762919d744672 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: ffbd87228ecc8d1f534e66d31301597822625b6a buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 3d434979659f8801921745600b1ee82f725937cc buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 8e42bc5e97d7f74a7ccba059be8327c61a342391 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 62e43d4e3492f970c7282f830af82fae9dfc27b5 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 50f857f47dc854851ca5812840c79f260d61c868 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 0b825c9f4615d119859dc3c3ecaf558614d5e148 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: 1def3f6213e4468ddf0c3b55a05fa028f12e6949 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError
flaky-bot[bot] commented 10 months ago

commit: ad19838ebc51215dc6c2fe0f373a4773877a0fb6 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:181: KeyError