googleapis / python-aiplatform

A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.
Apache License 2.0
589 stars 318 forks source link

tests.system.aiplatform.test_pipeline_job.TestPipelineJob: test_add_pipeline_job_to_experiment failed #2315

Closed flaky-bot[bot] closed 1 month ago

flaky-bot[bot] commented 1 year ago

Note: #1958 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.


commit: 2235305c7714835ff331e5294f90a6a23e31391d buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 1 year ago

commit: 8abd9e4fb6b9ffbb32457949323c4fd8922ee99c buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 1 year ago

commit: bf0e20b497675125e0bc5abc10455b06f7a0c019 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 1 year ago

commit: 5bcf6022d698eca0d64db6076e921c8ae4c0b5b9 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 1 year ago

commit: 750e16179e1a53bc916ae6db93cd28cfd3f911fe buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: dec8ffd80d8804d4a5afaccc1c748d886225b6bf buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 57806fb947e5b692cd8d4701e572eaf54585d383 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 06c9d1859279d09adb3a4f5351bcc9ec408df318 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 3a97c523c8223f7f007008769ecb2efd0d44d182 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: f3b25ab694eaee18f5cc34f800f1b6021d291bca buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 9eed3b7f1587d1daa56993d3dc3dd476b746e772 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 65e263cab9f8d09fde15420a44a9a1d51fa03d5d buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 593b54fefd1a410dfb67209589b0bb57f86d6656 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: f8f2b9cdf88f40fe0b7e86948515ab1cf72d92be buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 18e8bb283e80fa9efb26f5fe3f8997b0b038bb12 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: faead25ec27cb560e29d3ac3c63efe68572b303e buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 4e76a6e8338e1736274744551e2f32d3405c3685 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 8df5185d668292d5adc11ebf9477e2fdd44599d4 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: ba636f64523e3918299fd667eaedfaa1652614bb buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 3a8348bca2d9c74e5e52fb9fc131fdb766f49a5c buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: cbf9b6ee806d7eb89725f53c4509858a272b3141 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: e6d1e95e982824a95d662b190c0c70d0c90c5d00 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 62ff30daa718ac7869714c68e55d6955d6355945 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: ff5cfa1e789a4bbc17a9f83bb60e09cb0e646e5a buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: 7eaa1d4216f0494897606b1225c3b3599a235544 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: d11b8e67607fb9c526d04869cab47f23789bc8d7 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 11 months ago

commit: c60b9ca2dd8c9bbdee6d8b745ff5fa849fa38fe9 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 3d468ed10629e3d0f211f413af054e21620e5952 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:178: KeyError
flaky-bot[bot] commented 10 months ago

commit: 339593e377e3d1dccb9d58f3ad6221796d175ecd buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 61733c8120868620e1839bfae12fb90fd9a677ca buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 2a085354ed921485493b482c0f4e96f3f49d06f0 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: b3ac4a36c259944b5310909f5eca1f537f4d182a buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 91176aa0e61ea23be2dc5e1b178b8db362a64ee2 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 0fb50c7dc4e8a6ce6895ec2850d042b0a71ec93d buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 2bd494bc2359999531507f2f74f90b15458b3126 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 50c15917e9c102241319d94efddb60d548ea98fd buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: a1344610f761bfac4a2f4523130e57466d177471 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: d62bb1b2d9a41e700e3564012e70735e5148bb80 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 5dba09b18d461f7e498303cd6d119efa05c96cb3 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: e7fbecceb0a33fc5f0135bd65ee798b2236020cc buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 078d9e338a28a20de4a4a9ee7d0323641fff2a51 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 4256361e6b154464984e586ba215b69553bd0c61 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: d51693115a32c054bf5f10ebe7fd2c52ea1ac2d7 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: f7feeca2161df7c12c993116364a663c4249f852 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 0fa47aea08b635159e9c6dc64f7d330f047dfb5d buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 0743afbfd0c53f314a43cfa87255dde83bd5f465 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 8b0add169ebd0683b56dbe3b643d533ebbd5e1ca buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: e9eb159756dfe90c9f72818204fa74d05096aec6 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 6fb30bc0c955c624410df8c01947e971409ddce2 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 3be36e6c17ef5e335d4f12af7a7c64702b76570e buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError
flaky-bot[bot] commented 10 months ago

commit: 7483fb42e9666811035d259d6066f23cfd2c0761 buildURL: Build Status, Sponge status: failed

Test output
self = 
shared_state = {}

    @pytest.fixture(scope="class")
    def tear_down_resources(self, shared_state: Dict[str, Any]):
        """Delete every Vertex AI resource created during test"""

        yield

        # TODO(b/218310362): Add resource deletion system tests
        # Bring all Endpoints to the front of the list
        # Ensures Models are undeployed first before we attempt deletion
>       shared_state["resources"].sort(
            key=lambda r: 1
            if isinstance(r, aiplatform.Endpoint)
            or isinstance(r, aiplatform.MatchingEngineIndexEndpoint)
            or isinstance(r, aiplatform.Experiment)
            else 2
        )
E       KeyError: 'resources'

tests/system/aiplatform/e2e_base.py:180: KeyError