databrickslabs / blueprint

Baseline for Databricks Labs projects written in Python
https://pypi.org/project/databricks-labs-blueprint/
Other
19 stars 8 forks source link

add missing stat() methods to DBFSPath and WorkspacePath #144

Closed ericvergnaud closed 1 month ago

ericvergnaud commented 1 month ago

Fixes #142 and #143

github-actions[bot] commented 1 month ago

❌ 38/40 passed, 2 failed, 1m30s total

❌ test_detect_global: AttributeError: 'PermissionDenied' object has no attribute 'message' (754ms) ``` AttributeError: 'PermissionDenied' object has no attribute 'message' 10:26 DEBUG [databricks.sdk] Loaded from environment 10:26 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:26 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw1] linux -- Python 3.10.14 /home/runner/work/blueprint/blueprint/.venv/bin/python 10:26 DEBUG [databricks.sdk] Loaded from environment 10:26 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:26 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:26 DEBUG [databricks.labs.blueprint.installation] Uploading: /Applications/Ung4/some 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "The parent folder (/Applications/Ung4) does not exist." < } 10:26 DEBUG [databricks.labs.blueprint.installation] Creating missing folders: /Applications/Ung4 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/mkdirs > { > "path": "/Applications/Ung4" > } < 403 Forbidden < { < "error_code": "PERMISSION_DENIED", < "message": "4106dc97-a963-48f0-a079-a578238959a6 does not have View permissions on 0. Please contact the own... (34 more bytes)" < } 10:26 DEBUG [databricks.sdk] Loaded from environment 10:26 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:26 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:26 DEBUG [databricks.labs.blueprint.installation] Uploading: /Applications/Ung4/some 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "The parent folder (/Applications/Ung4) does not exist." < } 10:26 DEBUG [databricks.labs.blueprint.installation] Creating missing folders: /Applications/Ung4 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/mkdirs > { > "path": "/Applications/Ung4" > } < 403 Forbidden < { < "error_code": "PERMISSION_DENIED", < "message": "4106dc97-a963-48f0-a079-a578238959a6 does not have View permissions on 0. Please contact the own... (34 more bytes)" < } [gw1] linux -- Python 3.10.14 /home/runner/work/blueprint/blueprint/.venv/bin/python ```
❌ test_existing_installations_are_detected: AttributeError: 'PermissionDenied' object has no attribute 'message' (303ms) ``` AttributeError: 'PermissionDenied' object has no attribute 'message' 10:26 DEBUG [databricks.sdk] Loaded from environment 10:26 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:26 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw1] linux -- Python 3.10.14 /home/runner/work/blueprint/blueprint/.venv/bin/python 10:26 DEBUG [databricks.sdk] Loaded from environment 10:26 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:26 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:26 DEBUG [databricks.labs.blueprint.installation] Uploading: /Applications/pgob/some 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "The parent folder (/Applications/pgob) does not exist." < } 10:26 DEBUG [databricks.labs.blueprint.installation] Creating missing folders: /Applications/pgob 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/mkdirs > { > "path": "/Applications/pgob" > } < 403 Forbidden < { < "error_code": "PERMISSION_DENIED", < "message": "4106dc97-a963-48f0-a079-a578238959a6 does not have View permissions on 0. Please contact the own... (34 more bytes)" < } 10:26 DEBUG [databricks.sdk] Loaded from environment 10:26 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:26 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:26 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:26 DEBUG [databricks.labs.blueprint.installation] Uploading: /Applications/pgob/some 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "The parent folder (/Applications/pgob) does not exist." < } 10:26 DEBUG [databricks.labs.blueprint.installation] Creating missing folders: /Applications/pgob 10:26 DEBUG [databricks.sdk] POST /api/2.0/workspace/mkdirs > { > "path": "/Applications/pgob" > } < 403 Forbidden < { < "error_code": "PERMISSION_DENIED", < "message": "4106dc97-a963-48f0-a079-a578238959a6 does not have View permissions on 0. Please contact the own... (34 more bytes)" < } [gw1] linux -- Python 3.10.14 /home/runner/work/blueprint/blueprint/.venv/bin/python ```

Running from acceptance #211

ericvergnaud commented 1 month ago

@nfx the no-cheat is about avoiding pylint errors in existing code not sure what's causing the acceptance failure. The 2 failing tests pass locally, both are marked PermissionDenied. Smells like our test infra (sandbox?) expecting a message field ?