search

databrickslabs / lsql

Lightweight SQL execution wrapper only on top of Databricks SDK
https://pypi.org/project/databricks-labs-lsql/
Other
8 stars 3 forks source link

Fix boolean cli flags #235

Closed JCZuurmond closed 1 month ago

JCZuurmond commented 1 month ago

Fix the boolean cli flags. Purely boolean flags are not supported in the databricks labs cli command. Therefore, we simulate flags by confirming with a y or yes.

github-actions[bot] commented 1 month ago

❌ 35/36 passed, 1 failed, 2 skipped, 8m47s total

❌ test_dashboards_creates_dashboard_with_replace_database: databricks.sdk.errors.platform.BadRequest: [INSUFFICIENT_PERMISSIONS] Insufficient privileges: (1.233s) ``` databricks.sdk.errors.platform.BadRequest: [INSUFFICIENT_PERMISSIONS] Insufficient privileges: User does not have permission CREATE on CATALOG. SQLSTATE: 42501 08:51 DEBUG [databricks.sdk] Loaded from environment 08:51 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 08:51 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 08:51 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 08:51 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw7] linux -- Python 3.10.14 /home/runner/work/lsql/lsql/.venv/bin/python 08:51 DEBUG [databricks.sdk] Loaded from environment 08:51 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 08:51 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 08:51 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 08:51 INFO [databricks.sdk] Using Databricks Metadata Service authentication 08:51 DEBUG [databricks.sdk] POST /api/2.0/lakeview/dashboards > { > "display_name": "created_by_lsql_LFxfIR7eEOBtUrr5" > } < 200 OK < { < "create_time": "2024-07-25T08:51:24.913Z", < "dashboard_id": "01ef4a6312c81bbc9447b609da64572a", < "display_name": "created_by_lsql_LFxfIR7eEOBtUrr5", < "etag": "-933759438", < "lifecycle_state": "ACTIVE", < "parent_path": "/Users/4106dc97-a963-48f0-a079-a578238959a6", < "path": "/Users/4106dc97-a963-48f0-a079-a578238959a6/created_by_lsql_LFxfIR7eEOBtUrr5.lvdash.json", < "serialized_dashboard": "{\"pages\":[{\"name\":\"fca6a42f\",\"displayName\":\"New Page\"}]}", < "update_time": "2024-07-25T08:51:25.066Z" < } 08:51 DEBUG [databricks.labs.lsql.backends] [api][execute] CREATE SCHEMA hive_metastore.lsql_skawl WITH DBPROPERTIES (RemoveAfter=2024072510) 08:51 DEBUG [databricks.labs.lsql.core] Executing SQL statement: CREATE SCHEMA hive_metastore.lsql_skawl WITH DBPROPERTIES (RemoveAfter=2024072510) 08:51 DEBUG [databricks.sdk] POST /api/2.0/sql/statements/ > { > "format": "JSON_ARRAY", > "statement": "CREATE SCHEMA hive_metastore.lsql_skawl WITH DBPROPERTIES (RemoveAfter=2024072510)", > "warehouse_id": "TEST_DEFAULT_WAREHOUSE_ID" > } < 200 OK < { < "statement_id": "01ef4a63-12fb-1c59-93cb-f6ac62893681", < "status": { < "error": { < "error_code": "BAD_REQUEST", < "message": "[INSUFFICIENT_PERMISSIONS] Insufficient privileges:\nUser does not have permission CREATE on CATA... (20 more bytes)" < }, < "state": "FAILED" < } < } 08:51 DEBUG [databricks.sdk] Loaded from environment 08:51 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 08:51 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 08:51 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 08:51 INFO [databricks.sdk] Using Databricks Metadata Service authentication 08:51 DEBUG [databricks.sdk] POST /api/2.0/lakeview/dashboards > { > "display_name": "created_by_lsql_LFxfIR7eEOBtUrr5" > } < 200 OK < { < "create_time": "2024-07-25T08:51:24.913Z", < "dashboard_id": "01ef4a6312c81bbc9447b609da64572a", < "display_name": "created_by_lsql_LFxfIR7eEOBtUrr5", < "etag": "-933759438", < "lifecycle_state": "ACTIVE", < "parent_path": "/Users/4106dc97-a963-48f0-a079-a578238959a6", < "path": "/Users/4106dc97-a963-48f0-a079-a578238959a6/created_by_lsql_LFxfIR7eEOBtUrr5.lvdash.json", < "serialized_dashboard": "{\"pages\":[{\"name\":\"fca6a42f\",\"displayName\":\"New Page\"}]}", < "update_time": "2024-07-25T08:51:25.066Z" < } 08:51 DEBUG [databricks.labs.lsql.backends] [api][execute] CREATE SCHEMA hive_metastore.lsql_skawl WITH DBPROPERTIES (RemoveAfter=2024072510) 08:51 DEBUG [databricks.labs.lsql.core] Executing SQL statement: CREATE SCHEMA hive_metastore.lsql_skawl WITH DBPROPERTIES (RemoveAfter=2024072510) 08:51 DEBUG [databricks.sdk] POST /api/2.0/sql/statements/ > { > "format": "JSON_ARRAY", > "statement": "CREATE SCHEMA hive_metastore.lsql_skawl WITH DBPROPERTIES (RemoveAfter=2024072510)", > "warehouse_id": "TEST_DEFAULT_WAREHOUSE_ID" > } < 200 OK < { < "statement_id": "01ef4a63-12fb-1c59-93cb-f6ac62893681", < "status": { < "error": { < "error_code": "BAD_REQUEST", < "message": "[INSUFFICIENT_PERMISSIONS] Insufficient privileges:\nUser does not have permission CREATE on CATA... (20 more bytes)" < }, < "state": "FAILED" < } < } 08:51 DEBUG [databricks.sdk] DELETE /api/2.0/lakeview/dashboards/01ef4a6312c81bbc9447b609da64572a < 200 OK < {} [gw7] linux -- Python 3.10.14 /home/runner/work/lsql/lsql/.venv/bin/python ```

Running from acceptance #339