Open asnare opened 1 month ago
We need to track owners for the following inventory types:
ClusterInfo
:
creator
field, which is optional.DirectFsAccess
:
For:
user
attribute of the query[^1], which is optional.owner
of the DBFS or Workspace path[^1][^2] for the notebook or source, which is optional.Workspace admin.
Grant
, Table
and UDF
:
Note: No attempt to determine creator via table/UDF properties.
JobInfo
:
creator
field, which is optional.PipelineInfo
:
creator_name
field, which is optional.PolicyInfo
:
creator
field, which is optional.TableMigrationStatus
:
Where the workspace admin is needed (because a more appropriate owner cannot be determined) the algorithm is as follows:
[^1]: This is not yet available on the DirectFsAccess
instances; a schema change will probably be required along with code to expose this information.
[^2]: The APIs for DBFS and Workspace paths don't expose the owner/creator information, so this information is unavailable. If it were available, this would first be exposed via the .owner
attribute of our pathlib
emulation.
Is there an existing issue for this?
Problem statement
We will shortly be tracking history for inventory types that are routinely refreshed during migration. The history journal that we maintain will require that for each record an owner is available: the owner is the person (or group) responsible for the underlying resource being migrated. If this is not available, the workspace administrator should be used instead.
Proposed Solution
Each crawler that is responsible for a refreshable class will need to be updated to have code that can identify the owner for its
Result
type.Documentation
Additional Context
Related issues:
2572
2744
Blocks:
2573
2743