databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
196 stars 70 forks source link

[FEATURE]: PARTIAL GROUP MIGRATION #2080

Closed SomanathSankaran closed 1 week ago

SomanathSankaran commented 1 week ago

Is there an existing issue for this?

Problem statement

Hi Team,

if I understand the Group migration it migrate local groups by creating temp group and finally delete the local ws group This will work out if we do a complete migration But if we do a phase wise migration where UC clusters and normal Table ACL hive metastore clusters should co-exist What is the way to solve this scenario

Need Advice.

Proposed Solution

Currently we are planning to create a copy of local ws group and then migrate it so that both groups co-exist post group migration.

Additional Context

No response

asnare commented 1 week ago

I understand why you're interested in phased migration and I think there's common ground between this feature request and issue #880.

@SomanathSankaran: Would that also help or get you what you want?

SomanathSankaran commented 1 week ago

@asnare Basically the problem we have here is say we 10 DB which are attached to dev_group and we migrate only 3 dbs first then remaining 7 DBs are still accessed though hive legacy Table ACL. Since we ran group migration all these will be converted to account level group as part of UC Catalog. Then in that case what will happen for the other tables which are accessed through table acl (legacy ) if the ws groups are getting deleted

asnare commented 1 week ago

@SomanathSankaran Thanks for clarifying the scenario; I'm going to talk to the team about this.

If you don't mind me restating the concern: it's about the safety of deleting migrated WS groups when the entire WS wasn't within the scope of the migration (and the groups might therefore be required).

nfx commented 1 week ago

duplicate of #880