[D3] - Extract Monitor Hub Activity Data, API results and Fabric Item Activity

[ydaponte]

As a Developer, I want to access monitoring hub activity data, API results and Fabric Item Activity to determine when items were last updated or run so that we can accurately score and tag stale content.

Resources

• Some sort of calls to items to see when these were last updated -
• Items - List Items - REST API (Admin) | Microsoft Learn, (Pay attention to continuation token)
• Items - REST API (Core) | Microsoft Learn
• Some sort of calls to run activity to see when these were last run (note that we might have to do this for each item - rather than fetching all executions for a time period at workspace level - like monitoring hub) - Job Scheduler - REST API (Core) | Microsoft Learn - IS THERE a BETTER way?

Acceptance Criteria:

• [x] Implement API calls to retrieve data on item updates and executions.
• [ ] #742
• [ ] #743

[agonzalez2014]

The below pipeline shows how to orchestrate 2 notebooks together. One to get the Fabric Items and upsert it into the denormalizedtable. Another notebook to update xxxx entries in the denormalizedtable and give a random "LastUpdateDate" that ranges from 15-60 days prior to the current date.

Pipeline: https://app.fabric.microsoft.com/groups/2194de19-ac45-4d2c-82f1-b1eaf833f490/pipelines/6f87e7d3-0cbf-4a02-a26b-cdfa7362f2da?experience=data-factory&clientSideAuth=0&capacityObjectId=EEE8E4FB-AE22-40E8-8CF8-F844B4CA7A71&workspaceObjectId=2194de19-ac45-4d2c-82f1-b1eaf833f490   The below notebook will accomplish getting all Items in a Tenant:

https://app.fabric.microsoft.com/groups/2194de19-ac45-4d2c-82f1-b1eaf833f490/synapsenotebooks/f34da60f-262f-449d-bd09-b88e87a29b79?experience=data-factory

[agonzalez2014]

"monitoring hub activity data" AC is not possible until we hear from the PG on how to consume their events or call an API.