microsoft / coe-starter-kit

Other
761 stars 225 forks source link

[CoE Starter Kit - BUG] Apps, Flows, etc not mapped to Maker. #4772

Closed russxi closed 1 year ago

russxi commented 1 year ago

Describe the issue

This is a continuation from [CoE Starter Kit - BUG] Apps and Flows are not mapped to an environment. #4608.

As per checking there are several objects that are not mapped to a specific Maker. This happens in the following:

  1. Overview - Power Apps
  2. Overview - Power Automate
  3. Overview - Chatbots
  4. Overview - Solution
  5. Overview - Business Process Flows
  6. Overview - AI Builder Models
  7. Environments
  8. Makers By Country
  9. Makers By City

Power Apps Power Automate Environments Makers By Country

I already applied the following steps but I'm still seeing the issue:

  1. Changed the Modfied Date to 1/1/1990 and run the Admin | Sync Template V3
  2. Ran a Full Inventory

Expected Behavior

Objects are mapped to Maker.

What solution are you experiencing the issue with?

Core

What solution version are you using?

4.2

What app or flow are you having the issue with?

Admin | Sync Template V3

Steps To Reproduce

  1. Open Power Platform BI Dashboard.
  2. Open the following tabs
    • Overview - Power Apps
    • Overview - Power Automate
    • Overview - Chatbots
    • Overview - Solution
    • Overview - Business Process Flows
    • Overview - AI Builder Models
    • Environments
    • Makers By Country
    • Makers By City

Anything else?

No response

Jenefer-Monroe commented 1 year ago

Sorry for the delay. I did manage to find a test envt with this repro, and a full inventory did fix it. So can we please try that again? I've noticed that the new feature where power automate flows pick up env variable changes automatically does not always work, so perhaps that is what happened.

  1. Using the CoE Admin Command Center, change the Env Var admin_FullInventory to yes image

  2. Turn off these flows

    • Admin | Sync Template v3 (Apps)
    • Admin | Sync Template v3 (Flows)
    • Admin | Sync Template v3 (Model Driven Apps)

image

  1. Turn these flows back on
  1. Go to the Admin | Sync Template v3 flow and run it. image

  2. Wait until all runs from the triggered Apps, Flows, Model Driven Apps are complete. Usually flows finish last so if you go to Admin | Sync Template v3 (Flows) > All runs image And then filter to Running, you can wait until that list is empty (probably a few hours) image

russxi commented 1 year ago

Hi Jenefer, Sure I'll do this and get back to you. Thank you.

russxi commented 1 year ago

Hi Jenefer, just an update.

I have done the steps you mentioned.

  1. Enabled full inventory load. image

  2. Turned off then turned on the mentioned flows but as per checking some of them are still running till today (I did the steps last Monday). Any advice? image image image

Also I'm still seeing the same issue in the Power BI Dashboard. Untitled

Jenefer-Monroe commented 1 year ago

Have you refreshed the PBI? You should turn the Full Inventory switch back to No and turn those flows back off and on again to ensure the value takes. Then wait for these to complete.

russxi commented 1 year ago

Hi Jenefer, Apologies for the delayed response.

I'll retry the steps from the beginning and I'll let you know. But to answer your question, yes the Power BI was refreshed but I'm still seeing the same numbers.

Untitled

russxi commented 1 year ago

Hi Jenefer, As per your instructions:

  1. I changed FullInventory to yes
  2. Turned Off the flows.
  3. Turned On the flows.
    • Admin | Sync Template v3 (Apps)
    • Admin | Sync Template v3 (Flows)
    • Admin | Sync Template v3 (Model Driven Apps)
  4. Manually ran Admin | Sync Template v3 and it was successful.
  5. I changed FullInventory to no

Admin | Sync Template v3 (Model Driven Apps) has no pending runs. Hovewever both Admin | Sync Template v3 (Flows) and Admin | Sync Template v3 (Apps) are still running.

App Run History Apps Flow Run

Flow Run History Flow Flow Run

My questions are;

  1. Should I cancel or disable Admin | Sync Template v3 while I'm waiting for both flows to finish?
  2. Regarding the flow performance warning should we assign per flow license to each of this flows to avoid throttling?
  3. What could be the cause of the long running flows?
Jenefer-Monroe commented 1 year ago

It looks like you are just too large for our sync flow architecture to do full inventory runs. Yes please cancel this long run, it will likely never complete. Turn full inventory back to no and reset those same flows (if you havent already) Then turn everything back on to be running normally again.

The good news is that we are very close to releasing our new architecture for large tenants. Come to office hours to hear about it. And read here if you would like

russxi commented 1 year ago

Hi Jenefer, I registered and I'm looking forward to it.

Just to clarify, What's the next step here? Wait for the new update? Another thing I wanted to ask is that we have an old CoE Environment with historical data, will this be fixed if we migrate the data from our old CoE Environment?

Jenefer-Monroe commented 1 year ago

Yes im afraid I dont have a good next step for you right now aside from the new architecture. What I believe to be the bug you hit is fixed by full inventory run and you are just too big for that.

We will support upgrade of the kit from sync flow architecture (current) to data lake architecture (new), you will not lose the associated metadata that you have added to the kit. And apps and flows will no longer get their details from these sync flow but instead from the product data export features.

Jenefer-Monroe commented 1 year ago

Closing out as there is no further action other than the architecture shift.

russxi commented 1 year ago

Hi Jenefer, Sorry it took a while to respond I was on leave.

Anyway I got 2 Power Automate per flow license and assigned it to both Apps and Flows to increase the capacity of both flows. It still took a while but both App and Flow run completed.

Power Apps completed without any error but we are still seeing the same issue. Power Automate completed but with the following error:

{ "error": { "code": "0x80040217", "message": "admin_Maker With Id = *redacted* Does Not Exist", "@Microsoft.PowerApps.CDS.HelpLink": "http://go.microsoft.com/fwlink/?LinkID=398563&error=Microsoft.Crm.CrmException%3a80040217&client=platform", "@Microsoft.PowerApps.CDS.InnerError.Message": "admin_Maker With Id = *redacted* Does Not Exist" } }

111