Data issues with CoE environment

[svc-o365-group-prod]

Describe the issue

Some of the flows were not refreshed since long. Example flow 'Set Flow Permissions' is not refreshed since 14-October.

Expected Behavior

This should be refreshed with latest flow information.

What solution are you experiencing the issue with?

Core

What solution version are you using?

3.45

What app or flow are you having the issue with?

Set Flow Permissions

Steps To Reproduce

No response

Anything else?

No response

[manuelap-msft]

Set Flow Permissions is a canvas app, it won't refresh until you upgrade the solution with the next version.

[svc-o365-group-prod]

Hi,

We have upgraded the solution on 29-Sep but the flow ran until 15-Oct and it stopped after that.

Thanks, Raj

From: Manuela Pichler @.> Sent: den 26 oktober 2022 14:02 To: microsoft/coe-starter-kit @.> Cc: Rajasekhar A Ponnada @.>; Author @.> Subject: Re: [microsoft/coe-starter-kit] Data issues with CoE environment (Issue #4041)

You don't often get email from @.**@.>. Learn why this is importanthttps://aka.ms/LearnAboutSenderIdentification

Set Flow Permissions is a canvas app, it won't refresh until you upgrade the solution with the next version.

- Reply to this email directly, view it on GitHubhttps://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2Fcoe-starter-kit%2Fissues%2F4041%23issuecomment-1291927846&data=05%7C01%7Crajasekhar.a.ponnada%40ica.se%7Cb8a97263955c4253659708dab749ed51%7C176bdcf02ce34610962ad59c1f5ce9f6%7C0%7C0%7C638023825399648675%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=rEGKPG8tuUq0zulREZJkdc%2FMfsHf13JQZhRnSdzT3Vc%3D&reserved=0, or unsubscribehttps://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAZRYIIOV3RO3UA4DXEXUT3TWFEMUPANCNFSM6AAAAAARO5NAQQ&data=05%7C01%7Crajasekhar.a.ponnada%40ica.se%7Cb8a97263955c4253659708dab749ed51%7C176bdcf02ce34610962ad59c1f5ce9f6%7C0%7C0%7C638023825399648675%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=N49B45wUmK1rnqhVn1Vn%2BHfxmcl%2FIAriFGljL26pA3k%3D&reserved=0. You are receiving this because you authored the thread.Message ID: @.**@.>>

---

ATTENTION: This e-mail may contain confidential information that is intended solely for the addressee. If you are not the intended recipient, you should delete this message and are hereby notified that any disclosure, copying, or distribution of this message, or the taking of any action based on it, is strictly prohibited.

---

PRIVACY NOTICE: Your privacy is important for us at ICA Gruppen AB and its subsidiaries (ICA). We are transparent with how we collect and process any personal data that you share with us. More detailed information on how we process your personal data can be found at www.ica.se/dataskydd.

[manuelap-msft]

Can you share a screenshot of what flows you mean? Please note you will have to login to GitHub and attach the screenshot from there, sending screenshots via the "reply via email" doesn't work in GitHub.

Like I said, Set Flow Permissions is a canvas app not a flow so I don't know what flow you mean.

[svc-o365-group-prod]

Yes, I meant the flow behind 'Set Flow Permissions' App. We are trying to Manage Flow permissions when users left or moved to another organization. We could see only flows that are created or modified until 15-Oct and all latest flows weren't displayed in the App. Is there any flow running behind to refresh data in the App ? We verified some data based on App connections and it seems its not refreshed recently.

[manuelap-msft]

I see. Yes, there are flows running that update the inventory daily - they are our inventory flows and they all need to be running without failure, see here for a list: https://learn.microsoft.com/en-us/power-platform/guidance/coe/setup-core-components#turn-on-inventory-flows

You can open the Admin - Command Center app and navigate to the CoE Health page to see if you have any failures in those flows.

[svc-o365-group-prod]

I don't see any flows or data inside Service health in the App. from the documentation link, I found 'Admin | Sync Template v3' flow that is in suspended state. Triggered the flow and Awaiting flow status. will update once it completes.

[svc-o365-group-prod]

'Admin | Sync Template v3' is still in suspended mode, It didn't complete the run. It took 22hrs and still running.. I see in 'CoE Flows' that is stopped. What could be the issue ?

[manuelap-msft]

Can you open the Admin | Sync Template v3 from the maker portal (make.powerautomate.com), usually that should give you a reason on why it's suspended. Sometimes that can be due to an incorrect license or due to hitting throttling limits of your license or due to Data Policies preventing the flow from running.

[svc-o365-group-prod]

Manual triggers that I did last couple of times never completed, so I cancelled them. Last time it failed on 14-Oct, All flow runs before that also failed on last step with below error:

The 'inputs.parameters' of workflow operation 'Update_Last_Run_Successful' of type 'OpenApiConnection' is not valid. Error details: The resolved string values for the following parameters are invalid, they may not be null or empty: 'recordId'

Though it failed until 14-oct, it did refresh all latest flows in all other Apps. After 14-Oct, it never ran the flow Probably I think it got suspended and moved to Stopped status in command center. I stopped and started the flow in Command center. Now it is running...

[manuelap-msft]

Can you run the Admin | Sync Template v3 CoE Solution Metadata again? This flow sets some metadata that other flows populate and it looks like you're missing some of that metadata and that's why the flow fails. The current run will likely fail because of that as well.

[svc-o365-group-prod]

yes, I ran this flow yesterday. I ran it again now.

[svc-o365-group-prod]

'Admin | Sync Template v3' flow is still in running state and looks like under 'Delay Inventory' step

[Jenefer-Monroe]

The delay is expected, and will delay a randomized length of time before continuing and kicking off inventory each day.

This is done to prevent all the organizations that use the CoE from beginning their sync flows at the same time as they use a lot of Dataverse API calls.

Why? To protects the Dataverse service on the Microsoft side - the CoE Starter Kit is installed in thousands of tenants, and as you can image performs quite a lot of Dataverse read/write actions during an inventory run. The way scheduled flows work, unfortunately, is that when they are shipped in a managed solution they run at the very same time independent of the customer timezone - so they may run at 7am PST, 3pm GMT etc etc. This meant that we saw many many millions (or more) of Dataverse calls at the very same time each day, which meant that with an increase in installations of the CoE kit it may have caused a service disruption. That's the last thing we want! In order to balance out these Dataverse calls we had to make sure customers run the inventory at different times during the day - our ideal solution would have been to provide a parameter to the Schedule trigger, unfortunately that's not possible in Power Automate today (the Schedule trigger doesn't work with Environment Variables etc) so the only solution we could think of is introducing a random delay after the flow kicks off. We know and appreciate that's not ideal but it's the only thing we could think of to protect the service on our side.

[svc-o365-group-prod]

'Admin | Sync Template v3' flow is completed successfully now. But data is still not refreshed in 'Set Flow Permissions' App.

When I check Command Cener, it seems to be Failed

[svc-o365-group-prod]

The 'inputs.parameters' of workflow operation 'Get_environment_for_name' of type 'OpenApiConnection' is not valid. Error details: The resolved string values for the following parameters are invalid, they may not be null or empty: 'recordId'

[Jenefer-Monroe]

The Set Flow Permissions and Set App Permissions apps have a filter on them with the rollup column on apps/flows existing. In other words, Set Flow Permissions wont show Makers or Environments with no flows.

You need to wait for those roll up fields to populate. You'll see the same thing, all zeros until the rollup calculates in the main page of the Power Platform Admin View app.

[Jenefer-Monroe]

For the 3 failures you see in the Command Center. Note that this indicates you had three failures for runs of the Flow Action Details flow. Please hit resubmit for the failure. And let me know if it passes.

[Jenefer-Monroe]

closing out as no further action for starter kit team