microsoft / coe-starter-kit

Other
765 stars 225 forks source link

[CoE Starter Kit - BUG] Power BI "Introduction" page buttons setting incorrect query strings for page navigation #1531

Closed sharmajitendralal closed 2 years ago

sharmajitendralal commented 3 years ago

Describe the issue

I am trying to compare data from Power Platform analytics and CoE Dashboard and its seems that data is not matched exactly

CoE Power BI Dashboard:

CoEAppReport

Power Platform Analytics:

image

Expected Behavior

Data should be matched in both environment (Power Platform analytics and CoE Power BI report)

What solution are you experiencing the issue with?

Core

What solution version are you using?

3.13

What app or flow are you having the issue with?

Power BI Report

Steps To Reproduce

Open Power Platform analytics and CoE Power BI report and match the Apps/Flow/Cloud Flow count

Anything else?

No response

manuelap-msft commented 3 years ago

This is expected behaviour!

On the first one, this looks correct to me: Both the Admin Center and CoE display 1 Group and 2 Users as shared with. The number you highlighted is Unique Users - we get this information from the Audit Log based on Launches, this information is not available in the Admin Center analytics and it shows you the number of unique users that have launched the app. As the 1 Group your app is shared with could consist of hundres of users, this number seems ok to me. For comparision, you would want to compare with Users Shared not Unique Users.

We have a limitation on what custom connectors can be gathered in the CoE starter kit: https://docs.microsoft.com/en-us/power-platform/guidance/coe/limitations#missing-custom-connectors - but I'm not quite sure what discrepancy you found in your data, could you elaborate what's missing? The grid shows apps and flows using custom connectors, and the 43 number shows all custom connectors you have - you may have custom connectors that are no longer used in an app or flow, and they would then not show in the grid.

Manuela

sharmajitendralal commented 3 years ago

Query: Custom connector count and display name is not matched exactly when i was extracting data from PowerShell

CoE Dasboard reported : 43 + 5 custom connector Using PowerShell reported : 40 custom connector

CoE Screen shot: Seems that regular connector name in shared power apps grid not custom connector

image

PowerShell report: This is actual custom connector display name image

manuelap-msft commented 3 years ago

Hello,

the PowerShell cmdlet does not return custom connectors that are in solutions - the CoE Starter Kit also includes custom connectors that are in solutions. Due to the way the different mechanisms work, slight discrepancies like that are expected.

Manuela

sharmajitendralal commented 3 years ago

OK, Thanks for update... but if I can forget the count for the time being still custom connector name is completely not matched with PowerShell report and old CoE Power BI report, Here is screen shot from

Total Custom Connector: Overview PowerApps image

Total Custom Connector: Overview Power Automate

image

Power Shell Report:

image

Its seems that in October release Power Apps Custom connector report is not correct because listed connector in grid is not custom connector

sharmajitendralal commented 3 years ago

Hello Manuela,

One more conflict display in Environments report here you can see count is same for Total Env, Trial Env, Developer Env

image

PowerShell Reported: 310 Environment only

image

Please help me to understand the conflict in count

sharmajitendralal commented 3 years ago

Hello Manuela,

Please suggest.. How should I move further ?

Jitendra

Jenefer-Monroe commented 3 years ago

I do not repro these being the same number for all environments but I believe we did have this in an old version of the powerbi. When you upgraded Core to 3.13 did you also fetch the new PBI?

For the difference of 3 between PBI and Power Shell, again there are many reasons you could have a slightly different value but its likely filters, In an old version of the PBI we used to ship with this filter to true, meaning we would show deleted environments in our reports. image

sharmajitendralal commented 3 years ago

Yes, PBI also upgraded as per 3.13 version

We are facing this gap in new version 3.13, if you are looking back to my previous shared screen shot then you can see environment count is Correct in "Overview Power Automate" section but for " Overview PowerApps" its not correct

What about custom connector count ? Its completely different to actual value and count We have only 43 custom connector but its showing 633 and value is also not matched completely

Please help me to resolve the all gap or let me know if required to upgrade it with newer version

Jenefer-Monroe commented 3 years ago

You have a lot of issues at play in this bug so I'm having trouble tracking.

I do not repro this:

image

Nor do I repro this, both these cards have the exact same data in them so they are the same number for us:

image

At this point I suggest you just try with a fresh copy of our dashboard. Here is our December version: https://github.com/microsoft/coe-starter-kit/tree/coe-december/CenterofExcellenceResources/Release/Collateral/CoEStarterKit

sharmajitendralal commented 3 years ago

Same Issue with new version December one:

Still custom connector count wrongly appear in "Overview PowerApps section" but fortunately Env count seems consistent in both interface

Overview PowerApps image

Overview PowerAutomate

image

sharmajitendralal commented 2 years ago

Hello Jenefer-Monroe,

Please help me to understand, What's the cause behind this conflict

Regards, Jitendra

sharmajitendralal commented 2 years ago

Hello Team,

I am looking for your help to resolve the issue

As you can see in the shared screen shot custom connector count is not correct and environment name appearing two times

image

Regards, Jitendra

sharmajitendralal commented 2 years ago

Hello Team,

I am still looking for solutions

manuelap-msft commented 2 years ago

Hello,

please note the CoE Starter Kit is an unsupported set of templates: https://docs.microsoft.com/en-us/power-platform/guidance/coe/feedback-support

We do not have a support team that can help resolve issues, and support is provided on best endevaours without SLA via GitHub. We will look into your issue, but at the moment can not provide a timeline.

Thank you for your patience, Manuela

sharmajitendralal commented 2 years ago

Hello,

In this case, Please help me to know that how will I get notified once the issue resolved

secondly, let me know that the same issue is replicable on your side or not Or any log is required from my side ?

manuelap-msft commented 2 years ago

You are experiencing a lot of issues that we have not seen before and that we do not repo.

I suggest running a full inventory to make sure your inventory in the CoE tables is up to date - please follow these steps exactly and note that it may take a while to complete: https://docs.microsoft.com/en-us/power-platform/guidance/coe/limitations#incomplete-inventory

For the Power BI Count, this visual on the Overview Power Apps page has the highlighted filter set to only show connectors where isCustomAPI is true. The entire group at the top is the same across all Overview pages, and pulls information from the same tables so it's simply not possible that the count is different. You may have accidently removed the filter as you made changes to the dashboard. I can confirm that our latest released version (December), which Jenefer pointed to earlier, has this filter set. You can add this filter manually yourself by looking for the isCustomApi field and setting the filter value to true. image

sharmajitendralal commented 2 years ago

Thanks for your help on filter part..

Now connector count seems ok after applied the suggested filter, please help on other count issue

"Created this month" section showing wrong count in both page "Overview-PowerApps and Overview-Power Automate and other section" I did not do any changes in default template seems that default setting not correct

Working on to run the full inventory....will update you once completed

sharmajitendralal commented 2 years ago

I have updated the full inventory as suggested but still getting the same issue ..

Its seems that there is issue in introduction page, This page carry query string and update the target page accordingly

Step to reproduce the issue

  1. Click on Introduction page and select the Overview Power Apps

CoEIntro

  1. On the Overview Power Apps page focus on custom connector count

CoEPowerAppReset

  1. After Reset the page custom connector count appear correctly

CoEPowerApp

manuelap-msft commented 2 years ago

Hello,

you're right - there was an issue with the navigation from the Introduction page to the sub-pages that caused the filters for custom connectors and created this month to disappear.

You can fix this yourself by selecting the button on the Introduction page, and in the Format Button pane changing the Action from Bookmark to Page Navigation > Overview Power Apps for the Power Apps button and Page Navigation > Overview Power Automate for the Power Automate button. image

I have also fixed this for our January release, and if you want to try out the dashboard of this release you can download it here: https://github.com/microsoft/coe-starter-kit/raw/coe-january/CenterofExcellenceResources/Release/Collateral/CoEStarterKit/Production_CoEDashboard_Jan2022.pbit - but please note that this is still in testing.

manuelap-msft commented 2 years ago

Now connector count seems ok after applied the suggested filter, please help on other count issue

I am afraid I don't follow, what "other count issue" do you still need help with?

sharmajitendralal commented 2 years ago

Thanks ..

But I am still not able to find out the root cause, Why environment name appearing two times with different app count in Overview Power Apps section

manuelap-msft commented 2 years ago

Have you done a full refresh of the Power BI data after you ran the Full Inventory? Can you open the Power Platform Admin View (model driven app part of the Core components solution) and check the Environments page there - are the environments showing up double there as well?

Jenefer-Monroe commented 2 years ago

Hi there. Pulling all our asks into one place.

Can you please do the following?

1) As Manuela has asked, have you refreshed the data in the PBI since you ran the full inventory?

1) As Manuela has asked, please see if these show up twice in the product admin pages: https://admin.powerplatform.microsoft.com/

1) Ensure all the flows in the Core solution that begin with the word CLEANUP - are turned on, running, and passing, and that they dont have any unmanaged layers. image

1) Export the data from the Environments table (note you cannot do this from the solution itself, see picture below), find a pair of the duplicate records (ex Architecture Tests and Architecture Tests (org8xxxxx2) and return with an obfuscated list of the following fields: admin_environmentid, admin_environmentcdsinstanceurl, admin_environmentcreatedon, admin_environmentdeleted, admin_environmentmakerdisplayname, admin_environmentsku, admin_environmentname

1) For clarity, and in case its obfuscated away, do they have the same values for admin_environmentid? for admin_environmentname?

How to Export the table image

sharmajitendralal commented 2 years ago

Thanks both of you..

After refreshed the data now duplicate issue resolved :)

But I can see some Power automate without environment name

image

Jenefer-Monroe commented 2 years ago

Please ensure all the flows in the Core solution that begin with the word CLEANUP - are turned on, running, and passing, and that they dont have any unmanaged layers. image

sharmajitendralal commented 2 years ago

Hello, Thanks for your suggestion

I have verified and found all CLEANUP - are turned on and there is no unmanaged layers Now Power automate grid seems ok there is no blank record but still maker grid have some problem

image

Custom Connector: Seems that still there is issue in custom connector grid - duplicate record found for same connector

image

App Risk Assessment: Unique users and sessions have count without any display name and owner

image

Jenefer-Monroe commented 2 years ago

This issue is tracking way too many things. And it is now marked as fixed for January for the issue of the link from the home page. Please post one issue per issue, we cannot continue to track mega threads like this as it does not allow search or tracking.

sharmajitendralal commented 2 years ago

Ok got it, I will keep in mind in future

mikefactorial commented 2 years ago

@sharmajitendralal This has been fixed in the latest release. Please install the latest version of the toolkit following the instructions for installing updates. Note that if you do not remove the unmanaged layers as described there you will not receive updates from us.