search

BojanBuhac / M365-Copilot-Audit-Report

M365 Copilot Audit Report is displaying interactions your employees are having with M365 Copilot.
GNU General Public License v3.0
3 stars 2 forks source link

readme

M365 Copilot Audit Power BI Report

This report is using data from Purview Audit log and Entra ID exports into two CSV files. The first csv file is storing Copilot Interaction events and other csv is exporting user details (Display Name, UPN, Position, City, Country) for users that have M365 copilot license assigned. Power BI report is reading data from those these two files and can display users Display names or anonymize them. Report contains Overall and Adoption pages that allow M365 Champs to monitor behavior of M365 Copilot licensed users.

Overall report

screenshot

Adoption report

screenshot

Features

  1. Time of the day interaction
  2. Application ratio
  3. Monthly interactions
  4. Weekly Interactions
  5. Top active users
  6. Top sources
  7. Employee names anonymizer
  8. Active vs total licenses assigned
  9. Slicers
    • Time range
    • Application
    • Employee
    • Position

Prerequisites

  1. M365 Copilot Licenses assigned to users and some history with it :)
  2. Audit Log Read Permissions (Security Reader is minimum)
  3. Power BI Desktop (most recent version) Download link
  4. Windows PowerShell 7 Download link

    Scripts and supporting files

    [!NOTE] Download all files from Scripts

    Initial configuration

  5. Open Audit-Get-Events.ps1 and edit the $csvpath (line 29).
  6. Open Audit-Get-Users.ps1 and edit the $csvUserspath (line 23).

    Extracting AD users

  7. Run PowerShell 7 as Administrator
  8. Run Audit-Get-Users.ps1 from Windows PowerShell
  9. Once you get prompted to authenticate, authenticate with an account that has at least Security Reader Permissions (Global Admin will work of course).
  10. Once the script is complete, the folder will include Copilot_Users.csv that will contain list of users from your tenant that have M365 Copilot License assigned.

    Extracting Copilot Interactions

  11. Run PowerShell 7 as Administrator
  12. Run Audit-Get-Events.ps1 from Windows PowerShell
  13. Once you get prompted to authenticate, authenticate with an account that has at least Security Reader Permissions (Global Admin will work of course).
  14. Once the script is complete, the folder will include Copilot_Events.csv that will contain list of all copilot events that exist in your Audit log.

    Power BI Template configuration

  15. Open M365 Copilot Audit Report.pbit with Power BI Desktop
  16. You will get prompted with M365 Copilot Audit Report configuration screen

screenshot

  1. Populate it with parameters captured in Initial configuration section.
  2. Press Load button and click Connect
  3. Report will start to pull data from two files

Alt text

  1. Once the process is complete, your report will display information

Alt text

  1. Save the Report as M365 Copilot Audit Report.pbix to your PC

    Anonymizing users

    In case you want to anonymize user Display names in Power BI report:

Alt text

  1. Click on the Employee visual
  2. Click x next to Employee in Visualizations pane to remove employees.
  3. Tick the box on Anonymous in Data Pane

Alt text

  1. Repeat the same steps for Top Active users visual