RuiRomano / pbimonitor

MIT License
207 stars 76 forks source link

Catalog - Workspaces RAW error evaluating group by #18

Closed Gcsaniz closed 1 year ago

Gcsaniz commented 2 years ago

Large implementation (over 100k workspaces full scan, several days of 400+ modifications) using Azure blob storage is now failing on the group by:

Table.Group(#"Expanded Data.workspaces1", {"id"}, {{"AllRows", each _, type table [id=text, name=text, type=text, state=text, isOnDedicatedCapacity=logical, reports=list, dashboards=list, datasets=list, dataflows=list, ScanDate=nullable datetime]}}

PbiMonitor Catalog - Workspaces RAW error )

RuiRomano commented 1 year ago

On a large tenant, consider enabling the setting "PBIMONITOR_FullScanAfterDays" this will force a full scan every X days and the PowerQuery (last version of template) will only consider files since the last full scan.

You may need to force a full scan: https://github.com/RuiRomano/pbimonitor#force-a-full-scan

CsanizAZ commented 1 year ago

Doing a full scan every 7 days. This seems to have resolved the issue.

NRREDDY999 commented 1 year ago

is it possible to push to fix exceptions?