m-kovalsky / ProcessingManager

A tool for managing the processing of Analysis Services, Azure Analysis Services and Power BI Premium models.
MIT License
26 stars 7 forks source link

When selecting specific partition days it is only processing as per the incremental refreshing policy #4

Open GilbertQue opened 3 years ago

GilbertQue commented 3 years ago

Hi there, thanks for fixing the previous issue :)

What I now did was to configure the Partitions as shown below image

Now when I run the command line prompt, I watch it via SQL Profiler and I see it is not processing the partitions I selected. image

And when I review the partitions processed date I can see that the above partitions have not been processed. image

If you need anything further for me to help please let me know.

m-kovalsky commented 3 years ago

This is due to the Incremental Refresh policy. This tool is not set up to override an Incremental Refresh policy. Would you share the details of the IR policy?

GilbertQue commented 3 years ago

Hi Michael, thanks for getting back to me.

Here are the details of the IR policy

image

If you need any more details please let me know.

m-kovalsky commented 3 years ago

If you want it to ignore the Incremental Refresh policy, I believe you should set the table(s) as such:

image

GilbertQue commented 3 years ago

Thanks Michael, just to confirm the steps should be.

  1. Disable the "EnableRefreshPolicy"
  2. Run the processing of the partitions with your amazing script.
  3. Re-Enable the "EnableRefreshPolicy"
m-kovalsky commented 3 years ago

Yes, try it out and let me know. You can also run steps 1&3 as scripts. If this works, I can add a functionality within the tool to allow an option for disabling incremental refresh just for a particular processing batch.

Step 1:

Model.Tables["TableName"].EnableRefreshPolicy = false;

Step 3

Model.Tables["TableName"].EnableRefreshPolicy = true;
GilbertQue commented 3 years ago

Hi Michael,

Thanks for the suggestion when I try and do this via Tabular editor to disable the refresh policy on a PPU database I get the following error shown below

image

m-kovalsky commented 3 years ago

This issue is a bit outside the scope of this tool. The error message isn't too helpful but make sure to check out Tabular Editor's documentation on the subject. Otherwise you may want to open a support ticket with Microsoft.

https://docs.tabulareditor.com/te2/incremental-refresh.html