Azure Analysis Services: Purging Data

James H. Robinson 161 Reputation points
2020-10-15T14:33:26.647+00:00

I want to make sure there are only 90 days of data in my Azure Analysis Services (AAS) model.

I'm thinking about using Power Query/M to only filter the most recent 90 days and then doing a Process Full. Is that the best approach to this? If so, how can this be implemented, especially since there is no DateDiff function in Power Query/M?

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
439 questions
{count} votes

Accepted answer
  1. HarithaMaddi-MSFT 10,136 Reputation points
    2020-10-19T08:08:11.573+00:00

    Hi @James H. Robinson ,

    Thanks for your patience. I got update from Product team that the recommendation is to use partitions. Process the new partitions (Ex: monthly partitions) and delete the old partitions.

    And for using PowerQuery M functions, the filter expression in M will fold properly to the data source if it is a data source with compute (e.g. SQL Azure/Synapse/etc.) and be efficiently handled. For other data sources, you have to be careful about how to pull data efficiently.

    Hope this helps! Please let us know for further queries and we will be glad to assist.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful