question

AshokKumarBollineni-5476 avatar image
0 Votes"
AshokKumarBollineni-5476 asked AshokKumarBollineni-5476 commented

Are there any Limitations to use Tumbling window Trigger in Azure Data Factory?

Hi All,

I have multiple pipelines dependent on each other, I want to use Tumbling window trigger. Requesting you to suggest me Is it right approach? or Are there any Limitations to use it.

Regards,
Ashok

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered AshokKumarBollineni-5476 commented

Hi @AshokKumarBollineni-5476,

Thanks for reaching out. In addition to above inputs from @VaibhavChaudhari, please see below related info.

Tumbling window triggers are a type of trigger that fires at a periodic time interval from a specified start time (basically when you want to process a time based data), while retaining state. Tumbling windows are a series of fixed-sized, non-overlapping, and contiguous time intervals.

This triggers offer a suite of features for complex scenarios like :

Here are few Limitations:

  • A tumbling window trigger has a one-to-one relationship with a pipeline and can only reference a singular pipeline.

  • If one of the dependencies triggers fails, you must successfully rerun it in order for the dependent trigger to run.

  • A tumbling window trigger will wait on dependencies for seven days before timing out. After seven days, the trigger run will fail


ADF also has another time based trigger called Schedule trigger. To know more in detail about the differences between a Schedule trigger and a Tumbling window trigger, please refer to this doc: Trigger type comparison

78876-image.png

Related helpful docs: Tumbling window trigger Usage scenarios and examples

Hope this info helps.



Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.


· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@KranthiPakala-MSFT: Thank you so much for your reply.

0 Votes 0 ·
VaibhavChaudhari avatar image
0 Votes"
VaibhavChaudhari answered AshokKumarBollineni-5476 commented

Tumbling window trigger can be use if you want to import time based data and process data based on time.

See the trigger types and use cases - https://www.cathrinewilhelmsen.net/triggers-azure-data-factory/

If you just have pipeline dependencies, then it should be ok to use Scheduled trigger. You can create a master pipeline and orchestrate/call pipelines by connecting them in series as you need and set up scheduled trigger on this master pipeline.


Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@VaibhavChaudhari: Thank you so much for your reply

0 Votes 0 ·