Unable to deploy scheduled trigger for Synapse pipeline via ARM template

Sven Peeters 66 Reputation points
2022-07-05T12:17:29.01+00:00

Hi,

We are trying to include a scheduled trigger for one our synapse pipeline, after several attempts we arrived at ARM template as shown below.
It has been simplified and stipped of all other elements. No error message is reported however no trigger is created either :-(
Am I missing something here?

"variables": {  
    "workspaceId": "[concat('Microsoft.Synapse/workspaces/', parameters('workspaceName'))]"  
  },  
  
"resources": [  
	{  
		  "name": "[concat(parameters('workspaceName'), '/DataFromSQLToADLSRawDataCSV')]",  
		  "type": "Microsoft.Synapse/workspaces/pipelines",  
		  "apiVersion": "2019-06-01-preview",  
		  "properties": {  
			"activities": [  
			  {  
				"name": "GetTables",  
				"type": "Lookup",  
				"dependsOn": [],  
				"policy": {  
  
	   ....  
	},  
	{  
			"name": "[concat(parameters('workspaceName'), '/Nightly Run')]",  
			"type": "Microsoft.DataFactory/factories/triggers",  
			"apiVersion": "2018-06-01",  
			"properties": {  
				"annotations": [],  
				"runtimeState": "Stopped",  
				"pipelines": [  
					{  
						"pipelineReference": {  
							"referenceName": "DataFromSQLToADLSRawDataCSV",  
							"type": "PipelineReference"  
						},  
						"parameters": {  
							  
						}  
					}  
				],  
				"type": "ScheduleTrigger",  
				"typeProperties": {  
					"recurrence": {  
						"frequency": "Day",  
						"interval": 1,  
						"startTime": "2022-07-04T16:11:00",  
						"timeZone": "Romance Standard Time",  
						"schedule": {  
							"minutes": [  
								0  
							],  
							"hours": [  
								23  
							]  
						}  
					}  
				}  
			},  
			"dependsOn": [  
				"[concat(variables('workspaceId'), '/pipelines/DataFromSQLToADLSRawDataCSV')]"  
			]  
	}  
]  
  
  
Azure DevTest Labs
Azure DevTest Labs
An Azure service that is used for provisioning development and test environments.
260 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,524 questions
{count} votes

Accepted answer
  1. MartinJaffer-MSFT 26,041 Reputation points
    2022-07-06T16:53:41.813+00:00

    Hello @Sven Peeters ,
    Thanks for the question and using MS Q&A platform.

    So the problem you are facing is, you cannot find the triggers after publishing. Looking at your template, I see both Azure Synapse and Azure Data Factory pieces.

    "type": "Microsoft.DataFactory/factories/triggers",

    "type": "Microsoft.Synapse/workspaces/pipelines",

    I believe this is the cause. You are trying to deploy a Synapse Workspace, but you included a Data Factory path.

    I have never seen this happen naturally before. Did you write the ARM Template yourself?

    When I looked at a template from my Synapse Workspace, the trigger took the form:

    "type": "Microsoft.Synapse/workspaces/triggers",

    So, I think you were creating a trigger, but it wasn't placed where Synapse goes looking for triggers.

    I know Synapse basically contains a Data Factory inside it. At a quick glance anyway. However there are differences between the services. Some, like this one, are for purposes of integration, and making all the features work together. This is also so features can be developed separately for each service and not impact each other. This means there may be differences in the way triggers are written besides just this one line "type".

    In short, changing this line "type" may be all you need to fix it. This time.

    Please do let me if you have any queries.

    Thanks
    Martin


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

0 additional answers

Sort by: Most helpful