question

DickterSchiphorst-4556 avatar image
0 Votes"
DickterSchiphorst-4556 asked JoostHvanRossum-9791 answered

Azure Data Factory CI/CD automated publish

Hi,

I am running into some errors (in several jobs0 while running an azure pipeline, as described in the following link continuous-integration-deployment-improvements



validate:

  PublishConfigService: _getLatestPublishConfig - retrieving config file.
  LocalFileClientService: Unable to list files for: integrationRuntime, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/integrationRuntime'
  LocalFileClientService: Unable to list files for: dataset, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/dataset'
  LocalFileClientService: Unable to list files for: trigger, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/trigger'
  LocalFileClientService: Unable to list files for: dataflow, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/dataflow'
  LocalFileClientService: Unable to list files for: credential, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/credential'
  LocalFileClientService: Unable to list files for: managedVirtualNetwork, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/managedVirtualNetwork'


Validate and generate ARM template:

 ERROR === LocalFileClientService: Unable to read file: /home/vsts/work/1/s/arm-template-parameters-definition.json, error: {"stack":"Error: ENOENT: no such file or directory, open '/home/vsts/work/1/s/arm-template-parameters-definition.json'","message":"ENOENT: no such file or directory, open '/home/vsts/work/1/s/arm-template-parameters-definition.json'","errno":-2,"code":"ENOENT","syscall":"open","path":"/home/vsts/work/1/s/arm-template-parameters-definition.json"}
  WARNING === ArmTemplateUtils: _getUserParameterDefinitionJson - Unable to load custom param file from repo, will use default file. Error: {"stack":"Error: ENOENT: no such file or directory, open '/home/vsts/work/1/s/arm-template-parameters-definition.json'","message":"ENOENT: no such file or directory, open '/home/vsts/work/1/s/arm-template-parameters-definition.json'","errno":-2,"code":"ENOENT","syscall":"open","path":"/home/vsts/work/1/s/arm-template-parameters-definition.json"}

Please help.

Kind regards,

Dickkieee



azure-data-factory
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @DickterSchiphorst-4556,

Thanks for the questions and using MS Q&A platform.

Could you please share the command used for validating all the resources of a given folder?

0 Votes 0 ·

Hello @DickterSchiphorst-4556,

Just checking in if you have had a chance to see the previous response. We need the following information to understand/investigate this issue further.

0 Votes 0 ·

Sorry for the late reply, the code for generate and validate is

  • task: Npm@1
    inputs:
    command: 'custom'
    customCommand: 'run build export $(Build.Repository.LocalPath) /subscriptions/xxxxx/resourceGroups/xxxx/providers/Microsoft.DataFactory/factories/df-dev-0001 "ArmTemplate"'
    displayName: 'Validate and Generate ARM template'

0 Votes 0 ·

1 Answer

JoostHvanRossum-9791 avatar image
0 Votes"
JoostHvanRossum-9791 answered

The validation errors are probably because you haven't yet added datasets, dataflows, triggers, etc... you probably do have a pipeline since it is not complaining about that. So it's more a warning than an error...


To solve the missing arm-template-parameters-definition.json file you need to go to ADF and Edit the Parameter Configuration then it will be created for you in the repos. More details here


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.