How to enable writing for SH-IR via ADF Pipeliens

SKN 0 Reputation points
2023-12-15T11:01:02.0433333+00:00

Hello community,

I am facing an interesting problem when trying to write to a file share (on-prem) from a storage account via Self Hosted Integration Runtime (SHIR).


Details:

Rights on the share level are granted to the user and reading from the file share works perfectly fine. When writing a csv or txt file via a pipeline using a copy activity in debug mode I receive the error message attached (note that the file path is anonymized).

Detail Description
Activity Copy activity named "Copy data1"
Source Storage Account ADLS Gen2
Sink FileShare where SHIR is running on the machine "vm_misc" and the physical storage is mapped to "C:". Rights are granted on folder level "Exchange" and inherited by Subfolder "shared_files".
{
    "errorCode": "2200",
    "message": "ErrorCode=UserErrorFailedFileOperation,'Type=Generic.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path: 'shared_files/test.txt'.,Source=Generic.DataTransfer.ClientLibrary,''Type=System.UnauthorizedAccessException,Message=Access to the path "\\vm_misc\C$\Exchange\shared_files" was denied.,Source=mscorlib,'",
    "failureType": "UserError",
    "target": "Copy data1",
    "details": []
}

What I tried to resolve the error:

  1. Using preview the file -> works
  2. Copy from file to
  3. Revoking and granting rights to the user -> error 2200
  4. Using a different user -> error 2200
  5. Overwriting a file that exist (specify same filename in the dataset in Synapse e.g. test.txt) and trying to create a new file (by specifying a non existent file name in the Synapse dataset e.g. test2.txt) -> error 2200
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,396 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Adrian Kohler 0 Reputation points
    2024-04-25T07:46:01.67+00:00

    I had the same problem.User's image

    change the Host to C:\Exchange.
    Then you can read + write data!
    Of cours you still have to
    .\dmgcmd.exe -DisableLocalFolderPathValidation
    and
    .\dmgcmd.exe -elma

    0 comments No comments