ADF: DMZ to ADLS Data Copy error

Karthik Naidu 1 Reputation point
2021-09-07T18:49:03.07+00:00

Facing this issue on Data Copy activity of ADF recently. It was working fine earlier. Can anyone help me with this?

Dataset has binary and GZip compression enabled.

Here is the issue.

Failure happened on 'Source' side. ErrorCode=InvalidDataFormat,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The source data has an invalid format. Cannot decompress the source data. Source file name: 'file_name.txt'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=ICSharpCode.SharpZipLib.GZip.GZipException,Message=Error GZIP header, first magic byte doesn't match,Source=ICSharpCode.SharpZipLib,'

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,662 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. ShaikMaheer-MSFT 38,046 Reputation points Microsoft Employee
    2021-09-09T05:44:21.547+00:00

    Hi @Karthik Naidu ,

    Welcome to Microsoft Q&A Platform. Thank you for posting query here.

    I tried Copy activity using Source dataset(Binary) with compression type as "gzip(.gz)" and Sink dataset(Binary) with compression type as "none" and got similar issue when I pointed to an .txt file in source.

    From your error message also, it seems you are point to "file_name.txt" file using source dataset which has compression type as "gzip(.gz)", hence ending up with issue. ".txt" files will not have any compression types. You can select "none" as compression type in source dataset and run copy activity for same file and check results.

    Please let us know if it works or any further queries. Thank you.

    0 comments