question

lsc2021 avatar image
0 Votes"
lsc2021 asked lsc2021 commented

How to merge two csv by rownumber use azure datafactory

I would like to merge the following two CSV files (rest api data file and rest api response file). Please tell me how to do it.
CSV1:
ID, Name
1001, Nm1001
1002, Nm1002
CSV2:
status, message
success,
fail, XXXError
Expected file:
ID, Name, status, message
1001, Nm1001, success,
1002, Nm1002, fail, XXXError

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered lsc2021 commented

Hi @lsc2021 ,

Thank you for posting query in Microsoft Q&A Platform.

We can achieve this using dataflows in Azure data factory. Below is the detailed explanation of implementation.

Step1: Add two source transformations for both csv files.

109048-sourcetransformations.gif

Step2: Add Surrogate key Transformation on both sources to get unique key column

109114-surrogatetransformations.gif

Step3: Add Join Transformation to inner join on Surrogate key column values

109115-jointransformation.gif

Step4: Select Transformation to select only desired columns(remove your surrogate key columns).

109077-selecttransformation.gif

Step5: Finally apply Sink Transformation to load data in to your target storage

Hope this will help. Thank you


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a email-notifications


· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi, @ShaikMaheer-MSFT
Thank you very much!

0 Votes 0 ·

Hi @lsc2021 ,

My pleasure. Happy to help.

0 Votes 0 ·