question

PandeyAman-7220 avatar image
0 Votes"
PandeyAman-7220 asked ShaikMaheer-MSFT commented

Copy data from website to Azure Blob

Hi,

Thanks in advance!

I am trying to copy data from website to Azure blob using copy function in ADF. I am getting the below mentioned error.

Link for file: http://transparenciacre.westcentralus.cloudapp.azure.com/PNT/73/III/E/PL/Precios_promedio_diarios_y_mensuales_en_estaciones_de_servicio.xlsx


File is a excel.



Error:

Operation on target Copy data1 failed: Failure happened on 'Sink' side. ErrorCode=HttpFileFailedToRead,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to read data from http server. Check the error from http server:Unable to connect to the remote server,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 13.78.144.244:80,Source=System,'

Can you suggest me what to do to resolve this error?

azure-data-factory
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @PandeyAman-7220 ,

Following up to see if below answer helps you? If yes, Please accept answer. Accepted answers helps community as well. Thank you.

0 Votes 0 ·

Hi @PandeyAman-7220 ,

Just checking if below answer helps you? If yes, Please accept answer. Accepted answers helps community as well. Thank you.

0 Votes 0 ·

1 Answer

ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered ShaikMaheer-MSFT commented

Hi @PandeyAman-7220 ,

Welcome to Microsoft Q&A Platform. Thank you for posting query here.

l tried to Copy file from below link to Blob and it was working perfectly fine. You need to consider using HTTP connector type dataset in Source tab of Copy activity as your link is going to download a file.

HTTP connector is generic to retrieve data from any HTTP endpoint, e.g. to download file.

Please check below detailed steps of implementation.

Step1: Copy activity, source tab select a dataset which is HTTP connector type with binary format.

130683-sourcedataset.gif

Step2: Copy activity Sink tab select a dataset which is Blob connector type with binary format and give file name inside your dataset as per your requirement. Here I gave name to my file in sink as excelfile.xlsx

130665-sinkdataset.gif

Step3: Copy activity executed Successful.

130684-execution.gif

Hope this will help. Please let us know if any further queries.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators



sourcedataset.gif (1.4 MiB)
sinkdataset.gif (570.3 KiB)
execution.gif (564.6 KiB)
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I tried the above steps as stated, still got the below mentioned error:

Failure happened on 'Sink' side. ErrorCode=HttpFileFailedToRead,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to read data from http server. Check the error from http server:Unable to connect to the remote server,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 13.78.144.244:80,Source=System,'


Pipeline run ID:
fd0f2e95-57d8-4f61-a862-542f9c873c29


0 Votes 0 ·

Hi @PandeyAman-7220 ,

Sorry to hear that. Could you please check is Test connection happening good inside HTTP linked service? Could you please share your linked service configurations if possible?

0 Votes 0 ·

Hi @PandeyAman-7220 ,

We didn't hear back yet. Could you please check above comment and respond? Also, please refer below video where similar ask is implemented.
https://www.youtube.com/watch?v=LSF4ca0vfJE

If this helps, Please click on Accept Answer. Accepted answers helps community as well.

0 Votes 0 ·