question

johannahMotshwene-9508 avatar image
0 Votes"
johannahMotshwene-9508 asked HimanshuSinha-MSFT commented

ForEach/Copy Activity Error

Hi All

I have a ForEach Activity, that copies data from tables in MySQL Database into tables in a Data warehouse(MySQL).
And I quite often get an error which I don't understand or know how to prevent from happening again.
I usually get the error for one or two tables in the ForEach while the other tables run successfully.

Error Code: 2200

Error Message:
'Type=MySql.Data.MySqlClient.MySqlException,Message=Failed to read the result set.,Source=MySqlConnector,''Type=System.IO.IOException,Message=Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host.,Source=System,''Type=System.Net.Sockets.SocketException,Message=An existing connection was forcibly closed by the remote host,Source=System,'

Please assist with an explanation and how to prevent this from happening.

azure-data-factoryazure-database-mysql
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @johannahMotshwene-9508 ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu

0 Votes 0 ·
HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered

Hello @johannahMotshwene-9508 ,
Thanks for the ask and using the Microsoft Q&A platform .
Since you are using the foreach loop , I am assuming that the you are copying once table at a time . I am assuming that you are getting this error when you try to copy bigger tables . Can you please check this ? ( create a copy activity and select a table name which is big and try to run it .

I think increasing the timeout setting in the copy activity should help .

Please do let me know how it goes .
Thanks
Himanshu
Please do consider clicking on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

johannahMotshwene-9508 avatar image
0 Votes"
johannahMotshwene-9508 answered HimanshuSinha-MSFT commented

Hi @HimanshuSinha-MSFT

Thank you for the feedback and apologies for the late response.

Yes all the tables in the ForEach start running at the same time. And yes this happens for the bigger tables. But strangely, when I receive the error and I end up not making any changes, all the tables will run as normal and successfully the following day. So I am trying to understand why we get the error and how to prevent it.

I have created a copy activity for a big table and have tried to run it, it runs successfully without giving me any error that is of course if I set a big timeout for it.

· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @johannahMotshwene-9508 8,
Thanks for the patience , I think in your case we need to look into that logs etc and so someone needs to work in person . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same.

Thanks
Himanshu

0 Votes 0 ·

Hello @johannahMotshwene-9508 , ,
We haven’t received any email from you as requested in the last response and was just checking back to see if you have a resolution . In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, please respond back with the more details as requested and we will try to help .
Thanks
Himanshu

0 Votes 0 ·

Hello @johannahMotshwene-9508 , ,
We haven’t received any email from you as requested in the last response and was just checking back to see if you have a resolution . In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, please respond back with the more details as requested and we will try to help .
Thanks
Himanshu

0 Votes 0 ·