question

KajolDhosewan-5886 avatar image
0 Votes"
KajolDhosewan-5886 asked KajolDhosewan-5886 commented

HDInsight cluster is failing when upgrading the version to 4.0

Hi Team,

I am getting this error :
Operation on target Txxxxxx failed: Hadoop job failed with exit code '2'. See 'wasbs://adfjobs@sc1admadstg01.blob.core.windows.net/HiveQueryJobs/c269912c-700d-4907-a4d9-4e51ae0096ca/02_08_2021_06_47_21_708/Status/stderr' for more details. Alternatively, open the Ambari UI on the HDI cluster and find the logs for the job 'job_1627886449866_0002'. Contact HDInsight team for further support.

this error is random and usually happens when i manually run the pipeline.

HDinsight cluster creates the cluster but i guess then it fails while running hive query.

the pipeline runs successfully at 3.6 version of HDInsight cluster Linked Service and it gives the above mentioned error when i upgrade the version to 4.0.

azure-data-factoryazure-hdinsightazure-hdinsight-rserver
· 7
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@Azure-hdinsight @azure-hdinsight-rserver please let me know if you need any other details

0 Votes 0 ·

Hello @KajolDhosewan-5886 ·,
Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same.

0 Votes 0 ·

HI Himanshu,

i have mailed you with required details.

0 Votes 0 ·

Hi Team @Azure-HDInsight,

this hive activity in my pipeline is failing due to HDInsight cluster Version upgrade. i have updated the version to 4.0 from 3.6.

when i have tried running the pipeline with version 3.6 it ran successfully. it is failing for version 4.0
121536-image.png


0 Votes 0 ·
image.png (8.4 KiB)

Hello @KajolDhosewan-5886 ,
Just wanted to check back if you have created the SR # with the Microsoft support , if yes can you please share the SR#.
Thanks
Himanshu

0 Votes 0 ·

Hello @KajolDhosewan-5886 ,
Just wanted to check back if you have created the SR # with the Microsoft support , if yes can you please share the SR#.
Thanks
Himanshu

0 Votes 0 ·
Show more comments

0 Answers