Source: Hubspot
Sink: parquet file in Azure blob storage
Even when i adjust Core count to 16 (+16 core), following error still pop up when running pipeline:
][1]
Pipeline run ID:
50d2a7b0-c483-449d-8bb8-5f846f8e0914
Source: Hubspot
Sink: parquet file in Azure blob storage
Even when i adjust Core count to 16 (+16 core), following error still pop up when running pipeline:
][1]
Pipeline run ID:
50d2a7b0-c483-449d-8bb8-5f846f8e0914
Hello @NamNguyen-1476 ,
Thanks for the ask and using Microsoft Q&A platform .
Just wanted to suggest you to try the below options and let us know if that helps .
Please try out the Compute type to "Memory optimatized " and publish the changes and see if that helps .

2.Also try to update the Azure IR to a higher core

Please do let me know how it goes .
Thanks
Himanshu
Please don't forget to click on
or upvote
button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
Hello @NamNguyen-1476 ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
Hello @NamNguyen-1476 ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
11 people are following this question.
Update documents in cosmos from a json file in the datalake using a copy data in datafactory
Error while copying Files from Share Point Online to Azure Data Lake using Azure Data Factory?
Multiple filter conditions in a pipeline
Extract the date hierarchy from previous data in Data Lake Partition
Validation failed while upgrading Azure blob to datalake gen 2