question

ShahSapanaN-6586 avatar image
0 Votes"
ShahSapanaN-6586 asked ·

Azure Data Factory - Foreach for multiple CSV

Hello, I need to load multiple csv files from ADLS to SQL Db. For pipeline I am using lookupfiles to get the file list and than passing it to foreach. Within foreach I am using copydata. But i am getting error as each csv file has two extra lines of data before header starts. If i use skip line count within copydata than pipeline is throwing an error. Copy data for the same source and sink works without an error for single file but not within foreach. Any suggestion please ?

azure-data-factory
· 4
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @ShahSapanaN-6586,

Welcome to Microsoft Q&A forum and thanks for reaching out. Could you please share the error message you are receiving?

Thanks

0 Votes 0 ·

Hi @ShahSapanaN-6586,

Following up to see if you have got a chance to see my previous comment? If so could you please share the error message you are receiving as well the failed pipeline runID and failed activity runID?

Thanks

0 Votes 0 ·

Thanks for your response ! Sorry for late reply but there were deadlines at work. Issue is resolved now. But just wondering for future Q&A, will you be able to find the error with runID itself ? Asking as I am new to ADF. Thanks again.

0 Votes 0 ·

Hi @sapanashah-7759,

Thanks for your response and glad to know that the issue was resolved. Would you please share the resolution steps here with community as it could be beneficial for others who read this thread.

Also for future Q&A, I would suggest to share the complete error message along with your failed pipeline runID and activity runID so that It would help to narrow down the root cause analysis and also reduce the resolution time.

0 Votes 0 ·

0 Answers