question

AdityaRaj-8613 avatar image
0 Votes"
AdityaRaj-8613 asked SathyamoorthyVijayakumar-MSFT commented

Skipped rows are not logged in copy activity while copying to snowflake.

129073-capture.pngI am trying to copy data from teradata to snowflake using ADF copy activity. I am sharing details of setting that I am using. When some rows are skipped, skipped rows are not being copied in staging location. Am i doing something wrong or is there any other way to get skipped records.129055-capture2.png


azure-data-factory
capture2.png (6.5 KiB)
capture.png (30.9 KiB)
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello AdityaRaj-8613 ,


Thanks for the question and using MS Q&A platform.

Wanted to understand whether you are able see other log activities and missing only skipped file entries (Or) You are not able to see any of the entries being logged ?

0 Votes 0 ·
AdityaRaj-8613 avatar image AdityaRaj-8613 SathyamoorthyVijayakumar-MSFT ·

I am seeing some info regarding copy activity being populated in one log file. But I am not seeing skipped rows being populated anywhere.

0 Votes 0 ·

1 Answer

SathyamoorthyVijayakumar-MSFT avatar image
0 Votes"
SathyamoorthyVijayakumar-MSFT answered SathyamoorthyVijayakumar-MSFT commented

Hello @AdityaRaj-8613

Thanks for the question and using MS Q&A platform.

The issue could be because of the special character '/\' in your data which overlaps with the escape character('\').

You could try the below suggestion and let us know :

You could create two copy activity in place one Copy activity with staging enabled.

Copy Activity 1 :

  • Tera data --> Blob ( DelimitedText)

You could configure the Delimited Dataset with the following configuration (character that doesn't occur in the data)

133961-image.png

This will copy the data from the Teradata to Blob with the above configuration.

Copy Activity 2

The copied data in the blob will be pushed to snowflakes.

  • Blob (DelimitedText) --> Snowflake

Hope this will help. Please let us know if any further queries.



  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


image.png (40.4 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @AdityaRaj-8613
Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·