question

MikeHems-1808 avatar image
0 Votes"
MikeHems-1808 asked ShaikMaheer-MSFT answered

Azure Data Factory ODATA API - trouble with encoding (copy data activity)

Hi,

I am trying to do a simple "Copy Data" activity in Azure Data Factory.

My source dataset is an ODATA API, which has a $select filter (to specify columns) like so:
![194189-image.png][1]



All columns are loaded just fine in my destination (SQL server), only I am missing the column "specialField/Custom:81". When I click "preview data", or simply run the Copy Data activity, I get all fields except this one.

It seems clear that it is because the field name contains special characters. How do I fix this? I can easily retrieve data from this field in Postman, so it is a Data Factory issue.

My progress so far: I tried to using "encodeUriComponent", which successfully retrieves the specialField and all other specialFields, but they are all NULL, when they should not be.

azure-data-factory
image.png (59.2 KiB)
5 |1600 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered

Hi @MikeHems-1808 ,

Thank you for posting query in Microsoft Q&A Platform.

Could you please try using below as filter to escape special character in your column name and see if that helps?
specialField//Custom:81

Please let us know how it goes. Also please share your Dataset configuration screenshots and copy activity screenshots to understand your setup better. Thank you.

· 1
5 |1600 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

ShaikMaheer-MSFT avatar image ShaikMaheer-MSFT ·

Hi @MikeHems-1808 , Just checking if get chance to share updates? If you got an workaround then please share same with community. Thank you.

0 Votes 0 ·