question

Vs2021-4678 avatar image
0 Votes"
Vs2021-4678 asked HimanshuSinha-MSFT commented

Dynamic 365 Connector ADF -Incremental Load (Source Tab- Table Option)

Hello All,

It will be of great help if you can answer this :
I am using dynamic365 connector as source to move data into excel files using copy activity
1. I am forced to use table option instead of query option . I find that if the source table has some rows with null values in a column, the query option does not handle it and doesn't show that column in mapping tab. So I have to use table option to map the columns I need.



Given that scenario, how do I effectively do incremental load from Dynamic365 dataset . I do have a last run date ( Which loads excel files into database).
But I do not know how do I pass that date value with table option in source tab. Can anyone help with this?
I need to run copy activity by passing the date and get only data past that last run date (in table option of Source tab) and then create excel files from it as destination.

If you have resolution for any of the above problems, it will be very much helpful.
Thanks

azure-data-factory
· 5
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Is there anyone who can help with using dynamics365 connector in ADF?

0 Votes 0 ·

Hello @Vs2021-4678 ,
Thanks for the ask and using the Microsoft Q&A platform .
"I find that if the source table has some rows with null values in a column , the query option does not handle it and doesn't show that column in mapping tab".
Can you please share the query which you are trying to use ?
If you are trying to implement incremental loading you will have to use query .

Thanks
Himanshu

0 Votes 0 ·

Pls find code used in query -

132023-query.png



I have highlighted 2 attributes which has null in the values and so it doesnt display in the preview option and also doesnt show in mapping tab also. pls advice

If I try to manually type the column name in mapping tab, i get the following message

Column XX may not exist in the source data store, please import schema to get the column list.


0 Votes 0 ·
query.png (88.4 KiB)

Pls advice how to do incremental in fetch xml by using lastrundate as a parameter in query

0 Votes 0 ·

Hello @Vs2021-4678,
Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same.

Thanks
Himanshu

0 Votes 0 ·

0 Answers