Data Factory auto create table in Copy activity doesn't seem to work, or isn't very useful

Question

question

CornelVerster-9491 asked Jul 12, '21 KranthiPakala-MSFT commented Mar 16, '22

Data Factory auto create table in Copy activity doesn't seem to work, or isn't very useful

Hi there

I'm trying to create copy activities where the source table is replicated into the Sink database, and the table is created according to what is in the Source. I know there is the "Auto create table" option when making the copy activity, but when I check this, it still tells me that I need to select a Sink table. This is exactly what I'm trying to avoid, as I want it to replicate the Source table in my Sink database, and I would expect that is what auto create table is supposed to do?

How do I get the copy activity to replicate the Source table without having to create the table manually in my Sink database?

Kind regards

azure-data-factory

· 2

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT · Jul 14, 2021 at 10:28 PM

Hi @CornelVerster-9491,

Just checking in to see if the below suggestion from @VaibhavChaudhari was helpful. If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread.

And, if you have any further query do let us know.

0 ·

KranthiPakala-MSFT KranthiPakala-MSFT · Jul 15, 2021 at 07:46 PM

Hi @CornelVerster-9491,

We still have not heard back from you. Just wanted to check if the below suggestion was helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread.

And, if you have any further query do let us know.

0 ·

Answer 1 · 2021-07-12T12:08:08.027Z

VaibhavChaudhari answered Jul 12, '21 KranthiPakala-MSFT commented Mar 16, '22

Open the Copy activity > Sink > Dataset > Table > Edit > type in the table name that should get created and run the pipeline.

Table that doesn't exist should get auto created

Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

· 5

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

CornelVerster-9491 · Jul 16, 2021 at 08:12 AM

Hi there

I've tried this but it doesn't work. If I select no table it tells me to select a table, and if I enter a table name it tells me there is an error, so I end up having to create the table with all correct columns anyway.

1 ·

KranthiPakala-MSFT CornelVerster-9491 · Jul 21, 2021 at 08:04 PM

Hi @cornelverster-949,

Apologies for the delayed response and sorry for your experience.

I just tested the auto create table feature and looks like it is working as expected. Please see below sample GIF.

I assume there might be some configuration issue. It would be great if you can share the complete error message with any images of the config of your dataset as well as your Copy activity. This would help us to troubleshoot and assist better.

We look forward to your response.

Thank you

2 ·

autocreatetabletesting.gif (1.4 MiB)

CruzDavid-0054 KranthiPakala-MSFT · Mar 15 at 09:43 PM

I'm not sure this was the solution. The AutoCreateTableEmp in your example seems to have already existed in the destination database. The question was how to get the Pipeline to automatically create the table on the first run.

2 ·

Show more comments

KranthiPakala-MSFT KranthiPakala-MSFT · Jul 22, 2021 at 06:06 PM

Hi there,

We still have not heard back from you. Just wanted to check if you are still facing the issue or need assistance on this? In case If you already found a solution, would you please share it here with the community?

Thank you

0 ·

question