question

AyushChauhan-3425 avatar image
0 Votes"
AyushChauhan-3425 asked LaxmiKakarlapudi-8523 commented

How to Fetch an .bak file from ADF pipeline?

I want to migrate the data in the .bak file in my storage account to SQL Db, through ADF. As the .bak file is not a supported file format in ADF datasets, then what's the workaround that I should opt to get it done?

azure-data-factoryazure-sql-database
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @AyushChauhan-3425 and welcome to Microsoft Q&A.

Any file/blob can be copied or moved to another file/blob location, regardless of file type, by using the Binary datasets. What makes this possible, and different, from other dataset types, is that the data is just being copied as-is, without any transformation, reading, or ingestion.

To my understanding, .bak files are used by SQL to overwrite and restore a database to a point in time. This is something initiated by the database, and not handled by Data Factory.

If you want to simply migrate or ingest data, I recommend using a method other than .bak files.

That is my understanding, at least. Please let me know if I got something wrong.

So, which are your trying to do? Restore a database? Migrate entire database from on-prem to cloud? Copy data?

0 Votes 0 ·

Hi Ayush,

How are you able to get .bak files into datalake. I used azure webactivity to get the url and once I put the url in http it downloads the .bak file. But I am stuck how to pass the url and get .bak file to adls2? Can you explain your pipeline?

Thanks,
Laxmi

0 Votes 0 ·

If our discussion resolved the issue, please mark as accepted answer.

0 Votes 0 ·

1 Answer

AyushChauhan-3425 avatar image
0 Votes"
AyushChauhan-3425 answered MartinJaffer-MSFT commented

Hello @MartinJaffer-MSFT

Azure has deprecated the online migration to Azure SQL Db, that's why we are trying to simply store full backup from SQL Server to Azure storage account and then try to migrate data with .bak files in storage account to Azure SQL Db through ADF.

Other than that in the case of the binary dataset, we have to choose a binary dataset in both sink and source, but Azure SQL Db acts as the sink in our case.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Okay, so if I understand correctly you are going:

On prem SQL server -> Azure storage -> Azure SQL

I'm sorry, @AyushChauhan-3425 , but I don't think this precise combination of technologies will work that way.

While Data Factory can be used as a data migration method, Data Factory does not work directly with .bak files. Data Factory instead would connect to both databases, and pull the data. There are a number of implementations Data Factory can do, but at the most basic level, each table is a separate write action.



More Migration tools
Other migration options

For .bak file specifically, it can be retrieved from Azure Storage for SQL server, and Azure SQL Managed Instance.


0 Votes 0 ·