What is the best way to transfer the data from one database to other database in Azure aprt from elastic query.

prashyuth 1 Reputation point
2020-08-15T03:21:56.137+00:00

Hi All,
Elastic query is taking time for more number of records. Is there any other better way to transfer the data from one database to other database.
My source table is huge tx table ,need to transfer to other database for every 15 minutes. But the job itself is taking 20 minutes to transfer . For every batch the data may vary from 10000 to 20000 , we are using 100 DTU.

Azure SQL Database

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Vaibhav Chaudhari 38,631 Reputation points
    2020-08-15T07:31:25.593+00:00

    Azure data factory should be better for this task. You can scale up DIU, Parallel copies etc. settings of Copy activity and also schedule the pipeline to run every 15 minutes.

    =========================================================
    Please don't forget to "Accept Answer" and upvote if the response helped -- Vaibhav

    0 comments
  2. Mark Patton 1 Reputation point
    2020-08-15T22:10:52.627+00:00

    Hi!

    You could consider setting up an Azure SQL Sync Group which will allow you to synchronise your Azure SQL Database to another.

    I have used it as a mechanism for syncing specific elements of the db schema to another Azure SQL Database owned by a separate customer business unit.

    You can set the sync frequency between 5mins and 30 days which is suitable for your scenario of 15mins.

    Here is a link which you may find useful for setting this up: https://learn.microsoft.com/en-us/azure/azure-sql/database/sql-data-sync-sql-server-configure

    Hope this is along the correct lines of your query and that you find it useful.

    Mark.

    0 comments