Azure synapse staging

Akshay tondak 266 Reputation points
2022-01-28T07:59:30.157+00:00

In case of moving data from flat file to synapse :
.what is the staging analytics DB in this case.
In general, do we have to allocate the staging ourselves in each pipeline or it is automatically assigned.
.in case of issues with staging does this sow in logs (monitoring board)

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 31,151 Reputation points Microsoft Employee
    2022-01-28T12:40:12.857+00:00

    Hi @Akshay tondak ,
    Thankyou for using Microsoft Q&A platform and posting your query.

    Could you please confirm if you are using copy data activity to perform this action?

    Staging area, or landing zone, is an intermediate storage area which can be helpful to improve the Copy activity performance.

    It is not automatically assigned. It needs to be configured manually in the copy activity settings by choosing the AzureStorage linked service, which points to the instance of Storage that you use as an interim staging store and storage path you want to use as staging. If you do not provide any storage path specifically, a new folder with the name 'adfstagedcommandtempdata' will be automatically created with the staged file. This file will be deleted automatically once the copy is successful to the target dataset.

    169464-image.png

    For more details , please refer this article : Staged copy

    For having session logs for the activity run, you can enable logging with logging level as 'warning/info' as per need .

    169471-image.png
    Please refer : Session log in a Copy activity

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful