Synapse Serverless SQL Pool Distribution

Kuldeep Chitrakar 1 Reputation point
2021-09-16T11:49:22.963+00:00

Hi

In Serverless SQL Pool , if I have only one file and I am querying it using Server less SQL pool How does it processes parallel. As per documentation, control node assigns the files to Compute node.

What is the best practice. Is it mandatory to have separate files in order to achieve best performance in Server less SQL pool.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Ronen Ariely 15,096 Reputation points
    2021-09-16T12:22:07.447+00:00

    Good day,

    if I have only one file and I am querying it using Server less SQL pool How does it processes parallel.

    Using simple SELECT from a single file, it does not by default. One file = one reader at a time, but...

    As per documentation, control node assigns the files to Compute node. What is the best practice.

    I don't think that we can discuss best practice without fully understand the scenario

    but one of the recommended solution most important features available in serverless SQL pool which you can use is: CREATE EXTERNAL TABLE AS SELECT (CETAS). CETAS is a parallel operation that creates external table metadata and exports the SELECT query results to a set of files in your storage account. Check the documentation for more information.

    0 comments No comments