4,444 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers One of the answers was accepted by the question author.

SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio

SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio 2019 It succeeds when i change the target platform to Microsoft Azure SQL database, but fails when i change it to SQL…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
Visual Studio
Visual Studio
A family of Microsoft suites of integrated development tools for building applications for Windows, the web and mobile devices.
4,673 questions
Not Monitored
Not Monitored
Tag not monitored by Microsoft.
36,406 questions
asked 2020-08-13T12:18:05.987+00:00
Albert Dove 21 Reputation points
accepted 2020-08-17T06:19:53.777+00:00
Albert Dove 21 Reputation points
2 answers

Cannot access Azure Synapse DWH on portal, "The resource was not found" error

When I access synapse Datawarehouse on a portal the resource not found error happening. But I am still using data explorer and data factory to connect to this DWH The detailed error as below: Details The resource was not found, it may have been…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-08-07T06:03:18.033+00:00
HUYNH DUY HAI DU 1 Reputation point
commented 2020-08-15T12:52:18.487+00:00
HarithaMaddi-MSFT 10,136 Reputation points
1 answer One of the answers was accepted by the question author.

Replicated Table Distribution for Small Deployment

Microsoft design guidance suggests using a replicated distribution for small dimensions, such as date. For small service tiers, e.g., less than DW1000 where there is only one compute node allocated, does this selection still have positive impacts on…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-13T22:29:12.963+00:00
Matt 21 Reputation points
commented 2020-08-12T08:08:24.613+00:00
HarithaMaddi-MSFT 10,136 Reputation points
2 answers

how azure synapse on demand calculate data processed ?

for testing purpose I am using a small parquet file, it is only 1.2 MB, but I notice when I check the data processed metrics, I see numbers like 12 mb. my question is does On demand mode for Azure Synapse charge for the compressed data or uncompressed

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-26T03:53:31.203+00:00
mim 26 Reputation points
answered 2020-08-10T11:33:08.577+00:00
HarithaMaddi-MSFT 10,136 Reputation points
1 answer One of the answers was accepted by the question author.

How to setup data retention for Azure synapse analytics?

How do we delete/archive data older than certain time period in Azure synapse Analytics?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-30T14:53:52.82+00:00
Jaswanth Vankayalapati 21 Reputation points
accepted 2020-08-05T19:33:33.577+00:00
Jaswanth Vankayalapati 21 Reputation points
1 answer One of the answers was accepted by the question author.

How to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse) ?

Trying to understand how to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse). There isn't enough supporting material on the steps to implement retention policies in Azure Synapse Analytics/ SQL Data Warehouse. Does…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-21T01:37:43.19+00:00
Neil Pereira 81 Reputation points
accepted 2020-08-05T16:08:00.983+00:00
Neil Pereira 81 Reputation points
1 answer

How to pass column list as argument from databricks spark for copy write semantic

Is there a way to pass column list argument for column mapping between spark and synapse table from databricks spark for write semantics as copy as we pass it while running copy command from synapse?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,955 questions
asked 2020-07-23T06:54:16.693+00:00
Rishabh 11 Reputation points
commented 2020-08-05T00:32:38.243+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
1 answer

How big is "Not Big Enough" for Synapse?

We are looking to move our data warehouse to the cloud. We don't have "big data". The biggest table we have has 200 millions rows. Is it cost effective to run a small data warehouse in Synapse? Is there a scenario that exists where you would…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-26T17:33:53.627+00:00
John Mihalko 1 Reputation point
commented 2020-07-31T14:43:39.797+00:00
HarithaMaddi-MSFT 10,136 Reputation points
1 answer One of the answers was accepted by the question author.

How to insert data in Azure Synapse Analytics through Azure Data factory without PolyBase

I have tried using Move and Transfar activity in data factory but I'm getting 2 error at publishing: ' Data flow activity 'dataflow1' requires a stagingLinkedService Data flow activity 'dataflow1' requires a stagingStoragePath ' I don't want to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,693 questions
asked 2020-07-30T03:57:37.353+00:00
m d 26 Reputation points
commented 2020-07-30T14:02:54.583+00:00
m d 26 Reputation points
2 answers

Synapse updating the data lake json file?

is it possible to update the json file from synapse? After reading, i need to update the json rows. When i tried to update/delete the json through external table, it's error out with, won't support the DML operation. Kindly advise how to achieve…

Azure SQL Database
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,363 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-16T20:01:09.163+00:00
ever 1 Reputation point
answered 2020-07-29T15:16:33.61+00:00
Girijesh Pandey 1 Reputation point
3 answers One of the answers was accepted by the question author.

Azure data lake storage Gen2 error external location not found

I used COPY INTO statement to copy csv file in ADLS Gen2 to Synapse table successfully with share access signature as credential. However, when I try to copy snappy.parquet file in the same storage account (different container) into a table in the same…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,363 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-17T21:04:55.303+00:00
Larry Feng 21 Reputation points
answered 2020-07-29T14:43:14.813+00:00
Girijesh Pandey 1 Reputation point
2 answers

Architectual Question (ADLS, Azure Synapse, AAS, Power BI)

We are using the following: Source data stored in ADLS (Blob Storage) Azure Synapse (sort of a staging layer) Azure Analysis Services (semantic layer) Power BI (for users to create their own vizualizations based on the AAS semantic layer) …

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
439 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-26T20:46:49.767+00:00
james.h.robinson.csm@gmail.com 6 Reputation points
commented 2020-07-28T14:32:07.89+00:00
Saubhagya Nayak 1 Reputation point
1 answer One of the answers was accepted by the question author.

is cetas refreshed automatically

sorry for the basic question, I just created a new CETAS (external table as a select) using azure synapse on demand, when the data source change will CETAS refresh automatically , or how to refresh a CETAS ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-25T07:34:15.013+00:00
mim 26 Reputation points
accepted 2020-07-28T04:24:49.987+00:00
mim 26 Reputation points
1 answer

Unable to load timestamp (Hexadecimal) from Azure SQL to Azure Synapse

Hi, I have been trying to load table from Azure SQL to Azure synapse (formerly Azure DW) using Azure Data Factory. However, it is failing with a timestamp column, which has hexadecimal values. Timestamp is not supported in Azure Synapse and it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-24T17:15:58.913+00:00
BIFlake 1 Reputation point
commented 2020-07-27T16:33:20.477+00:00
BIFlake 1 Reputation point
2 answers

Is it possible to Read CSV files where description has a quote (not delimited by quotes) in Synapse SQL On Demand?

Hello, my question is very sample if have the following CSV file in my datalake |Id|Description |1|my description |2| descry 3 " inches is it possible to use TSQL BULK an openquery to read the above content? Thank you so much

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-02T21:33:17.08+00:00
silvan 1 Reputation point
commented 2020-07-24T20:33:14.72+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
1 answer

Infer parquet schema to create table in SQL pool

hi, I am evaluating Synapse analytics (in preview) and need to create tables in Synapse sql pool from parquet files, stored in ADLS gen2. I would like to avoid creating tables manually in sql pool as my parquet files already have a schema with…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-15T14:03:33.717+00:00
Boris Tyukin 1 Reputation point
commented 2020-07-24T20:24:06.15+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
1 answer

Error at create spark database in synapse workspace notebook using orchestrate pipeline.

I'm getting below error while running synapse notebook from orchestrate in synapse workbook. My notebook runs fine when ran individually from Develop. I gave Owner and Storage Blob Data Owner role to myself before running the pipeline as mentioned in…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,363 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-21T07:01:54.63+00:00
Rishabh 11 Reputation points
commented 2020-07-23T22:04:55.32+00:00
MartinJaffer-MSFT 26,036 Reputation points
1 answer

How do we add user to synapse analytics workspace ?

Hi, How do i add AAD user to a specific Synapse Analytics Workspace. At the moment it is showing only SQL Pool Admin, Spark Admin and Workspace Admin. I want to just add end user to a workspace so that they can work with it. In Azure Databricks we…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,955 questions
asked 2020-07-13T14:14:27.267+00:00
Anbu.Dhanushkodi 1 Reputation point
commented 2020-07-23T07:49:05.83+00:00
Rishabh 11 Reputation points
1 answer

Error while Running Predict Function in Synapse Studio

Getting an error Incorrect Syntax near 'Model' while running the Prediction function in T-SQL statement. The below query was tried on Azure Synapse Studio as well SSMS and did not work DECLARE @modelvarbinary(max) = (SELECT Model FROM…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-10T01:02:58.17+00:00
Sneha Sheshadri 1 Reputation point
commented 2020-07-21T20:49:32.54+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
1 answer

What should I put the "Host" while linking the Oracle Service Cloud to Azure Synapse Analytics?

I want to link the Oracle Service Cloud to Azure Synapse Analytics portal, but I am not getting what should be the "Host" 12296-screenshot-65.png

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,444 questions
asked 2020-07-15T05:54:59.867+00:00
Pallav Kulkarni 1 Reputation point
commented 2020-07-21T20:49:07.15+00:00
HimanshuSinha-msft 19,381 Reputation points Microsoft Employee