Azure Synapse Analytics

External Database Scoped Credential via SAS

Is it possible to create a data base scoped credential in synapse for Azure Blob Storage in SYnapse? Tried this scenario : WITH IDENTITY = 'SHARED ACCESS SIGNATURE', SECRET = '<your SAS secret without the preleading ?>'; CLOSE MASTER KEY; -- only…

Querying flat files (parquet, csv) with different columns

Hi, I'm trying to Query a set of files that are stored in ADL Gen2. Those files have different columns between them like: File 1: Id, Name, LastName File 2: Id, Name, LastName, Phone How could I create an external table without conflicts? …

Visualization/plots/graphs executed successfully on PySpark in Azure Synapse but not showing up! Please help!!

Visualization/plots/graphs executed successfully on PySpark in Azure Synapse but not showing up! Please help!!

Can you connect to an Azure Synapse Analytics Spark cluster through SSMS?

Hi All, I'm new to Azure Synapse Analytics and would like to use the Spark Cluster feature. My team are SSMS SQL users and would like to query the data on a Spark Cluster through SSMS. I know the Serverless SQL endpoint link can be used was…

How to query 3rd party Azure DataLake Gen2 and only store the results

First, what I am trying to do is I want to query and aggregate raw JSON files stored in a 3rd party's Azure Data Lake (Gen2) and store those aggregates in my own data lake or relation db. I do not want to physically copy all of those raw JSON files…

temp table getting dropped in synapse in the same session.

Hi All, I am trying to create temp tables for some analysis on the synapse analytics. While I am able to operate the data from temp table in the same execution but I am unable to access temp table individually in the same session. Just wondering if…

Azure Synapse resource group concept

Please correct me if I am wrong Suppose I have two users in smallrc and two users in xlargerc If both users in smallrc run a query at the same time, user B will need to wait user A to complete before executing , because Slots used by smallrc is…

Azure synapse : is it possible to check each query DWU usage ?

Are there any DMV in Azure synapse that can check each query DWU usage ?

Best options to pull data from SaaS API to Azure Synapse

What are the best options for ingesting data from SaaS Application to Synapse through API with Authentication? We have a couple of SaaS Applications such as NetSuite, EyeShare & SAP SaaS Applications, and planning to ingest the data to Synapse but…

Are composite primary keys supported in Azure Synapse external tables?

Hi. Are composite primary keys in Azure Synapse external tables supported? If yes, can you kindly share the syntax for creating the composite PK? Thank you. Hans Kiamzon

SQL SERVER Source table create point in table of 70 gb table

Hi Guys, We want to create snapshot of an table everyday in azure synapse on sQldw, what would be best approach for daily load of 70GB table from on premise sql,oracle or sap hana, we want load the data in mill seconds max in minutes. Hint -Similar…

Synapse with git integration - publish issues with spark job

I'm having issues with git integration in Synapse. They concern spark job definition in pipelines. When creating new job, the execution policy is saved, commited to git. It is present on collaborative branch after completing pull request. …

No results when querying using Openrowset from ADLS Gen2.

No results when querying using Openrowset from ADLS Gen2. I used to able to query earlier and for the past two weeks it is showing me No results. Any change in permissions? I did follow all the permissions as in below URL. …

Azure synapse : partition a table that has no partition

Is it possible to partition a table (which current not partitioned) , without recreate the table ?

Azure synapse: result Cache

May I know it's 1TB limit result cache for every DWU level ???

Databricks readstream writestream to Azure Synapse

I am having an issue on writing stream to Azure synapse with the following error . let's have a look and see if there is idea ?

Azure synapse : Fastest way to load into Fact table

what's the fastest way to load/insert in to Current fact table(NOT CREATE A NEW ONE) ? – INSERT INTO … SELECT FROM … – CREATE TABLE … AS SELECT … – Polybase – BCP – OPENROWSET / BULK INSERT – COPY INTO … ??

Azure Synapse : What's the actual size of the database ?

Azure Synapse: How do you set up blob storage file as Azure Synapse external table that can be replicated?

Hello, In Azure Synapse, one of the more powerful features is setting up a Spark table and having it replicated to query it in SQL Serverless. This works great if you set up a file in the data lake as a Spark table, but if I set up an azure blob…

synapse team development

How do you set up a development team say 1-5 devs to do shared pipeline development to a synapse data warehouse. All I see is brief comments to set up and use GIT repository .