4,460 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

How to run stored procedure in Azure Database for PostgreSQL using Azure Databricks Notebook

We have Stored Procedure available in Azure Database for PostgreSQL and we want to call or run or execute the postgreSQL stored procedures in Azure Databricks through Notebook We are attempting to run PostgreSQL stored procedures, through Azure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,963 questions
asked 2024-05-22T04:46:02.37+00:00
Anuj, Singh (Cognizant) 25 Reputation points
answered 2024-05-22T11:25:18.69+00:00
PRADEEPCHEEKATLA-MSFT 79,376 Reputation points Microsoft Employee
2 answers

Deploying strategy on Lake Database and SQL Database objects to further environments.

I need assistance with deploying the Lake Database and SQL Database objects to the quality and production environments. Despite creating tables and external tables under these databases, I can't seem to find these objects in my branch.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-10T11:36:27.0366667+00:00
Sai Kishore Amara 20 Reputation points
commented 2024-05-22T10:43:22.19+00:00
phemanth 6,630 Reputation points Microsoft Vendor
1 answer

Synapse Python/Spark Notebook code with SQL to query data from linked service to SQL Server

In Synpase, I have linked service to a SQL Server database. I'm looking for a sample notebook code, either in python or spark, that I can run a complex SQL qery within this code to get data from multiple SQL Server tables, put the rsults in a dataframe…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
12,877 questions
asked 2024-04-24T13:45:40.7233333+00:00
ylycfj88 5 Reputation points
commented 2024-05-22T10:36:44.55+00:00
Eswar Chitirala 0 Reputation points
0 answers

Azure Synapse Link for dataverse to bring Dynamics 365 data to ADLS and Synapse for analytical purpose - Facing Issues and inconsistencies in the feature

We are using Synapse Link for Dataverse feature to bring dynamics 365 data to ADLS and Synapse Analytics. We have below open issues due to which we are unable to finalize the solution: In F&O linked dataverse environment, we have created a synapse…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,366 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
73 questions
Microsoft Power Platform Training
Microsoft Power Platform Training
Microsoft Power Platform: An integrated set of Microsoft business intelligence services.Training: Instruction to develop new skills.
112 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
9 questions
asked 2024-05-21T04:28:25.19+00:00
Sriram M 0 Reputation points
commented 2024-05-22T09:57:15.17+00:00
Harishga 4,170 Reputation points Microsoft Vendor
1 answer

Is it possible to hide a pipeline created in Azure Data Factory or Azure Synapse Analytics for a particular user/s?

Scenario : Lets say there are number of department in any organisation. Adf pipeline of one department can only be visible to respective department , not to other department. For ex. if the adf pipeline created by Data ETL related Department then…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,719 questions
asked 2024-05-22T06:43:06.7966667+00:00
Rachit Pandya 0 Reputation points
commented 2024-05-22T09:43:49.62+00:00
Harishga 4,170 Reputation points Microsoft Vendor
0 answers

Databricks integration to Azure Synapse Serveless SQL Pool

Hi, What is the way to connect to Databricks to Azure Synapse serverless SQL pool when I am trying to connect using serverless SQL endpoint getting an error as - Py4JJavaError: An error occurred while calling o388.load. :…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,963 questions
asked 2024-05-21T16:50:55.78+00:00
Vishnu Tupe 0 Reputation points
commented 2024-05-22T09:29:24.85+00:00
Vishnu Tupe 0 Reputation points
0 answers

How to parse nested json array of document in ADF data flow

Hi all I am trying to fitch the values from a nested josh array of document , I have used aggregate to convert into objects but not able to fitch the values of all child nodes like as below itOffer.item itOffer.item.SplOfr itOffer.item.buy …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,963 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,719 questions
asked 2024-05-02T15:44:57.8633333+00:00
venkat rao 45 Reputation points
commented 2024-05-22T08:57:45.5533333+00:00
venkat rao 45 Reputation points
1 answer

Where are the DataSets for the Prepare and transform data with Azure Synapse Analytics

Hello i am learning via the Microsoft Learning Modulle "Prepare and transform data with Azure Synapse Analytics" and try to reproduce the exercise. But i don't have acces to the datasets and the data sets are also not mentioned in the training…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-20T11:48:08.3133333+00:00
Erik van der Hoeven 0 Reputation points
answered 2024-05-22T08:35:35.3433333+00:00
AnnuKumari-MSFT 31,716 Reputation points Microsoft Employee
0 answers

"Continuous DataFlow execution failed" error on Link connection, while following Synapse Link tutorial

While following this tutorial on creating a Synapse Link, I get an unclear error when trying to start the Link Connection. I can't find any information on google about this error code. Continuous DataFlow execution failed. Error…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-21T01:47:59.0233333+00:00
Dario Ruben Scanferlato 0 Reputation points
commented 2024-05-22T08:17:46.7066667+00:00
PRADEEPCHEEKATLA-MSFT 79,376 Reputation points Microsoft Employee
0 answers

databricks to synapse

Hi Team, I am getting error while connecting databricks to synapse ... here is the code com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code. def…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-21T09:20:54.4866667+00:00
Vineet S 185 Reputation points
commented 2024-05-22T08:16:26.5033333+00:00
Vineet S 185 Reputation points
0 answers

Using UAMI in Azure Synapse Notebooks

I have a bunch of Synapse notebooks currently using AppId and secret through Linked Services and successfully running so far. As part of some initiative we need to migrate these notebooks to consuming User Assigned Managed Identity (UAMI). Notebooks…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-21T01:42:12.56+00:00
Siva Gangadhar Galla 0 Reputation points Microsoft Employee
commented 2024-05-22T07:58:19.6166667+00:00
Harishga 4,170 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Cant choose Key for upsert, in Copy Data-activity

I want to copy Data from an Azure SQL to a comsosdb container, with the copy data activity of Azure Synapse. As I cannot enter the uniqe key column, for the upsert behaviour, i receive a unique key violation error. Why is there no option to select the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,469 questions
asked 2024-05-10T12:05:43.3633333+00:00
Axel 20 Reputation points
accepted 2024-05-22T07:10:24.0633333+00:00
Axel 20 Reputation points
1 answer

Azure Synapse Deployment Failure with "Exception has been thrown by the target of an invocation."

0 Failure to deploy azure synapse pipelines with below error: Set-AzSynapsePipeline : Exception has been thrown by the target of an invocation. 2024-05-08T08:29:52.7382260Z [31;1m[31;1m+ … $deploy = Set-AzSynapsePipeline -WorkspaceName $WorkspaceName…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,719 questions
asked 2024-05-22T05:37:02.1733333+00:00
Sree 0 Reputation points
answered 2024-05-22T06:34:17.7133333+00:00
hossein jalilian 4,185 Reputation points
1 answer One of the answers was accepted by the question author.

How to prevent eventual "An insufficient number of arguments were supplied for the procedure or function cdc.fn_cdc_get_net_changes_" in Synapse?

I have a Data Flow that takes various tables from an Azure SQL Database source. All of these tables have CDC enabled at the Database level as well as having CDC enabled on the Source Connector (set to "Full on the first run, then…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2023-08-03T04:03:42.9033333+00:00
Matty Stubbs 190 Reputation points
commented 2024-05-22T06:23:16.2633333+00:00
Smaran Thoomu 10,720 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Do you know how to install the 'ODBC Driver 17 for PostgreSQL' on a Azure Databricks cluster?

I am attempting to run postgreSQL stored procedures , through Azure Databricks notebook. We have stored procedure written in Azure Database for PostgreSQL and we want to run postgreSQL stored procedures through Azure Databricks Notebook (using…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,963 questions
Azure Database for PostgreSQL
asked 2024-04-30T11:06:56.06+00:00
Anuj, Singh (Cognizant) 25 Reputation points
commented 2024-05-22T04:46:59.1066667+00:00
Anuj, Singh (Cognizant) 25 Reputation points
1 answer

Synapse>>Power BI

Hello- We have some sensitive data in azure synapse, the synapse view will be accessed by Power BI user for reporting. What is the best practice for sensitive data (PII) for production , do we mask the columns that has sensitive information ? If we…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-21T21:01:49.0566667+00:00
Sourav 80 Reputation points
answered 2024-05-22T02:01:17.36+00:00
Harishga 4,170 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

Querying with Filename and Filepath Functions in Synapse Serverless

Hello, I have been reading about using filename() and filepath() in t-sql statements with synapse serverless sql: https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/query-specific-files#functions Wondering if for the following statement:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Transact-SQL
Transact-SQL
A Microsoft extension to the ANSI SQL language that includes procedural programming, local variables, and various support functions.
4,562 questions
asked 2024-05-21T17:38:30.0266667+00:00
Karl Gardner 45 Reputation points
answered 2024-05-21T20:52:17.8666667+00:00
Karl Gardner 45 Reputation points
1 answer

Synapse Link for Dataverse-SYN-806: Default storage container in Synapse workspace is not accessible error while enbling tables

Hi, I'm trying to setup a synapse link via dataverse to F&O. I'm able to setup the connection but when I enable tables sync status is throwing out error . Error details - SYN-806: Default storage container in Synapse workspace is not…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-17T12:32:44.3633333+00:00
Sandz 66 Reputation points
commented 2024-05-21T20:31:04.35+00:00
BhargavaGunnam-MSFT 27,326 Reputation points Microsoft Employee
0 answers

self-hosted integration from sharepoint to synapse

Hello, I successfully connect my synapse to file system by setting up self-hosted integration. However, previous I would like to connect my sharepoint to synapse but it keeps on having this error. We investigated, was wondering if we also need…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
asked 2024-05-15T12:47:22.0833333+00:00
Nick Wong 170 Reputation points
commented 2024-05-21T20:30:33.79+00:00
BhargavaGunnam-MSFT 27,326 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Azure Synapse Analytics | Pipeline | Linked Service to "Azure Database for PostgreSQL" not available in 'Stored Procedure'

Hi everyone, I am trying to create a simple pipeline in Azure Synapse Analytics which should write some files' metadata fields into a Database. To do so, I first created a linked service to a postresql database instance hosted on Azure: I am now trying…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,460 questions
Azure Database for PostgreSQL
asked 2024-05-21T10:06:49.0933333+00:00
Lorenzo Perino 0 Reputation points
accepted 2024-05-21T18:43:34.6533333+00:00
Lorenzo Perino 0 Reputation points