How to run stored procedure in Azure Database for PostgreSQL using Azure Databricks Notebook
We have Stored Procedure available in Azure Database for PostgreSQL and we want to call or run or execute the postgreSQL stored procedures in Azure Databricks through Notebook We are attempting to run PostgreSQL stored procedures, through Azure…
Deploying strategy on Lake Database and SQL Database objects to further environments.
I need assistance with deploying the Lake Database and SQL Database objects to the quality and production environments. Despite creating tables and external tables under these databases, I can't seem to find these objects in my branch.
Synapse Python/Spark Notebook code with SQL to query data from linked service to SQL Server
In Synpase, I have linked service to a SQL Server database. I'm looking for a sample notebook code, either in python or spark, that I can run a complex SQL qery within this code to get data from multiple SQL Server tables, put the rsults in a dataframe…
Azure Synapse Link for dataverse to bring Dynamics 365 data to ADLS and Synapse for analytical purpose - Facing Issues and inconsistencies in the feature
We are using Synapse Link for Dataverse feature to bring dynamics 365 data to ADLS and Synapse Analytics. We have below open issues due to which we are unable to finalize the solution: In F&O linked dataverse environment, we have created a synapse…
Is it possible to hide a pipeline created in Azure Data Factory or Azure Synapse Analytics for a particular user/s?
Scenario : Lets say there are number of department in any organisation. Adf pipeline of one department can only be visible to respective department , not to other department. For ex. if the adf pipeline created by Data ETL related Department then…
Databricks integration to Azure Synapse Serveless SQL Pool
Hi, What is the way to connect to Databricks to Azure Synapse serverless SQL pool when I am trying to connect using serverless SQL endpoint getting an error as - Py4JJavaError: An error occurred while calling o388.load. :…
How to parse nested json array of document in ADF data flow
Hi all I am trying to fitch the values from a nested josh array of document , I have used aggregate to convert into objects but not able to fitch the values of all child nodes like as below itOffer.item itOffer.item.SplOfr itOffer.item.buy …
Where are the DataSets for the Prepare and transform data with Azure Synapse Analytics
Hello i am learning via the Microsoft Learning Modulle "Prepare and transform data with Azure Synapse Analytics" and try to reproduce the exercise. But i don't have acces to the datasets and the data sets are also not mentioned in the training…
"Continuous DataFlow execution failed" error on Link connection, while following Synapse Link tutorial
While following this tutorial on creating a Synapse Link, I get an unclear error when trying to start the Link Connection. I can't find any information on google about this error code. Continuous DataFlow execution failed. Error…
databricks to synapse
Hi Team, I am getting error while connecting databricks to synapse ... here is the code com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code. def…
Using UAMI in Azure Synapse Notebooks
I have a bunch of Synapse notebooks currently using AppId and secret through Linked Services and successfully running so far. As part of some initiative we need to migrate these notebooks to consuming User Assigned Managed Identity (UAMI). Notebooks…
Cant choose Key for upsert, in Copy Data-activity
I want to copy Data from an Azure SQL to a comsosdb container, with the copy data activity of Azure Synapse. As I cannot enter the uniqe key column, for the upsert behaviour, i receive a unique key violation error. Why is there no option to select the…
Azure Synapse Deployment Failure with "Exception has been thrown by the target of an invocation."
0 Failure to deploy azure synapse pipelines with below error: Set-AzSynapsePipeline : Exception has been thrown by the target of an invocation. 2024-05-08T08:29:52.7382260Z [31;1m[31;1m+ … $deploy = Set-AzSynapsePipeline -WorkspaceName $WorkspaceName…
How to prevent eventual "An insufficient number of arguments were supplied for the procedure or function cdc.fn_cdc_get_net_changes_" in Synapse?
I have a Data Flow that takes various tables from an Azure SQL Database source. All of these tables have CDC enabled at the Database level as well as having CDC enabled on the Source Connector (set to "Full on the first run, then…
Do you know how to install the 'ODBC Driver 17 for PostgreSQL' on a Azure Databricks cluster?
I am attempting to run postgreSQL stored procedures , through Azure Databricks notebook. We have stored procedure written in Azure Database for PostgreSQL and we want to run postgreSQL stored procedures through Azure Databricks Notebook (using…
Synapse>>Power BI
Hello- We have some sensitive data in azure synapse, the synapse view will be accessed by Power BI user for reporting. What is the best practice for sensitive data (PII) for production , do we mask the columns that has sensitive information ? If we…
Querying with Filename and Filepath Functions in Synapse Serverless
Hello, I have been reading about using filename() and filepath() in t-sql statements with synapse serverless sql: https://learn.microsoft.com/en-us/azure/synapse-analytics/sql/query-specific-files#functions Wondering if for the following statement:…
Synapse Link for Dataverse-SYN-806: Default storage container in Synapse workspace is not accessible error while enbling tables
Hi, I'm trying to setup a synapse link via dataverse to F&O. I'm able to setup the connection but when I enable tables sync status is throwing out error . Error details - SYN-806: Default storage container in Synapse workspace is not…
self-hosted integration from sharepoint to synapse
Hello, I successfully connect my synapse to file system by setting up self-hosted integration. However, previous I would like to connect my sharepoint to synapse but it keeps on having this error. We investigated, was wondering if we also need…
Azure Synapse Analytics | Pipeline | Linked Service to "Azure Database for PostgreSQL" not available in 'Stored Procedure'
Hi everyone, I am trying to create a simple pipeline in Azure Synapse Analytics which should write some files' metadata fields into a Database. To do so, I first created a linked service to a postresql database instance hosted on Azure: I am now trying…