Question on Parallelism in Azure Synapse Analytics
Hello experts, I'm seeking clarification on the concept of parallelism in Azure Synapse Analytics. Specifically, I'd like to understand how parallel processing is utilized within Synapse Analytics to optimize query performance and data processing. Can…
Configuring sql user permission to INSERT only via stored procedure in Synapse dedicated pool
We currently have a client with External users set up via AAD and each group has access to a certain schema with grant permission to select, insert, delete and update on their dedicated SQL pool. Our client would like to revoke explicit insert, delete…
Cant choose Key for upsert, in Copy Data-activity
I want to copy Data from an Azure SQL to a comsosdb container, with the copy data activity of Azure Synapse. As I cannot enter the uniqe key column, for the upsert behaviour, i receive a unique key violation error. Why is there no option to select the…
Synape managed private endpoint is in refreshing state
Hello, In synapse studio managed private endpoints stuck in refreshing state. Do you know what is causing the issue here?
connecting linked services error from sharepoint to synapse
Hello, Just wondering what else I could do if I get this error, I have all the correct information provided but flagged up with this error. An error occurred while sending the request.
How to identify if someone has disconnected AzureGit in Azure Synapse Analytics
Someone has disconnected the AzureGit connection from Azure Synapse Analytics. Is there a way to figure out who has done that task or is there a way to restrict it ? or is there any way we can implement security so only selected people can…
Run SQL scripts stored in Synapse dev instance on PPE & PROD env
Requirement is to run SQL scripts stored in Synapse Dev instance on subsequent PPE & PROD env. Please keep in minds following points : In Synapse dev workspace, sql files are stored as .sql files When pushed to repository, the files are…
Using elephas and keras deep learning libraries in Synapse notebook
Hi, I tried to find a solution for distributed computing with Keras deep learning libraries in Azure Synapse Notebook. 'elephas' looks like a good option. But I encountered the following error: Py4JJavaError Traceback (most recent call last) Cell In…
ADLS Gen2 operation failed: Operation returned an invalid status code Conflict. Account: 'x' endpoint does not support BlobStorageEvents or SoftDelete
Currently setting up a storage account for a synapse analytics workspace, there is an existing synapse workspace with a linked service to an azure storage account, When I tried to setup a similar configuration I get the error message below. Here it…
rename of pipeline failed part-way, now I have both source and destination pipeline and cant remove them
Hi we have a pipeline A that was being renamed to pipeline B, and the rename has failed. now we have pipeline A with an EntityState of "Deleting", and Pipeline B with an EntityState of "Creating". they are linked by Source and Target…
Deploying strategy on Lake Database and SQL Database objects to further environments.
I need assistance with deploying the Lake Database and SQL Database objects to the quality and production environments. Despite creating tables and external tables under these databases, I can't seem to find these objects in my branch.
How to maintain same folder structure as source while sink the processed file
I have a requirement to process the JSON to parquet on daily basis. I have folder A,B,C needs to sink the file to another container with same structure as A,B,C for example if I'm processing a file from folder A it should sink to output container folder…
Access Azure SQL DBs using Azure Synapse studio
I would like to understand how Azure Synapse Analytics can be used within the organization to facilitate data analysis and development. How will developers access Azure Datasets in a convenient way Is there a case for using Azure Synapse? I have a use…
Joining different SQL pools under one workspace in synapse
Hello, are we able to join two different SQL pools under one workspace which allows me to join tables as a query under Synapse/Datafactory? Many thanks
Is it possible to run Azure Synapse Pipelines with user impersonation?
We would like to run analysis scripts (Azure synapse pipeline) on user defined data (Azure storage), but we don't want to bother to get access to every possible storage account on our end. For this it would be beneficial to just use user impersonation…
Trouble Connecting Synapse Endpoint to Power BI After Latest Update
Hi, everyone! I have a connection between Synapse and pbix. Before the last update of Power BI in March 2024, I could connect easily using the SQL Server connector, and I set Database Credentials, Unencrypted Connection, Privacy Level = None. But after…
CosmosDB Analytical store delete changes in sql sink
Hi I am trying to capture delete changes from Azure cosmosdb analytical store using change data capture in Azure datafactory, Source is Cosmosdb, sink is Azure sql database. In between I am flattening my file using dataflow. My insert, update is…
Help on executing custom query on Azure Cosmos DB using Spark in Azure Synapse
Hi Team, I want to run custom query against cosmos db in spark using clientid and secret but I'm ending up with below error. can you please assit. I tried multiple way but it still gives same error. AppId has Reader access on the cosmos db account. As…
How to connect ADLS Gen2 from Synapse Notebook, using SAS Token.
Hello, i'm trying to connect with Data Lake Storage Gen2 in Synapse Notebook. I'm trying to send a parquet file from my subscription's ADLS to other subscription's ADLS. So i got a SAS token from other subscription's ADLS, and I tried to connect ADLS…
Workspace is in non-terminal state Failed and cannot be updated
Hello, I was working on creating a new workspace in Azure Synapse Analytics. During deployment, error is encountered. I tried to delete and re-create the workspace but same error. Tried to re-deploy, still error persisted. Any advice? Workspace is in…