4,365 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Dedicated SQL Pool Performance issues

We're utilizing Tableau's live connection feature, linked to a dedicated SQL pool. We've taken all necessary steps from the SQL pool side, such as creating required indexes, statistics, assigning appropriate distribution models and partitioning tables,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-25T17:57:30.54+00:00
Vinod Kumar Kapa 0 Reputation points
commented 2024-04-25T20:50:34.62+00:00
Vinod Kumar Kapa 0 Reputation points
1 answer

How to allow access for Azure Synapse pipeline to connect to logic app which has public access disabled with Vnet, NSG and user defined route configuration enabled

Hi, I need to call logic app through web activity from a synapse pipeline, get the error as "The web app you have attempted to reach has blocked your access". The synapse workspace has managed virtual network configured and the logic app has…

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,841 questions
Azure Virtual Network
Azure Virtual Network
An Azure networking service that is used to provision private networks and optionally to connect to on-premises datacenters.
2,140 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-03-26T14:01:38.6733333+00:00
Nandini S (Nokia) 20 Reputation points
commented 2024-04-25T20:20:45.9266667+00:00
Emmanuel Kouadio-Kossonou 0 Reputation points
1 answer

How to translate database content with Azure Translator by ADF or Synapse notebook?

There is an Azure Database table. Some of columns need to be translated from one language to another into additional columns. Such as from English to Spanish, or Portuguese to English, etc. I am exploring how I can use ADF or Synapse notebook to…

Azure SQL Database
Azure Translator
Azure Translator
An Azure service to easily conduct machine translation with a simple REST API call.
340 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,533 questions
asked 2024-04-22T15:17:46.4133333+00:00
Dataholic 80 Reputation points
commented 2024-04-25T19:09:15.17+00:00
Dataholic 80 Reputation points
0 answers

SAP CDC and SAP Tables connectors regarding SAP Note 3255746 ?

Dear Team, Is there any one who when through the SAP Note 3255746 ? What impact shroud we expect regarding the SAP CDC and SAP Tables connectors already implemented for our customers? Thanks for you input. Tarik

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,533 questions
asked 2024-04-23T11:45:42.5766667+00:00
Tarik Zaaboul 0 Reputation points
commented 2024-04-25T17:35:52.56+00:00
BhargavaGunnam-MSFT 26,136 Reputation points Microsoft Employee
1 answer

Is the 'tzoffset' function no longer compatible within Synapse?

Up until last night, executing the below script worked within our Synapse instance. However, since last night when I attempt execute the below script I receive the error message underneath. Is the 'tzoffset' function no longer compatible within…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-17T14:25:00.3+00:00
Anon101 51 Reputation points
answered 2024-04-25T15:41:30.93+00:00
BhargavaGunnam-MSFT 26,136 Reputation points Microsoft Employee
0 answers

Writing binary data to ADLS in Synapse notebook

Hi all, Is it possible to write binary data to the ADLS in Synapse notebook using Pyspark? I retrieve data via an API call where the content type is application/excel (basically binary data) and want to save it to the ADLS, a specific location like…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-18T19:40:19.28+00:00
Ljubo Jurkovic 41 Reputation points
commented 2024-04-25T14:24:42.44+00:00
Ljubo Jurkovic 41 Reputation points
0 answers

Reducing Data Scanning Overhead in Delta Format in Azure Synapse Analytics SQL Pool

We've established a serverless SQL pool with a hierarchical folder structure partition and employed open row set to reduce data scanning when executing queries on Parquet file format from the serverless SQL pool. Now, as we endeavor to utilize the delta…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-23T20:04:03.4333333+00:00
Vinod Kumar Kapa 0 Reputation points
commented 2024-04-25T12:55:15.8733333+00:00
Vinod Kumar Kapa 0 Reputation points
1 answer

Integration

Can you provide detailed information on the factors that should be considered for hybrid cloud integration between an on-premises private cloud and Azure, with a focus on scalability, performance, and security?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-25T11:45:02.4+00:00
Anonymous 0 Reputation points
answered 2024-04-25T12:03:54.08+00:00
Harishga 3,260 Reputation points Microsoft Vendor
2 answers

How can I scan views from the same Azure Synapse Analytics schema to multiple collections?

I have multiple collections in Microsoft Purview. I have registered an Azure Synapse Analytics source to a parent collection. Depending on the ownership of the datasets I need to scan in views from the same schema to different collections. When I scan…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
931 questions
asked 2024-04-17T16:10:58.4633333+00:00
HR 0 Reputation points
commented 2024-04-25T10:34:39.1933333+00:00
HR 0 Reputation points
0 answers

How to save spark dataframe (with synaps) in data container (without making folder and SUCCES file)

I want to save a spark dataframe to my data container. It worked with this code: df.write.csv(path_name + "test5.csv") However, this makes a folder called test5.csv with 2 files in it. One which is my dataframe (but with a random generated…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-25T08:31:33.9933333+00:00
Vivian Nguyen 20 Reputation points
commented 2024-04-25T08:32:32.3033333+00:00
Vivian Nguyen 20 Reputation points
1 answer

Changing the time zone for a Synapse dedicated SQL pool

Hi, inside a Synapse dedicated SQL pool I need to use the GETDATE() T-SQL function for some queries, but it returns a time minor of two hours respect to the Italian time. This is the datetime returned by the GETDATE() using SSMS: The real time is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-24T12:41:21.9433333+00:00
pmscorca 792 Reputation points
commented 2024-04-25T08:04:53.2566667+00:00
phemanth 5,730 Reputation points Microsoft Vendor
1 answer

How to enable writing for SH-IR via ADF Pipeliens

Hello community, I am facing an interesting problem when trying to write to a file share (on-prem) from a storage account via Self Hosted Integration Runtime (SHIR). Details: Rights on the share level are granted to the user and reading from the file…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2023-12-15T11:01:02.0433333+00:00
SKN 0 Reputation points
answered 2024-04-25T07:46:01.67+00:00
Adrian Kohler 0 Reputation points
0 answers

In ADF, I am not able to merge data from multiple streams with different columns with different data types

Hello, I am not able to merge data from multiple streams in ADF DATAFLOWS. Stream 1) flow let - only 1 column. Stream 2) flow let - only 1 column. Stream 3) source columns (54 columns) Stream 4) regular…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,533 questions
asked 2024-04-24T16:32:40.4033333+00:00
neeraj aitha 0 Reputation points
edited a comment 2024-04-25T07:44:31.9833333+00:00
phemanth 5,730 Reputation points Microsoft Vendor
1 answer

Cannot edit an existing data factory in synapse

I have a synapse workspace with several pipelines with data factories. Today I have noticed that existing data factories that are running correctly I cannot see the details when I edit them I attach two examples, one that is working and the other that I…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,533 questions
asked 2024-04-22T13:25:21.7566667+00:00
Emilio Salas Roura 25 Reputation points
commented 2024-04-25T06:09:04.18+00:00
Smaran Thoomu 9,525 Reputation points Microsoft Vendor
1 answer

Troubleshooting CSV file operations in Synapse Spark with R script

I'm encountering an issue I can't solve on my own. I'm running an R script in Synapse Spark, and I want to save the results of that script into a CSV file in Azure Data Lake Storage (ADLS). I've attempted to read a CSV file and then write it back into a…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-22T04:03:43.9866667+00:00
Pravalika-randstad 240 Reputation points
commented 2024-04-25T05:43:53.56+00:00
PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
1 answer

Access Azure SQL DBs using Azure Synapse studio

I would like to understand how Azure Synapse Analytics can be used within the organization to facilitate data analysis and development. How will developers access Azure Datasets in a convenient way Is there a case for using Azure Synapse? I have a use…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
asked 2024-04-22T08:25:56.1866667+00:00
Santhi Dhanuskodi 145 Reputation points
commented 2024-04-25T05:42:09.29+00:00
PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
0 answers

Insufficient memory when running script/stored procedure activity using synapse

So serverless sql have a limit memory of data processed? I got the error message like this: Operation on target Stored procedure1 failed: Execution fail against sql server. Please contact SQL Server team if you need further support. Sql error number:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,533 questions
asked 2024-04-23T08:36:35.47+00:00
Jovian Aditya Wiranata 0 Reputation points
commented 2024-04-25T05:38:20.34+00:00
PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
0 answers

Join cosmos DB when processing streaming data from eventhub in Synapse

Hi Team, Good morning! Would like to check that when we using spark notebook in Synapse to process Eventhub streaming data, we join the streaming data from Eventhub with CosmosDB data. We try both way of connecting CosmosDB transcational store with OLTP,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,441 questions
asked 2024-04-24T17:24:07.47+00:00
Jiacheng Zhang 20 Reputation points
commented 2024-04-25T05:32:37.0333333+00:00
Smaran Thoomu 9,525 Reputation points Microsoft Vendor
1 answer

Synapse Python/Spark Notebook code with SQL to query data from linked service to SQL Server

In Synpase, I have linked service to a SQL Server database. I'm looking for a sample notebook code, either in python or spark, that I can run a complex SQL qery within this code to get data from multiple SQL Server tables, put the rsults in a dataframe…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
12,706 questions
asked 2024-04-24T13:45:40.7233333+00:00
ylycfj88 0 Reputation points
answered 2024-04-25T05:15:43.54+00:00
Smaran Thoomu 9,525 Reputation points Microsoft Vendor
2 answers

How to test a synapse link service from a powershell script?

How to test a synapse link service from a powershell script?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,365 questions
PowerShell
PowerShell
A family of Microsoft task automation and configuration management frameworks consisting of a command-line shell and associated scripting language.
2,052 questions
asked 2024-04-18T19:05:59.8166667+00:00
Jean-Francois Roger ADM 0 Reputation points
answered 2024-04-24T23:16:14.6566667+00:00
Jean-Francois Roger ADM 0 Reputation points