4,505 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Updating Oracle on-premise table from a Synapse table

Hi, I need to update an Oracle on-premise table from a Synapse table by joining the Oracle table with the Synapse table avoiding to build a staging table on Oracle platform to copy the Synapse data. It is a problem to obtain the authorization from my…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,806 questions
asked 2024-06-01T12:00:58.09+00:00
pmscorca 837 Reputation points
commented 2024-06-03T09:26:51.3466667+00:00
Smaran Thoomu 11,045 Reputation points Microsoft Vendor
0 answers

We are not getting data in azure data lake Service v2 storage's container.

Hello, We are getting data in the Azure event hub sink through the POSTGRES SQL database but we are not getting files in the container which we have configured in an ADLS GEN 2 and while configuring we have an encounter that we are using a free…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
573 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-30T07:02:45.27+00:00
DNT 0 Reputation points
commented 2024-06-03T08:59:14.3633333+00:00
PRADEEPCHEEKATLA-MSFT 80,491 Reputation points Microsoft Employee
1 answer

How can i integrate hubspot rest api linked service in azure synapse.

When i directly integrated husbpot it's not giving me all the data. But when i try to link that with rest api my test connection is failied. I checked the hubspot api endpoint and from postman i can see all the data tables i want but it is not working in…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-30T00:12:02.02+00:00
Abhishek Singh 5 Reputation points
commented 2024-06-03T08:49:04.06+00:00
PRADEEPCHEEKATLA-MSFT 80,491 Reputation points Microsoft Employee
1 answer

How to reset password for Azure synapse dedicated SQL Pool "when Reset SQL Admin password" is disabled?

Hello, When I'm creating a linked service to fetch the data from Dedicated SQL Pool within the Azure Synapse Analytics workspace, it ask for the SQL authentication. Since I hadn't created the username and password at that time, I want to create or reset…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-24T08:15:33.2033333+00:00
Apurva Tiwari 0 Reputation points
commented 2024-06-03T06:59:21.0433333+00:00
PRADEEPCHEEKATLA-MSFT 80,491 Reputation points Microsoft Employee
2 answers

Seeking Expertise in Spark SQL CTE Recursive Queries in Azure Databricks

I'm currently diving deep into Spark SQL and its capabilities, and I'm facing an interesting challenge. I'm eager to learn how to write CTE recursive queries in Spark SQL, but after thorough research, it seems that Spark doesn't natively support…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,985 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
12,953 questions
asked 2024-05-30T04:27:35.4+00:00
Anuj, Singh (Cognizant) 50 Reputation points
commented 2024-06-03T05:47:31.3133333+00:00
Smaran Thoomu 11,045 Reputation points Microsoft Vendor
1 answer

How to ignore the records by applying an auditing filed column condition using ADF Data Flows

Hi All I am building a data transamination using mapping data flows ,I have a time stamp field Like TimeStampUpdated in the target table. I want to lockup historical data with incremental data transamination and ignore the records coming in the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,985 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,806 questions
asked 2024-05-30T09:28:46.6066667+00:00
venkat rao 45 Reputation points
commented 2024-06-03T05:46:23.9533333+00:00
Smaran Thoomu 11,045 Reputation points Microsoft Vendor
1 answer

azure synapse RBAC not working

I have just created a synapse analytics workspace, on opening it I get an error message similar to the below. From my research, I have gr anted storage blob contributor role to the synapse application as well as the user assigned managed identity. Going…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-30T22:05:59.0533333+00:00
MrFlinstone 501 Reputation points
commented 2024-06-03T05:42:23.3633333+00:00
MrFlinstone 501 Reputation points
0 answers

Using SMI in Synapse Spark Job

Hello We have Synapse Pipeline with Spark Job Definition We currently use SPN to read data from ADLS2 and also to write to kusto with Spark Kusto Connector (Getting a token from SPN) We have saved SPN credentials into AKV. We have urgent requirement to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-29T14:30:25.29+00:00
Jean-Christian Kouamé 0 Reputation points Microsoft Employee
commented 2024-06-03T05:38:05.2333333+00:00
phemanth 6,885 Reputation points Microsoft Vendor
0 answers

source files problem from internal server to Gen2 container

Hello, I am trying to connect my interal files system to the gen2 container sink, following this instructions https://arulmouzhi.wordpress.com/2021/04/12/bringing-folder-structure-via-azure-data-factory/ The first one in Allfiles set, I can load…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-31T14:16:49.5966667+00:00
Nick Wong 170 Reputation points
commented 2024-06-03T05:24:24.5466667+00:00
phemanth 6,885 Reputation points Microsoft Vendor
1 answer

Azure Synapse Analytics

Hi, I have a question. Can I access the Database on SQL Database pane from apache sp

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-06-01T16:55:42.2033333+00:00
Pedro The Admin 0 Reputation points
edited the question 2024-06-03T03:54:25.6566667+00:00
OMMI NAVEEN KUMAR 195 Reputation points Microsoft Vendor
0 answers

Issue with Copy Dataverse data into Azure SQL using Synapse Link Template

I am experiencing issues using ADF I am trying to use the template "Copy Dataverse data into Azure SQL using Synapse Link" to move f&o data from datalake to Azure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,806 questions
asked 2024-05-30T07:08:10.6766667+00:00
Dipo Onibile 0 Reputation points
commented 2024-06-03T03:43:19.0666667+00:00
phemanth 6,885 Reputation points Microsoft Vendor
0 answers

ADF Data Flows Flatten nested json array values are being populated as null

Hi All I am building a data transamination with ADF data flow using a nested json array of objects , but after parse and flatten the json node itOffer.item.LeadOfer.zdeal.item[].dealNumber I am seeing that the column values are populated as null . I…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,985 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,806 questions
asked 2024-05-30T11:06:56.13+00:00
venkat rao 45 Reputation points
commented 2024-06-03T02:50:28.12+00:00
Harishga 4,485 Reputation points Microsoft Vendor
1 answer

how can i solve for this error HTTP header that's mandatory for this request is not specified.", 400 in azure synapse pyspark

hey guys how can solve for this error i am using synapse to read data from a blob with Hierarchical namespace Enabled but when i try to write back i get : Operation failed: "An HTTP header that's mandatory for this request is not specified.",…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-06-02T12:19:09.5866667+00:00
Adika Stadevant Okelo 0 Reputation points
answered 2024-06-02T13:25:06.97+00:00
Vinodh247-1375 11,726 Reputation points
1 answer

Failed to convert the value in 'xxxx' property to 'System.String' type in Data Lake Connector

Environment: Azure Synapse I am developing a pipeline that has a lookup to SQL that is passing the values to GetMetaData. When using @dataset.name of parameter in the dataset, it fails with "Failed to convert the value in name of parameter…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,806 questions
asked 2024-05-31T19:42:29.6733333+00:00
Doreen Cecil 0 Reputation points
answered 2024-06-01T09:09:28.1+00:00
Amira Bedhiafi 17,201 Reputation points
1 answer

How to flatten dynamic Json in ADF/Synapse

I have a issue where I have dynamic json and enabled schema drift in my source, To flatten the json I am coding it as array(byName('Columnname')) in unroll by dynamic content section. Here columnname is the array which need to be unrolled. I am getting…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,806 questions
asked 2021-10-02T02:06:35.697+00:00
Rashmi Shetty 6 Reputation points
commented 2024-06-01T05:24:48.3433333+00:00
Harman Brar 0 Reputation points
1 answer

From Synapse notebook, trouble connecting to Azure SQL using system managed identity

I can create a Linked Service to my Database using my Synapse system-managed identity. This works fine, and the "test connection" shows success. But for the life of me, I can't figure out how to do it in a Python notebook. Here is the…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-27T22:33:03.2733333+00:00
Rhonda S 6 Reputation points Microsoft Employee
edited a comment 2024-05-31T18:15:43.0666667+00:00
Rhonda S 6 Reputation points Microsoft Employee
2 answers

Assert error output not writing to blob

Hello. I have built a pipeline which gathers data from a .csv file and then goes through a couple of assert activities to check the validity of the data. Valid rows are supposed to be input into the table, while assert-failure rows are setup to be…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,380 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-28T10:17:13.85+00:00
Dejvis Leka 0 Reputation points
commented 2024-05-31T16:18:50.0033333+00:00
BhargavaGunnam-MSFT 27,976 Reputation points Microsoft Employee
1 answer

CI/CD Powershell Azure Synapse Workspace with Azure Devops

I am working on CI/CD between Azure Synapse Workspace with Azure Devops.  I have source code from someone else who work on this project before and it works well and I try to understand it and create my own project on it. right now, I have issues of the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-28T10:04:13.9833333+00:00
Zhuoqiong Mo 20 Reputation points
commented 2024-05-31T15:52:34.93+00:00
BhargavaGunnam-MSFT 27,976 Reputation points Microsoft Employee
0 answers

Error publishing notebook.

I am trying to publish my notebook. I get the following error : CreateOrUpdateNotebook failed: BadRequest. The operation failed because the entity “notebookA” is being renamed to “notebookB”. A retry of rename from exact source to target may work”. It…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
asked 2024-05-30T17:31:34.6033333+00:00
Candy T 0 Reputation points
edited a comment 2024-05-31T15:47:45.9433333+00:00
BhargavaGunnam-MSFT 27,976 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

How can I find help validating a certificate?

Indeed, I am a student in cloud computing in Morocco and I do not have enough means to obtain the AZ 900 certification and my family also does not have enough financial means. Could someone help me validate this certificate please?

Azure SQL Database
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,380 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,505 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,478 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,806 questions
asked 2024-05-30T15:54:26.2366667+00:00
HAMIDOU YOUSSOUF 20 Reputation points
accepted 2024-05-31T14:55:42.77+00:00
HAMIDOU YOUSSOUF 20 Reputation points