Azure Data Bricks and Azure Synapse Spark Pool

Question

Hi Guys,

For the newcomers who would like to use a spark on Azure, we need a clear article describing the differences between Azure Data Bricks and Azure Synapse Spark Pool.

Thank you

Answer 1

Hello @Yahor Sinkevich ,

Thanks for the feedback.

Currently, we are working with the content team to publish an article which describing the differences between Azure Databricks and Azure Synapse Spark Pool. I will update you once it is available.

Meanwhile you can checkout third party article which describes When to use Azure Synapse Analytics and/or Azure Databricks.

Hope this helps. Do let us know if you any further queries.

------------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Hi @Yahor Sinkevich

Azure Databricks is a data analytics platform optimized for the Microsoft Azure cloud services platform. Azure Databricks offers two environments for developing data intensive applications: Azure Databricks SQL Analytics and Azure Databricks Workspace.
https://learn.microsoft.com/en-us/azure/databricks/scenarios/what-is-azure-databricks
Get started with Azure Databricks SQL Analytics
https://learn.microsoft.com/en-us/azure/databricks/sql/get-started/

Run a Spark job on Azure Databricks Workspace using the Azure portal
https://learn.microsoft.com/en-us/azure/databricks/scenarios/quickstart-create-databricks-workspace-portal?tabs=azure-portal

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale.
Creating a Synapse workspace
https://learn.microsoft.com/en-us/azure/synapse-analytics/get-started-create-workspace

Apache Spark is a parallel processing framework that supports in-memory processing to boost the performance of big-data analytic applications. Apache Spark in Azure Synapse Analytics is one of Microsoft's implementations of Apache Spark in the cloud. Azure Synapse makes it easy to create and configure a serverless Apache Spark pool in Azure. Spark pools in Azure Synapse are compatible with Azure Storage and Azure Data Lake Generation 2 Storage.
Create a new serverless Apache Spark pool using the Azure portal
https://learn.microsoft.com/en-us/azure/synapse-analytics/quickstart-create-apache-spark-pool-portal

If the Answer is helpful, please click Accept Answer and up-vote, this can be beneficial to other community members.