Hi Guys,
For the newcomers who would like to use a spark on Azure, we need a clear article describing the differences between Azure Data Bricks and Azure Synapse Spark Pool.
Thank you
Hello @YahorSinkevich,
Thanks for the feedback.
Currently, we are working with the content team to publish an article which describing the differences between Azure Databricks and Azure Synapse Spark Pool. I will update you once it is available.
Meanwhile you can checkout third party article which describes When to use Azure Synapse Analytics and/or Azure Databricks.
Hope this helps. Do let us know if you any further queries.
Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.
Could you please do the same for the Azure SQL and Synapse Dedicated SQL Pool.
Some differences are obvious, but many are not.
Azure Databricks is a data analytics platform optimized for the Microsoft Azure cloud services platform. Azure Databricks offers two environments for developing data intensive applications: Azure Databricks SQL Analytics and Azure Databricks Workspace.
https://docs.microsoft.com/en-us/azure/databricks/scenarios/what-is-azure-databricks
Get started with Azure Databricks SQL Analytics
https://docs.microsoft.com/en-us/azure/databricks/sql/get-started/
Run a Spark job on Azure Databricks Workspace using the Azure portal
https://docs.microsoft.com/en-us/azure/databricks/scenarios/quickstart-create-databricks-workspace-portal?tabs=azure-portal
Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale.
Creating a Synapse workspace
https://docs.microsoft.com/en-us/azure/synapse-analytics/get-started-create-workspace
Apache Spark is a parallel processing framework that supports in-memory processing to boost the performance of big-data analytic applications. Apache Spark in Azure Synapse Analytics is one of Microsoft's implementations of Apache Spark in the cloud. Azure Synapse makes it easy to create and configure a serverless Apache Spark pool in Azure. Spark pools in Azure Synapse are compatible with Azure Storage and Azure Data Lake Generation 2 Storage.
Create a new serverless Apache Spark pool using the Azure portal
https://docs.microsoft.com/en-us/azure/synapse-analytics/quickstart-create-apache-spark-pool-portal
If the Answer is helpful, please click Accept Answer and up-vote, this can be beneficial to other community members.
7 people are following this question.
