question

YahorSinkevich avatar image
0 Votes"
YahorSinkevich asked aj20106 commented

Azure Data Bricks and Azure Synapse Spark Pool

Hi Guys,

For the newcomers who would like to use a spark on Azure, we need a clear article describing the differences between Azure Data Bricks and Azure Synapse Spark Pool.

Thank you

azure-synapse-analyticsazure-databricks
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered aj20106 commented

Hello @YahorSinkevich,

Thanks for the feedback.

Currently, we are working with the content team to publish an article which describing the differences between Azure Databricks and Azure Synapse Spark Pool. I will update you once it is available.

Meanwhile you can checkout third party article which describes When to use Azure Synapse Analytics and/or Azure Databricks.

Hope this helps. Do let us know if you any further queries.


Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Is the documentation for differences published yet?

1 Vote 1 ·

Could you please do the same for the Azure SQL and Synapse Dedicated SQL Pool.
Some differences are obvious, but many are not.

0 Votes 0 ·

And same for the Azure Data Factory vs Synapse

0 Votes 0 ·
learn2skills avatar image
1 Vote"
learn2skills answered

Hi @YahorSinkevich

Azure Databricks is a data analytics platform optimized for the Microsoft Azure cloud services platform. Azure Databricks offers two environments for developing data intensive applications: Azure Databricks SQL Analytics and Azure Databricks Workspace.
https://docs.microsoft.com/en-us/azure/databricks/scenarios/what-is-azure-databricks
Get started with Azure Databricks SQL Analytics
https://docs.microsoft.com/en-us/azure/databricks/sql/get-started/

Run a Spark job on Azure Databricks Workspace using the Azure portal
https://docs.microsoft.com/en-us/azure/databricks/scenarios/quickstart-create-databricks-workspace-portal?tabs=azure-portal

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale.
Creating a Synapse workspace
https://docs.microsoft.com/en-us/azure/synapse-analytics/get-started-create-workspace

Apache Spark is a parallel processing framework that supports in-memory processing to boost the performance of big-data analytic applications. Apache Spark in Azure Synapse Analytics is one of Microsoft's implementations of Apache Spark in the cloud. Azure Synapse makes it easy to create and configure a serverless Apache Spark pool in Azure. Spark pools in Azure Synapse are compatible with Azure Storage and Azure Data Lake Generation 2 Storage.
Create a new serverless Apache Spark pool using the Azure portal
https://docs.microsoft.com/en-us/azure/synapse-analytics/quickstart-create-apache-spark-pool-portal



If the Answer is helpful, please click Accept Answer and up-vote, this can be beneficial to other community members.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.