IDEA: Notebook-scoped Python libraries and Search Engine for the libraries (indexing at leat PyPI and Maven Central)

ReiselGonzalezPerez-3086 1 Reputation point
2021-08-28T15:09:20.07+00:00

Despite Azure Synapse is not looking to be a replacement for Azure Databricks, IMHO there are really nice features that can be useful for the Spark Pool notebooks and the libraries installation into the Clusters.

Notebook-scoped Python libraries and a "visual" search engine for the libraries (indexing at leat PyPI and Maven Central) should be more efective and productive than generating and uploading a requirements file to install new dependencies.

Best regards.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,402 questions
{count} votes