August 2019

These features and Azure Databricks platform improvements were released in August 2019.

Note

Releases are staged. Your Azure Databricks account may not be updated until up to a week after the initial release date.

New region: UAE North

Aug 27, 2019

Azure Databricks is now available in UAE North (Dubai).

Workspace library installation enhancement

Aug 27 - Sept 3, 2019: Version 3.1

Admins can now install a library on all clusters from a cluster’s Libraries tab.

no-alternative-text

For details, see Workspace library.

Clusters UI now reflects more consistent interactive and automated cluster terminology

Aug 27 - Sept 3, 2019: Version 3.1

To clarify which type of cluster (automated or interactive) you are using for a job, the Clusters list and job Configure Cluster UI have been updated.

In the Clusters list, the Job Clusters sublist has been renamed to Automated Clusters to reflect that a cluster created for a job is charged at the automated rate.

no-alternative-text

When you configure a cluster for a job, the Cluster Type menu option New Cluster has been renamed to New Automated Cluster and Existing Cluster has been renamed to Existing Interactive Cluster. These changes reflect the fact that if you choose a new cluster it is charged at the automated rate, and if you choose an existing cluster it is charged at the interactive rate.

no-alternative-text

Databricks Runtime 5.5 and Databricks Runtime 5.5 ML are LTS

Aug 27, 2019

Databricks Runtime 5.5 and Databricks Runtime 5.5 ML have been identified as long term support (LTS) runtimes. Azure Databricks provide two full years of support for LTS runtimes. For details, see Databricks Runtime Release Notes.

Instance allocation notifications for pools

Aug 13 - 20, 2019: Version 2.104

You are now informed if a pool fails to allocate the minimum number of idle instances. The pool details and statistics page displays an error message stating the number of failed instances. You can click the error message to view details about each pending instance failure.

New cluster events

Aug 13 - 20, 2019: Version 2.104

Cluster events are now generated whenever a cluster is pinned or unpinned.

See ClusterEventType.

MLflow updates

Aug 13 - 20, 2019: Version 2.104

The Runs sidebar in notebooks now supports sorting the runs by metric or parameter.

MLflow 1.2 was released on Aug 12, 2019. For details, see the MLflow 1.2 Changelog.