Databricks Runtime Version String for REST API Calls

The structure of a Databricks runtime version string in the REST API is:

Databricks Runtime:

<M>.<F>.x[-cpu][-gpu][-ml][-hls][conda]-scala<scala-version>

where

  • M - Databricks Runtime major release
  • F - Databricks Runtime feature release
  • cpu - CPU version (with -ml only)
  • gpu - GPU-enabled
  • ml - Machine learning
  • hls - Genomics
  • conda - with Conda
  • scala-version - version of Scala used to compile Spark: 2.10 or 2.11

For example, 3.5.x-scala2.10 and 4.1.x-gpu-scala2.11. The Databricks runtime support schedule and End-of-support history tables map Databricks Runtime versions to the Spark version contained in the runtime.

Databricks Light:

apache-spark.<M>.<F>.x-scala<scala-version>

where

  • M - Apache Spark major release
  • F - Apache Spark feature release
  • scala-version - version of Scala used to compile Spark: 2.10 or 2.11

For example, apache-spark-2.4.x-scala2.11.