Open Source Big Data applications that work with Azure Data Lake Storage Gen1

Note

Azure Data Lake Storage Gen2 is now generally available. We recommend that you start using it today. For more information, see the product page.

This article lists the open source big data applications that work with Azure Data Lake Storage Gen1. For the applications in the table below, only the versions available with the listed distribution are supported. For information on what versions of these applications are available with HDInsight, see HDInsight component versioning.

Open Source Software Distribution
Apache Sqoop HDInsight 3.2, 3.4, 3.5, and 3.6
MapReduce HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Storm HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Hive HDInsight 3.2, 3.4, 3.5, and 3.6
HCatalog HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Mahout HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Pig/Pig Latin HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Oozie HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Zookeeper HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Tez HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Spark HDInsight 3.4, 3.5, and 3.6

See also