question

ImranMondal-3977 avatar image
0 Votes"
ImranMondal-3977 asked KD-6513 answered

Impala Table alternative on Azure

Hi Team,

I have a one-premise data pipeline, where we have cleaned data stored, On top of it we are creating IMPALA tables that connect to the tableau server so that when end-users change any filters or request any data from a table, Impala table can quickly go and fetch the data.

We planing on migrating this system to Azure, So I was what is the alternative tool I can use in Azure, which will give me the same flexibility as Impala. Please suggest

azure-synapse-analyticsazure-data-lake-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered PRADEEPCHEEKATLA-MSFT commented

Hello @ImranMondal-3977,

Thanks for the ask and using the Microsoft Q&A platform

Azure HDInsight - Interactive Query (Apache Hive with LLAP) is the closest alternative for Impala on Azure.

What is Interactive Query In Azure HDInsight?

Interactive Query (also called Apache Hive LLAP, or Low Latency Analytical Processing) is an Azure HDInsight cluster type. Interactive Query supports in-memory caching, which makes Apache Hive queries faster and much more interactive. Customers use Interactive Query to query data stored in Azure storage & Azure Data Lake Storage in super-fast manner. Interactive query makes it easy for developers and data scientist to work with the big data using BI tools they love the most. HDInsight Interactive Query supports several tools to access big data in easy fashion.

For migration, you can checkout this article: Migrate on-premises Apache Hadoop clusters to Azure HDInsight - motivation and benefits

Hope this helps. Do let us know if you any further queries.


Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@PRADEEPCHEEKATLA-MSFT basically I want a in-memory database for my dashboard, is there any other service available on azure , that I can use??

0 Votes 0 ·

Hello @ImranMondal-3977,

For in-memory processing you can use Azure HDInsight Interactive Query or Spark clusters.

Azure HDInsight currently provides the following cluster types, each with a set of components to provide certain functionalities.

88175-image.png

Other than Azure HDInsight we have Azure Databricks and Azure Synapse Analytics .

Hope this helps. Do let us know if you any further queries.


0 Votes 0 ·
image.png (24.4 KiB)

Hello @ImranMondal-3977,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·
KD-6513 avatar image
0 Votes"
KD-6513 answered

You can use CDW experience in Cloudera Data Platform on Azure and choose Impala Virtual Warehouse. You will not have to re-write the queries and save time on migration.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.