Automatically delete HDInsight cluster after period of inactivity

Question

Hi,
I have created an Azure template for creating HDInsight cluster.
I would like to be able to set an option to delete the cluster after a period of inactivity. Ideally, I could set up this parameter during the creation and after (let's say) an hour of inactivity the cluster would be automatically deleted to save on costs.
Other acceptable solutions would be to have an email sent to the user who created the account that the cluster has been inactive (or running for a predefined period of time) reminding them to delete it.

I know that Azure Data Factory can create a cluster and set the time for it to be active, but I'd like to utilize the template I already created and I'd like to retain the full control of the cluster once created (access to Jupyter, Ambari, etc.)

Thanks

Answer 1

Hi @suba1987 ,

Welcome to the Microsoft Q&A platform.

Unfortunately, you cannot delete Azure HDInsight cluster after a period of inactivity.

I would suggest you to vote up an idea submitted by another Azure customer.

https://feedback.azure.com/forums/217335-hdinsight/suggestions/5663773-start-stop-cluster-hdinsight

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.

Currently, if you want to delete the cluster after a period of inactivity, you need to use create on-demand Apache Hadoop clusters in HDInsight using Azure Data Factory.

Hope this helps. Do let us know if you any further queries.

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.