How to Change Apache Hadoop MapReduce memory settings in HDInsight R Server cluster?
[Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question]
Sourced from Docs - Azure HDInsight R Server
Welcome to the Microsoft Q&A platform.
Happy to answer your questions.
To Change Apache Hadoop MapReduce memory settings:
Available memory to ML Services can be modified when it's running a MapReduce job. To modify a cluster, use the Apache Ambari UI for your cluster. For Ambari UI instructions, see Manage HDInsight clusters using the Ambari Web UI.
Available memory to ML Services can be changed by using Hadoop switches in the call to RxHadoopMR:
hadoopSwitches = "-libjars /etc/hadoop/conf -Dmapred.job.map.memory.mb=6656"
Reference: Azure HDinsight – R Server Overview
Hope this helps.
Sourced from Docs - Azure HDInsight R Server
3 people are following this question.
