Share via

Error in getCluster(clusterName = "myPoolName") : Code: AccountCoreQuotaReached - Message: The specified account has reached core quota Code: AccountLowPriorityCoreQuotaReached - Message: The specified account has reached low priority core quota

Mathew Fok 0 Reputation points
2024-05-06T03:29:15.14+00:00

In R programming, I am trying doAzureParallel for the first time and I encountered this cluster quota error:

Error in getCluster(clusterName = "myPoolName") : Code: AccountCoreQuotaReached - Message: The specified account has reached core quota Code: AccountLowPriorityCoreQuotaReached - Message: The specified account has reached low priority core quota

I followed this: made my .JSON..

I see nothing when I go to my subcriptions =>quota

When I first logged in to Portal I got token error idk what that means, I just skipped it.

I do not see this issue posted on the GitHub.

I made a fresh new account today new email. My Resource, Batch, and Source Name are happybones1234

I did not understand this part on here:

I could not get the Delete Resource part after the Azure Active Directory Authentication Part of the tutorial to work so I skipped it.

For Azure Active Directory Authentication:

"servicePrincipal": {
    "tenantId": "<AAD Diretory ID>",
    "clientId": "<AAD App Application ID>",
    "credential": "<AAD App Password>",
    "batchAccountResourceId": "</batch/account/resource/id>",
    "storageAccountResourceId": "</storage/account/resource/id>",
    "storageEndpointSuffix": "</storage/account/endpoint/suffix>"
}

# install the package devtools
install.packages("devtools")
# install the doAzureParallel and rAzureBatch package
devtools::install_github("Azure/rAzureBatch")
devtools::install_github("MatHatter/doAzureParallel")
library(doAzureParallel)
generateClusterConfig("cluster.json")
generateCredentialsConfig("credentials.json")
setCredentials("credentials.json")
cluster <- makeCluster("cluster.json")
registerDoAzureParallel(cluster)
getCluster(clusterName = "myPoolName")

###################################################################################
HERE IS MY OUTPUT
###################################################################################

> install.packages("devtools")
Installing package into ‘C:/Users/wfky1/AppData/Local/R/win-library/4.2’
(as ‘lib’ is unspecified)
trying URL 'https://cran.rstudio.com/bin/windows/contrib/4.2/devtools_2.4.5.zip'
Content type 'application/zip' length 436380 bytes (426 KB)
downloaded 426 KB

package ‘devtools’ successfully unpacked and MD5 sums checked

The downloaded binary packages are in
	C:\Users\wfky1\AppData\Local\Temp\RtmpCaRGvN\downloaded_packages
> 
> # install the doAzureParallel and rAzureBatch package
> devtools::install_github("Azure/rAzureBatch")
Downloading GitHub repo Azure/rAzureBatch@HEAD
These packages have more recent versions available.
It is recommended to update all of them.
Which would you like to update?

1: All                               
2: CRAN packages only                
3: None                              
4: jsonlite (1.8.4  -> 1.8.8 ) [CRAN]
5: curl     (5.0.0  -> 5.2.1 ) [CRAN]
6: digest   (0.6.31 -> 0.6.35) [CRAN]

Enter one or more numbers, or an empty line to skip updates: devtools::install_github("Azure/doAzureParallel")
Enter one or more numbers, or an empty line to skip updates: 
── R CMD build ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
✔  checking for file 'C:\Users\wfky1\AppData\Local\Temp\RtmpCaRGvN\remotes7ab81a172073\Azure-rAzureBatch-ddbc612/DESCRIPTION' (362ms)
─  preparing 'rAzureBatch':
✔  checking DESCRIPTION meta-information ...
─  checking for LF line-endings in source and make files and shell scripts
─  checking for empty or unneeded directories
   Omitted 'LazyData' from DESCRIPTION
─  building 'rAzureBatch_0.7.0.tar.gz'
   
Installing package into ‘C:/Users/wfky1/AppData/Local/R/win-library/4.2’
(as ‘lib’ is unspecified)
* installing *source* package 'rAzureBatch' ...
** using staged installation
** R
** byte-compile and prepare package for lazy loading
** help
No man pages found in package  'rAzureBatch' 
*** installing help indices
** building package indices
** testing if installed package can be loaded from temporary location
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* DONE (rAzureBatch)
> library(doAzureParallel)
> generateClusterConfig("cluster.json")
> generateCredentialsConfig("credentials.json")
> 
> setCredentials("credentials.json")
======================================================================================================================================
Batch Account: happybones1234
Batch Account Url: https://happybones1234.westus2.batch.azure.com
Storage Account: happybones1234
Storage Account Url: https://happybones1234.blob.core.windows.net
======================================================================================================================================
Your credentials have been successfully set.
> 
> cluster <- makeCluster("cluster.json")
======================================================================================================================================
Name: myPoolName
Configuration:
	Docker Image: rocker/tidyverse:latest
	MaxTasksPerNode: 1
	Node Size: Standard_D2_v2
Scale:
	Autoscale Formula: QUEUE
	Dedicated:
		Min: 3
		Max: 3
	Low Priority:
		Min: 3
		Max: 3
======================================================================================================================================
The specified cluster 'myPoolName' already exists. Cluster 'myPoolName' will be used.
Your cluster has been registered.
Dedicated Node Count: 3
Low Priority Node Count: 3
Warning message:
In self$client$extractAzureResponse(response, content) :
  Conflict (HTTP 409).
> 
> registerDoAzureParallel(cluster)
> 
> getCluster(clusterName = "myPoolName")

Error in getCluster(clusterName = "myPoolName") : 
  Code: AccountCoreQuotaReached - Message: The specified account has reached core quota 
Code: AccountLowPriorityCoreQuotaReached - Message: The specified account has reached low priority core quota 
> getDoParWorkers()
[1] 0
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
309 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. deherman-MSFT 34,026 Reputation points Microsoft Employee
    2024-05-06T20:53:27.3033333+00:00

    @Mathew Fok

    From the error message it sounds like you reached two limits for Azure Batch. Both Low-priority cores per Batch account and the total core quota limit. You can submit an increase request to Azure Support.

    Hope this helps! Let me know if you still have issues or need further assistance.

    If you still have questions, please let us know in the "comments" and we would be happy to help you. Comment is the fastest way of notifying the experts.

    If the answer has been helpful, we appreciate hearing from you and would love to help others who may have the same question. Accepting answers helps increase visibility of this question for other members of the Microsoft Q&A community.

    Thank you for helping to improve Microsoft Q&A!

    User's image

    0 comments