question

Eric-4026 avatar image
0 Votes"
Eric-4026 asked Eric-4026 commented

How long is it supposed to take an Azure batch node to start running a task?

I'm trying to run an R script in paralell on azure batch. The script uses the xgboost package and pulls csv files from my azure storage account. The output is a csv file back in to my azure storage account. After a node boots it literally takes hours for my tasks to go from queued to running. This happens whether I use dedicated nodes or low priority nodes. If I add .packages = c('xgboost') to my foreach function Rstudio tells me "Job Preparation Status: Package(s) being installed" and that step takes literally hours to finish even if I only have 1 node in the pool.

I understand cloud computing resources take time to boot up, but is it supposed to take hours or is there something I can do to speed it up? It takes about 20 minutes for my PC to run 1 task on it's own.

azure-batch
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@Eric-4026 Apologies for the delay in response and all the inconvenience caused because of the issue.
I have reached out to our internal team on the issue and once I have an update will keep you posted on same.

Thank you for your patience over the matter.

Thanks.

0 Votes 0 ·

1 Answer

prmanhas-MSFT avatar image
0 Votes"
prmanhas-MSFT answered Eric-4026 commented

@Eric-4026 Thank you for your patience over the matter!!!

Below is the response I got from our internal team:

It can take 2 – 6 mins for VMs to be started and in a position to run Batch tasks. It isn’t supposed to take hours.

You might be using doAzureParallel which might be the reason as well. Whether they are or aren’t, the customer should submit a support ticket so someone can help them.

I would recommend you to open Support Request with Microsoft Support Team if you have a support plan in place if not do let me know I can help you open a One Time Free Technical Support.

Hope it helps!!!

Please "Accept as Answer" if it helped so it can help others in community looking for help on similar topics.


· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I do not have a support plan that is the reason I am here. It would be great if you could open a ticket for me, as getting azure batch to work has been incredibly expensive and frustrating.

0 Votes 0 ·