(DEPRECATED) Create and mount a file share to a DC/OS cluster
Warning
The Azure Container Service (ACS) is being deprecated. No new features or functionality are being added to ACS. All of the APIs, portal experience, CLI commands and documentation are marked as deprecated.
For more information, see the Azure Container Service deprecation announcement on Azure.com.
We recommend that you deploy one of the following Azure Marketplace solutions:
- Mesosphere DC/OS
If you want to use Kubernetes, see Azure Kubernetes Service.
This tutorial details how to create a file share in Azure and mount it on each agent and master of the DC/OS cluster. Setting up a file share makes it easier to share files across your cluster such as configuration, access, logs, and more. The following tasks are completed in this tutorial:
- Create an Azure storage account
- Create a file share
- Mount the share in the DC/OS cluster
You need an ACS DC/OS cluster to complete the steps in this tutorial. If needed, this script sample can create one for you.
This tutorial requires the Azure CLI version 2.0.4 or later. Run az --version to find the version. If you need to upgrade, see Install the Azure CLI.
Use Azure Cloud Shell
Azure hosts Azure Cloud Shell, an interactive shell environment that you can use through your browser. You can use either Bash or PowerShell with Cloud Shell to work with Azure services. You can use the Cloud Shell preinstalled commands to run the code in this article without having to install anything on your local environment.
To start Azure Cloud Shell:
| Option | Example/Link |
|---|---|
| Select Try It in the upper-right corner of a code block. Selecting Try It doesn't automatically copy the code to Cloud Shell. |  |
| Go to https://shell.azure.com, or select the Launch Cloud Shell button to open Cloud Shell in your browser. |  |
| Select the Cloud Shell button on the menu bar at the upper right in the Azure portal. |  |
To run the code in this article in Azure Cloud Shell:
Start Cloud Shell.
Select the Copy button on a code block to copy the code.
Paste the code into the Cloud Shell session by selecting Ctrl+Shift+V on Windows and Linux or by selecting Cmd+Shift+V on macOS.
Select Enter to run the code.
Create a file share on Microsoft Azure
Before using an Azure file share with an ACS DC/OS cluster, the storage account and file share must be created. Run the following script to create the storage and file share. Update the parameters with those from your environment.
# Change these four parameters
DCOS_PERS_STORAGE_ACCOUNT_NAME=mystorageaccount$RANDOM
DCOS_PERS_RESOURCE_GROUP=myResourceGroup
DCOS_PERS_LOCATION=eastus
DCOS_PERS_SHARE_NAME=dcosshare
# Create the storage account with the parameters
az storage account create -n $DCOS_PERS_STORAGE_ACCOUNT_NAME -g $DCOS_PERS_RESOURCE_GROUP -l $DCOS_PERS_LOCATION --sku Standard_LRS
# Export the connection string as an environment variable, this is used when creating the Azure file share
export AZURE_STORAGE_CONNECTION_STRING=`az storage account show-connection-string -n $DCOS_PERS_STORAGE_ACCOUNT_NAME -g $DCOS_PERS_RESOURCE_GROUP -o tsv`
# Create the share
az storage share create -n $DCOS_PERS_SHARE_NAME
Mount the share in your cluster
Next, the file share needs to be mounted on every virtual machine inside your cluster. This task is completed using the cifs tool/protocol. The mount operation can be completed manually on each node of the cluster, or by running a script against each node in the cluster.
In this example, two scripts are run, one to mount the Azure file share, and a second to run this script on each node of the DC/OS cluster.
First, the Azure storage account name, and access key are needed. Run the following commands to get this information. Take note of each, these values are used in a later step.
Storage account name:
STORAGE_ACCT=$(az storage account list --resource-group $DCOS_PERS_RESOURCE_GROUP --query "[?contains(name, '$DCOS_PERS_STORAGE_ACCOUNT_NAME')].[name]" -o tsv)
echo $STORAGE_ACCT
Storage account access key:
az storage account keys list --resource-group $DCOS_PERS_RESOURCE_GROUP --account-name $STORAGE_ACCT --query "[0].value" -o tsv
Next, get the FQDN of the DC/OS master and store it in a variable.
FQDN=$(az acs list --resource-group $DCOS_PERS_RESOURCE_GROUP --query "[0].masterProfile.fqdn" --output tsv)
Copy your private key to the master node. This key is needed to create an ssh connection with all nodes in the cluster. Update the user name if a non-default value was used when creating the cluster.
scp ~/.ssh/id_rsa azureuser@$FQDN:~/.ssh
Create an SSH connection with the master (or the first master) of your DC/OS-based cluster. Update the user name if a non-default value was used when creating the cluster.
ssh azureuser@$FQDN
Create a file named cifsMount.sh, and copy the following contents into it.
This script is used to mount the Azure file share. Update the STORAGE_ACCT_NAME and ACCESS_KEY variables with the information collected earlier.
#!/bin/bash
# Azure storage account name and access key
SHARE_NAME=dcosshare
STORAGE_ACCT_NAME=mystorageaccount
ACCESS_KEY=mystorageaccountKey
# Install the cifs utils, should be already installed
sudo apt-get update && sudo apt-get -y install cifs-utils
# Create the local folder that will contain our share
if [ ! -d "/mnt/share/$SHARE_NAME" ]; then sudo mkdir -p "/mnt/share/$SHARE_NAME" ; fi
# Mount the share under the previous local folder created
sudo mount -t cifs //$STORAGE_ACCT_NAME.file.core.windows.net/$SHARE_NAME /mnt/share/$SHARE_NAME -o vers=3.0,username=$STORAGE_ACCT_NAME,password=$ACCESS_KEY,dir_mode=0777,file_mode=0777
Create a second file named getNodesRunScript.sh and copy the following contents into the file.
This script discovers all cluster nodes, and then runs the cifsMount.sh script to mount the file share on each.
#!/bin/bash
# Install jq used for the next command
sudo apt-get install jq -y
# Get the IP address of each node using the mesos API and store it inside a file called nodes
curl http://leader.mesos:1050/system/health/v1/nodes | jq '.nodes[].host_ip' | sed 's/\"//g' | sed '/172/d' > nodes
# From the previous file created, run our script to mount our share on each node
cat nodes | while read line
do
ssh `whoami`@$line -o StrictHostKeyChecking=no < ./cifsMount.sh
done
Run the script to mount the Azure file share on all nodes of the cluster.
sh ./getNodesRunScript.sh
The file share is now accessible at /mnt/share/dcosshare on each node of the cluster.
Next steps
In this tutorial an Azure file share was made available to a DC/OS cluster using the steps:
- Create an Azure storage account
- Create a file share
- Mount the share in the DC/OS cluster
Advance to the next tutorial to learn about integrating an Azure Container Registry with DC/OS in Azure.