Currently the notebook need to use spark.conf.set to set storage account password .
like
spark.conf.set("fs.azure.account.auth.type.dfs.core.windows.net", "OAuth")
spark.conf.set("fs.azure.account.oauth.provider.type...dfs.core.windows.net", "org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider")
spark.conf.set("fs.azure.account.oauth2.client.id...dfs.core.windows.net", ".")
spark.conf.set("fs.azure.account.oauth2.client.secret...dfs.core.windows.net", dbutils.secrets.get(scope=".",key="."))
spark.conf.set("fs.azure.account.oauth2.client.endpoint...dfs.core.windows.net", "https://login.microsoftonline.com/.**/oauth2/token")j
how to include in during spark cluster startup as a global config ?




