Share via

My Dev, test, prod environments are in different resource groups of same subscription. How do I create a devops pipeline in this case?a DevOps pipeline to deploy a

Shashwat Tiwary 0 Reputation points
2024-05-14T19:23:38.4366667+00:00

Hi,

My dev, test and prod environments are in different resource groups of the same subscription. I am involved in a data engineering project where I will be using primarily below resources -

ADLS - data storage

ADF - Orchestration

Azure Databricks - QC and transformation

Logic App, Function App - error notifications

MySql - Configurations

I want to create a DevOps pipeline so that the code in Dev is migrated and deployed to test resource group and then to prod. The deployment to higher environment should be governed by an approval.

Is it possible to do this?

Awaiting for an early response.

Thanks in Advance!

Shashwat

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,379 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,982 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,793 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Sumarigo-MSFT 44,096 Reputation points Microsoft Employee
    2024-05-15T03:11:56.2766667+00:00

    @Shashwat Tiwary Welcome to Microsoft Q&A Forum, Thank you for the question.
    I'd recommend posting your question in https://developercommunity.visualstudio.com/spaces/21/index.html , it would the better medium to get better help since the issue doesn't seem to be Azure Data Lake Storage but the devops integration with it. 

    However, let me share some insights on your query.

    To create a DevOps pipeline to migrate and deploy your code from Dev to Test and then to Prod environments with approval gates. Here are the high-level steps you can follow:

    Create a new Azure DevOps project and repository to store your code.

    Create a new pipeline in Azure DevOps to build and deploy your code.

    Configure the pipeline to use the appropriate service connections for each of your resources (ADLS, ADF, Azure Databricks, Logic App, Function App, and MySQL).

    Set up the pipeline to deploy to the Dev environment first, using the appropriate deployment tasks for each resource.

    Once the Dev deployment is successful, set up a release gate to require approval before deploying to the Test environment.

    Once the Test deployment is successful and approved, set up another release gate to require approval before deploying to the Prod environment.

    You can use Azure DevOps' built-in release gates feature to require manual approval before deploying to higher environments. You can also use Azure DevOps' built-in deployment tasks for each of your resources, or you can create custom deployment tasks if needed.

    Make sure to test your pipeline thoroughly in your Dev environment before deploying to higher environments. Also, ensure that you have appropriate access and permissions to all the resources in each environment.

    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments