question

AlphonseOkossi-1577 avatar image
0 Votes"
AlphonseOkossi-1577 asked AlphonseOkossi-1577 commented

How to pull data from an on premise MySQL database into Azure Databricks dataframe

How to pull data from an on premise MySQL database into Azure Databricks dataframe ?
1. MySQL data is on premise and can be accessed through a VPN connection
2. I am using Azure Databricks and Azure Data Factory, see below88315-new-design-page-3-2-page-4-1.png


How to setup pipeline in Azure Data Factory to accomplish this?

azure-data-factoryazure-databricks
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered AlphonseOkossi-1577 commented

Hello @AlphonseOkossi-1577 ,
Thanks for the ask and using the Microsoft Q&A platform .
I think you will have take the two stesp approach , copy the data from my sql to a blob and then you can use a notebook activity in ADF to read the blob and have the data in dataframes .

Just out of curiosity what is next are you planning to do once the data is in dataframes ?

Please do let me know how it goes .
Thanks
Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I basically want to create an automated pipeline that loads data using query of mysql database on premise, from Azure Databricks to into dataframe then do some processing then save the data in a PostgreSQL database in Azure

0 Votes 0 ·