Hi Everyone,
We have ETL job running in Databricks and writing the data back to blob storage, Now we have created a table using azure table storage and would like to import the same data (Databricks output) to table storage.
So how to load data from blob to table storage
or
how to write data from databricks to table storage. please help
Welcome to Microsoft Q&A forum and thanks for your query.
So how to load data from blob to table storage?
In order to load data from blob storage to table storage, you can use Azure Data factory copy activity to perform the copy job.
a) Please refer to this to doc to know how to copy data from Azure Blob storage using ADF: Copy and transform data in Azure Blob storage by using Azure Data Factory
b) Please refer to this to doc to know how to copy data to Azure Table storage using ADF: Copy data to and from Azure Table storage by using Azure Data Factory
How to write data from databricks to table storage
You can try doing so using the Python SDK as described here: Get started with Azure Table storage and the Azure Cosmos DB Table API using Python (Note: The content in this article applies to both Azure Table storage and the Azure Cosmos DB Table API.)
Hope this info helps.
Thank you
Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.
9 people are following this question.
