How to use Azure Data Factory to copy FHIR data from local storage to Azure Health Data Service - FHIR service

P, Pioline (Cognizant) 195

Hi I have planned to use Azure Data Factory for Bulk import of FHIR data.
My source is local folder in my PC and destination sink is Azure Health Data Service - FHIR service. Now, can you tell me the steps to do this integration using ADF. Thanks

Harishga 3,745 Reputation points Microsoft Vendor

2024-01-16T06:10:31.0733333+00:00
Hi @P, Pioline (Cognizant) |

Welcome to Microsoft Q&A platform and thanks for posting your question here.

Here are the steps to use Azure Data Factory for bulk import of FHIR data from a local folder to Azure Health Data Service - FHIR service:

Create an Azure Data Factory instance in the Azure portal.

Create a linked service for your local folder in Azure Data Factory. You can use the File System linked service to connect to your local folder.

Create a linked service for your Azure Health Data Service - FHIR service in Azure Data Factory. You can use the Azure Healthcare APIs linked service to connect to your FHIR service.

Create a dataset for your local folder in Azure Data Factory. You can use the File System dataset to specify the location of your FHIR data in your local folder.

Create a dataset for your Azure Health Data Service - FHIR service in Azure Data Factory. You can use the Azure Healthcare APIs dataset to specify the location of your FHIR service.

Create a pipeline in Azure Data Factory that performs bulk import of FHIR data from your local folder to your Azure Health Data Service - FHIR service. You can use the Copy Data activity to copy data between the two datasets.

In the Copy Data activity, select the source dataset as your local folder dataset and the sink dataset as your Azure Healthcare APIs dataset.

Configure the Copy Data activity to use the $import operation to perform bulk import of FHIR data. You can do this by setting the operation field to "Import" and the Import Mode field to "Initial".

Map the columns in your source dataset to the columns in your sink dataset. You can use the Mapping tab in the Copy Data activity to do this.

Run the pipeline to perform bulk import of FHIR data from your local folder to your Azure Health Data Service - FHIR service.

For more information on how to use Azure Data Factory to copy data, see the following documentation:
https://learn.microsoft.com/en-us/azure/healthcare-apis/fhir/import-data

I hope this information helps you. Let me know if you have any further questions or concerns.
P, Pioline (Cognizant) 195 Reputation points

2024-01-16T12:19:34.1933333+00:00

The 3rd point that you mentioned is not possible. I tried Creating a linked service for Azure Health Data Service - FHIR service, however the FHIR service option is not listed under New Linked service.

Kindly assist.
Harishga 3,745 Reputation points Microsoft Vendor

2024-01-17T09:39:46.8533333+00:00

Hi @P, Pioline (Cognizant)
We are reaching out to the internal team to get more information related to your query and will get back to you as soon as we have an update.
Harishga 3,745 Reputation points Microsoft Vendor

2024-01-24T10:06:00.4733333+00:00

@P, Pioline (Cognizant)
Have you attempted to connect to the Azure Health Data Service - FHIR service using the Azure Healthcare APIs linked service? If you have already tried this and it was unsuccessful, I can suggest using Azure Functions to write custom code for interacting with the FHIR service.
Harishga 3,745 Reputation points Microsoft Vendor

2024-01-25T05:32:11.79+00:00

Hi @P, Pioline (Cognizant)
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.