question

IlzeAmanda-9677 avatar image
0 Votes"
IlzeAmanda-9677 asked ShaikMaheer-MSFT commented

Passing data from Azure Data Factory into Azure ML

In Azure ML the input data has to be defined as a Dataset (to create a pipeline). In my code I am passing datasets with the following syntax: input_data = Dataset.File.from_files(datapath)

I would like to change this datapath as an input parameter from Data Factory (for example via PipelineParamater), so I can apply the same Data Factory pipeline for different datasets. However, in Data Factory you can only pass string as a parameter, not a DataPath.

What is the solution around this?

azure-data-factoryazure-machine-learning
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @IlzeAmanda-9677 ,

Welcome to Microsoft Q&A Platform. Thank you for posting your query here.

Could you please help on below clarifications to understand ask better.

  • Which Activity you are using here in your Azure Data Factory Pipeline?

  • Could you please share activity configurations what you did so far and what we are missing here?

Below screenshot show what type of Parameters we can create in Pipeline. Kindly check it once.
115815-image.png


0 Votes 0 ·
image.png (196.4 KiB)

Activity you are using here in your Azure Data Factory Pipeline: using ML Experiment.
Activity configurations what you did so far and what we are missing here: global pipeline parameters are strings specifying storage name and file folder.

Goal: pass into the ML Experiment different input data as a user defined parameter from Azure Data Factory.

0 Votes 0 ·

Hi @IlzeAmanda-9677 ,

Thank you for your response. Below shared answer. Thank you.

0 Votes 0 ·

1 Answer

ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered ShaikMaheer-MSFT edited

Hi @IlzeAmanda-9677 ,

Thank you for posting your query on Microsoft Q&A Portal and sharing clarifications on ask.

Unfortunately, we cannot create user defined types in Azure data factory at this moment.

But, I will encourage you to log your feedback using below link. Product team will actively monitor feedback there and consider them for future releases. Thank you.
https://feedback.azure.com/forums/270578-data-factory

Hope this will help.


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.