question

David-3633 avatar image
0 Votes"
David-3633 asked YutongTie-MSFT commented

What is the point of AzureML modules?

Hello!

I created an Azure ML pipeline in Python and used multiple PythonScriptSteps for each of my tasks. For example, I have three training steps running in parallel, so I create three PythonScriptSteps in a for loop with my train.py script and different data. Later, I came across the ModuleStep, which seems to do exactly this, but with an extra layer of (seemingly pointless) abstraction. What does the ModuleStep add to a PythonScriptStep?

Also, I imagined the ModuleStep might make it possible to use a custom PythonScriptStep in the pipeline designer (by creating a new drag and drop module), however this doesn't seem to be the case. Is there any way of doing this?



azure-machine-learning
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello,

Are you trying to share your train python script? I can not open it. For your question. are you asking you want to develop a custom PythonScriptStep in Designer(the drag and drop) then use it in Python? Thanks.


Regards,
Yutong

0 Votes 0 ·

Hello @YutongTie-MSFT,

Sorry for the confusion, I wasn't trying to share my script, I'm not sure why it appears as a link, maybe I added an extra character by mistake. It's just a generic training script run using PythonScriptStep, so irrelevant.

No, I would like to create a new module, written in Python, and save this for reuse in the Designer, basically as an extra block.

But more broadly, I'd like to understand the point of the ModuleStep, if I already have a PythonScriptStep. What does it add?

Thank you,
David

0 Votes 0 ·

1 Answer

David-3633 avatar image
0 Votes"
David-3633 answered YutongTie-MSFT commented

Just to close this question, I have since discovered that the ModuleStep does create a custom drag-and-drop module in the designer. I don't know if I'd missed this (I imagine so) or if this is a new feature. Either way, that's the answer. @YutongTie-MSFT can you confirm if this was recently added?

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@David-3633 Thanks for sharing the solution, glad to know your issue has been solved. For your question, I haven't seen change for this class in the document. Please let me know if you have any further issue.


Regards,
Yutong

0 Votes 0 ·