I recently encountered the following error while running a Custom Activity on Azure Data Factory:
"Total size of resourceFiles cannot be more than 32768 characters"
For this error, I found many blog posts that state you must zip all the files, then unzip using the command for the Custom Activity. I came across the following posts:
But I got a little confused and was hoping to get some clarification on the following questions:
How do I run a Python script with some command line arguments (For example, my current command is "python main.py -o test123") along with unzipping files?
When I unzip files on the Batch Node, should I have to delete the files once the Custom Activity is done running? How is that taken care of?
Does any activity on ADF 'zip' files for you?
If there's existing documentation for this, please guide me toward it. If not, any help will be appreciated!
Thank you, in advance!