We pass in the columns mapping of our Copy data activities thru pipeline parameters.
But first we get the columns mapping from a Lookup table then store it on a variable which we pass to the pipeline with the Copy data activity.
This used to work with no problems even in production.
But starting last night, we now encounter an error on our dev ADF that there is now a limit of 1024 bytes for the variable intermittently (some pipelines are still working ok).
Has there been a recent limit on variable size that has been imposed? Does this 1024 bytes limit also apply to parameters? If so, how can we make the columns mapping for Copy data activity dynamic?