question

JohnySijo-2036 avatar image
0 Votes"
JohnySijo-2036 asked JohnySijo-2036 answered

How to exclude a column having null values in ADF

Hi,

I am having a input file in which some of the columns will be having null values, column name will be there but the values are null, is there any way to exclude those in output.


for example : file will be having , emp, emp_name, address, pin code etc. one of the column can be null values. so need to avoid that alone. column names of input file changes dynamically

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Samy-7940 avatar image
0 Votes"
Samy-7940 answered
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

JohnySijo-2036 avatar image
0 Votes"
JohnySijo-2036 answered

Thanks for the answer, in the example i have mentioned i would want to completely exclude columns that having only null values from the output sink. basically what i am doing is doing few lookups and derive new columns in certain conditions , new derived columns would be completely empty(null) so need to exclude that from the output sink

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.