FILTER Transformation in ADF

Question

question

srinnippu-1270 asked May 9, '22 MarkKromer-MSFT commented May 10, '22

Hi Team,

I am new to ADF. I need to filter few ids that i want to see data.

Ex: ID : 1276 ,18976,4587,9870

Please suggest how can i filter the above ids only to show in filter transformation same as like IN Operator in SQL.

Thanks in advance.

azure-data-factory

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Answer 1 · 2022-05-10T01:34:02.25Z

KranthiPakala-MSFT answered May 10, '22 MarkKromer-MSFT commented May 10, '22

Thanks for the question and using MS Q&A platform.

Here is an excellent video demonstration of Filter transformation usage in ADF mapping data flow - Filter Transformation in Mapping Data Flow in Azure Data Factory

For your scenario you can use equal function with multiple OR operations to meet the conditions. Below is an example

If your ID column is an integer, please use below in your expression builder of filter transformation:

 equals(ID, 1276) || equals(ID, 18976) || equals(ID, 4587) || equals(ID, 9870)

If your ID column is a string type, please use below in your expression builder of filter transformation:

    equals(ID, '1276') || equals(ID, '18976') || equals(ID, '4587') || equals('ID, 9870')

Hope this will help. Please let us know if any further queries.

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

· 1

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

MarkKromer-MSFT · May 10 at 05:07 AM

Alternatively, if you'd like to use a similar IN SQL operator, you can use ADF's in() like this as an expression in your Filter transformation:

in ([1276 ,18976,4587,9870],ID)

0 ·