Share via

I have a CDC connector on ADF connected to an SAP BW system. Need to read data only of a particular country from the ODQ into ADF. How can I send a selection filter through the CDC connector to the SAP BW system so that only the filtered records are read?

Pooja Kulkarni 0 Reputation points
2024-04-01T05:14:39.2766667+00:00

I have tried the Optimize on source option on data flow with the conditions attached on the screenshot and I know that these conditions help with partitioning but I need to have some filters applied on the ODQ and then filtered data flowing into the dataflow stage location

MS_Image2

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,692 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. AnnuKumari-MSFT 31,561 Reputation points Microsoft Employee
    2024-04-01T17:09:03.4066667+00:00

    Hi Pooja Kulkarni ,

    Welcome to Microsoft Q&A platform and thanks for posting your query here.

    As per my understanding, you are looking for solution to filter out records out of SAP BW dataset using CDC in mapping dataflow. Please let me know if that is not the ask.

    You can use 'filter transformation' for filtering out the records as per the desired condition, however , it seems you want to filter out as soon as data is getting read from the source so that only desired records show up which is not possible unfortunately , as pointing to the source using dataset would be the replica of data present in the source datastore.

    Kindly consider using filter transformation after source transformation to filter out the records.

    Hope it helps. Kindly let us know how it goes. Thanks.

    0 comments