Troubles with preview and filter in data factory , data flow

Golebiowska, Paula 1 Reputation point
2021-07-19T13:52:49.757+00:00

I create new data flow, then add source which is a table from the sql database from linked service. And in the preview I can't see some records that should be there (and I know for sure they exist there). When I add filter to the query in the source I can see that one record in the preview. But without that filter it is not presented in the preview. So when I used azure built in function "filter" this record is not presented

Azure SQL Database
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,135 questions
{count} votes

3 answers

Sort by: Most helpful
  1. Ryan Abbey 1,151 Reputation points
    2021-07-19T20:08:31.517+00:00

    Preview is exactly that... a preview... it will only show some of the rows and therefore if you have more rows in the table than the preview is configured to show, you will have "missing rows"


  2. Mark Kromer MSFT 1,146 Reputation points
    2021-07-22T14:56:04.43+00:00

    How about something like this? toUpper(trim(CardID))=='ABC'

    Taking out possibilities of unseen whitespace or casing issues


  3. Mark Kromer MSFT 1,146 Reputation points
    2021-07-22T15:09:00.057+00:00

    So you see the row in the data preview pane in the Source query? But you do not see it in the subsequent Filter transformation data preview?