Azude Synapse Analytics Data flow expression - bitwise operations

Pierre-Andre van Leeuwen 56 Reputation points
2021-03-05T11:44:53.927+00:00

The documentation for Data Flow expression language in Azure Synapse Analytics data-flow-expression-functions states that both Synapse and Data Factory have the same functions available, but it looks like a number of them are missing in Synapse. I'm trying to perform some bitwise operations in a Data Flow transformation, but bitwiseAnd, bitwiseOr and the corresponding operators (&, |) are not recognized by the editor or and validation produces this error: "Data flow expression uses functions/parameters/columns which are not present in current context"

How can I perform bitwise operations in a Data Flow transformation?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,432 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Samara Soucy - MSFT 5,051 Reputation points
    2021-03-09T07:23:24.353+00:00

    I think this Github issue is yours as well: https://github.com/MicrosoftDocs/azure-docs/issues/71677

    I've assigned that to the doc author to make sure we are more clear on which features are only available in Data Factory currently. We do track feature requests on the forums, but you may also want to post on the relevant product feedback page: https://feedback.azure.com/forums/307516-azure-synapse-analytics?category_id=387856

    If you need this specific data transformation, there are two workarounds currently: The first is to use Data Factory until the feature is added to Pipelines. The second would be to use a Spark pool instead of a data flow to do your transformations and call that from the Pipeline. You lose the code-free experiences, but it also does not limit you to the operations defined in ADF or Pipelines.