question

PierreAndrevanLeeuwen-3896 avatar image
0 Votes"
PierreAndrevanLeeuwen-3896 asked ·

Azude Synapse Analytics Data flow expression - bitwise operations

The documentation for Data Flow expression language in Azure Synapse Analytics data-flow-expression-functions states that both Synapse and Data Factory have the same functions available, but it looks like a number of them are missing in Synapse. I'm trying to perform some bitwise operations in a Data Flow transformation, but bitwiseAnd, bitwiseOr and the corresponding operators (&, |) are not recognized by the editor or and validation produces this error: "Data flow expression uses functions/parameters/columns which are not present in current context"

How can I perform bitwise operations in a Data Flow transformation?


azure-synapse-analytics
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SamaraSoucy-MSFT avatar image
0 Votes"
SamaraSoucy-MSFT answered ·

I think this Github issue is yours as well: https://github.com/MicrosoftDocs/azure-docs/issues/71677

I've assigned that to the doc author to make sure we are more clear on which features are only available in Data Factory currently. We do track feature requests on the forums, but you may also want to post on the relevant product feedback page: https://feedback.azure.com/forums/307516-azure-synapse-analytics?category_id=387856

If you need this specific data transformation, there are two workarounds currently: The first is to use Data Factory until the feature is added to Pipelines. The second would be to use a Spark pool instead of a data flow to do your transformations and call that from the Pipeline. You lose the code-free experiences, but it also does not limit you to the operations defined in ADF or Pipelines.

· 2 ·
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PierreAndrevanLeeuwen-3896 avatar image PierreAndrevanLeeuwen-3896 ·

Thank you for the feedback. I wasn't sure where to post this.

I've switched to a Spark pool for now, so not a big issue.

0 Votes 0 ·
SamaraSoucy-MSFT avatar image SamaraSoucy-MSFT PierreAndrevanLeeuwen-3896 ·

I'm glad you found a solution. I definitely appreciate the feedback on where we can improve the documentation.

This space is for product questions and the Github repo is for docs feedback- nothing wrong with posting the question here and feedback on Github. When the question and feedback are so closely linked like this either one is generally fine. When it is purely a question or product feedback we do ask you to post here instead of using the Github repo- both are actively monitored. The main advantage you get by posting product questions on Q&A is that you can also get help or advice from the community and MVPs as well as Microsoft employees.

0 Votes 0 ·