question

RomainPham-5538 avatar image
0 Votes"
RomainPham-5538 asked AndreaCuneo-6656 published

Azure Data Factory Wrangling data flow - Unexpected Error when connecting datasource

Dear Tech Community,

I am trying to use Wrangling Data Flow to perform transformation on a csv file host in my azure blob storage.
However every time I add the source data set that target my csv file and hit ok I receive the following message when power query online is launch:

Please specify how to connect.

I then click on Configure Connection

I have then 3 choice for Connection Kind: Anonymous, Basic, Organizational Account

Anonymous and Organizational Account (when clicking Sign In) always give the same error:

We encountered an unexpected error.

section Section1;
shared ABC_Finance = let
AdfDoc = Web.Contents("https://.blob.core.windows.net/data/ABC/ABC_Finance1.txt?sv=2018-03-28&sig=xlEVzRExQJ8hgVc%2B0ZOSpXJpV73bgrGqTJjGnnfYjkc%3D&spr=https&se=2020-12-22T06%3A20%3A52Z&srt=sco&ss=bf&sp=rwl"),
Csv = Csv.Document(AdfDoc, [Delimiter = ",", Encoding = TextEncoding.Utf8, QuoteStyle = QuoteStyle.Csv])
in
Csv;
shared UserQuery = let
Source = ABC_Finance
in
Source;


I don't know what am I doing wrong. All those data and transformation are happening in the same Storage Account.

if someone can help thanks.

azure-data-factorypower-query-not-supported
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @RomainPham-5538,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

I tried reproducing the same and transforming the CSV file using wrangling data flow and was able to do it successfully. I have used wrangling-data-flow-tutorial as reference. You can refer to attached image here.

Below are few details needed from you to further investigate the issue which you are facing

1) Can you try sharing the screenshot of the complete error which you are getting.
2)Share the sample query which you are using to transform the data in the power query.
3) If possible, please share the sample data file (attach as .txt file) .
4) Please provide the pipeline runID of the failed pipeline.
5) for the CSV file can you use it in copy activity as source and see if you are able to load the file properly.

Awaiting your Response.

0 Votes 0 ·
transform.png (274.2 KiB)
KeshavKiran-MSFT avatar image
1 Vote"
KeshavKiran-MSFT answered RomainPham-5538 commented

Hi @RomainPham-5538,

Thank you for your continued patience while we were working on this issue.

Your data factory is hosted in central France region and during the investigation process our product team identified that there was some issue with the underlying infra in the region due to which Wrangling data flow was not working as expected.

Fix has been deployed for the same and we would like you to test and confirm.


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

It's fix and it's All Good!

Thank you so much Keshav for the quick feedback and thanks to the Product Team for quickly identifying and fixing the issue! Keep on the good work you guys really help us to achieve more :)



54257-image.png


1 Vote 1 ·
image.png (59.8 KiB)
RomainPham-5538 avatar image
0 Votes"
RomainPham-5538 answered KeshavKiran-MSFT commented

Dear @KeshavKiran-MSFT ,

Thanks for your feedback please find below screenshot of the different message I receive

50529-configure-connection.png
50626-configure-connection-2.png
50569-unexpected-error-when-sign-in.png
50614-unexepxted-error.png


2) I haven't done any transformation yet below the sample query:
let
AdfDoc = Web.Contents("https://cndatafactorysa.blob.core.windows.net/tmrdata/test.txt?sv=2018-03-28&sig=%2Ft%2BGLsVfetK4eaaAgq%2FsZjRGEEuaUYij7LZolUKIkTA%3D&spr=https&se=2020-12-24T02%3A57%3A40Z&srt=sco&ss=bf&sp=rwl"),
Csv = Csv.Document(AdfDoc, [Delimiter = ",", Encoding = TextEncoding.Utf8, QuoteStyle = QuoteStyle.Csv])
in
Csv

3) Sample data

50635-test.txt



4)There is no pipeline failed i simply connot see the file in the power query hence cannot do any transformation

5) I can copy the file without problem using copy activity i just have this issue when trying to use power query online


· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @RomainPham-5538

Thanks for connecting over mail and sharing the necessary details. We are working with the Product Group on this and we will get back to you as soon as we get the final findings from them.

0 Votes 0 ·

Hi @RomainPham-5538

Due to Holiday seasons and limit availability of the product group engineers during the time, our product team were not able to address this issue. We are working on this and will keep you posted as soon as I hear back form them.

0 Votes 0 ·
AndreaCuneo-6656 avatar image
0 Votes"
AndreaCuneo-6656 answered AndreaCuneo-6656 published

Having the same issue in West Europe.
The other difference is that we're using ADLS Gen2 instead of BlobStorage. The Storage is linked with Service Principal Account.

89876-image.png



image.png (105.4 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.