question

RyanAbbey-0701 avatar image
0 Votes"
RyanAbbey-0701 asked RyanAbbey-0701 commented

UTF8 - GBP symbol

My source file has the GB pound symbol (£) in some header columns and in the data, however, I'm unable to reference these columns and when viewing the data via the Copy "Preview Data", they show as the "diamond background question mark"... as I understand it, Data Factory should process everything as UTF8 and I would expect the pound symbol to be within UTF8 encoding range (is it not?) so any idea what I need to do so that I can decode these characters correctly?

azure-data-factory
· 5
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @RyanAbbey-0701 ,
I wanted to repro this issue and what I did , took and CSV and added a fileld with name £ , I was expecting to see what you mentioned in the preview , unfortunately it works just fine to me . I am not sure what is that I am missing .

125695-image.png

125753-image.png

Thanks
Himanshu





0 Votes 0 ·
image.png (19.6 KiB)
image.png (129.1 KiB)

Why doesn't that surprise me? In screenshot below, both heading and data "?"s are meant to be the pound symbol. If I look at the output parquet file generated, they are also "?"

I'm on Australia-East, is there likely any difference there?

125728-image.png


0 Votes 0 ·
image.png (7.4 KiB)

Hello @RyanAbbey-0701, ,
Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same.

Thanks
Himanshu

0 Votes 0 ·
Show more comments

0 Answers