Dataflow CDM Source Error java.lang.IllegalArgumentException: java.net.URISyntaxException:

Question

question

RamonAyala-1874 asked Dec 1, '20 YoussefYoussef-4250 commented Feb 21, '21

Dataflow CDM Source Error java.lang.IllegalArgumentException: java.net.URISyntaxException:

Hi All,
I'm testing out Azure Data Factory and Data Lake, I'm getting the following error when trying to use a model.json in the data preview.

at Source 'DataLake': java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: Airlines.csv@snapshot=2020-11-25T19:22:27.5604776Z

I'm using the Power Platform Dataflow to send to our data lake. It seems to be able to parse something from the model.json file as I'm only providing the "Airlines" entity and it's finding the rest as mentioned in the error.

azure-data-factory power-query-not-supported

image.png (24.9 KiB)

image.png (29.6 KiB)

image.png (13.2 KiB)

image.png (20.8 KiB)

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Answer 1 · 2020-12-01T20:10:00.267Z

RamonAyala-1874 answered Dec 1, '20 MartinJaffer-MSFT converted comment to answer Dec 9, '20

I kinda found an answer for the problem but not a solution. The OOBE for exporting to azure data lake from the power platform using the New Dataflow wizard appends the csv files with @snapshot=date:time:stamp. The model.json file has the correct path, but it's not a valid url so the function ADF uses isn't able to browse to the path. If I manually rename the partitions\location path and remove everything after @ and rename the file in the data lake to match that path. I don't get an error and it loads the schema.
It's not loading the actual data at this point, but some progress at least.

· 4

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

MarkKromer-MSFT · Dec 01, 2020 at 08:38 PM

Can you paste the path here for your partitions location?

0 ·

RamonAyala-1874 MarkKromer-MSFT · Dec 01, 2020 at 09:08 PM

Hi Mark,
Thank you for the quick response here is the path for partitions\location.
Note, I removed the unique domain and org names and replaced with renamed.

https://renamed.dfs.core.windows.net:443/power-platform-dataflows/environments/renamed/datalaketransferring/Airlines/Airlines.csv.snapshots/Airlines.csv@snapshot=2020-11-25T19:22:27.5604776Z

0 ·

image.png (66.8 KiB)

MarkKromer-MSFT RamonAyala-1874 · Dec 01, 2020 at 09:22 PM

Can you strip off everything after your filename (Airlines.csv) and try again?

0 ·

Show more comments

Answer 2 · 2020-12-01T22:17:15.063Z

RamonAyala-1874 answered Dec 1, '20 YoussefYoussef-4250 commented Feb 18, '21

Changing to just Airlines.csv for the files allows me to import the schema in the projection tab. But does not have any data pulled.

Doing the above along with renaming the file path to the updated file name, Airlines.csv, produces the data as expected, (not sure why it didn't it the first time I tried that)

So this is good, with the only problem is I don't think I have any control over how that data is named and appended with the @snapshot=datetimestamp. So on each refresh in the power platform dataflow, I'm sure it will just dump the new file with that files timestamp on runtime.

· 3

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

YoussefYoussef-4250 · Feb 18, 2021 at 02:27 PM

Hello,

Did you find a solution for this to enable ADF to read from output files of Power BI Dataflows?

0 ·

Kiran-MSFT YoussefYoussef-4250 · Feb 18, 2021 at 05:35 PM

Try the same operation in dataflow in Synapse workspace and it should succeed.

0 ·

YoussefYoussef-4250 Kiran-MSFT · Feb 18, 2021 at 07:28 PM

Thanks for your response! This got the schema import to work but when I run the data preview it shows no data.

0 ·

Answer 3 · 2021-02-18T21:30:46.46Z

svijaya-MSFT answered Feb 18, '21 YoussefYoussef-4250 commented Feb 21, '21

Can you check if your model.json is under the root container and data is within a folder in the same hierarchy?

· 1

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

YoussefYoussef-4250 · Feb 21, 2021 at 02:52 PM

Yes, it is all there and I can query that same CDM folder from Power BI Desktop.

0 ·

question