This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 62%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPJ%3C/text%3E%3C/svg%3E)
Hello I am trying to ingest data from an api, I want to try using data flow to transform
and store the data in a sql database.
I successfully copied the json response from the api in a storage account (data lake gen 2).
However I cannot get any preview of the data when mapping it as a source in data flow.
The error is when I want to preview the data as a source in data flow.
at Source 'RawJsonResponse': org.apache.spark.SparkException: Job aborted due to stage failure ...
org.apache.spark.SparkException: Malformed records are detected in schema inference. Parse Mode: FAILFAST.
the entire trace does not seem to have any other useful information.
I have simplified the content to test if it is indeed the json that is malformed, but I can't see anything wrong.
contents of the simplified json
[
{"":"389cbb431e39693f8b4e116048461617","id":"9b9d5b64f1b26a76372210a4ae560c6e"}
,{"":"389cbb431e39693f8b4e116048461617","id":"4d99ba3182996825ed9bc227534bfe9d"}
]
In source settings I have schema drift enabled.
In source options I have Array of documents selected as Document form. ( I have tried the other forms with no success)
What am I doing wrong?
When I took your sample JSON, set the blank key to "name" and used "array of documents" in source options, it worked.
This is odd... The key is not blank, it is an underscore _ i see it is not visible in the post, but even if change the value of the key I get the same error.
Are there perhaps some hidden prerequisites in the storage account before I can load json files?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 61%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
This will probably need a ticket for Azure support so that engineering can look at it. Especially since it is not giving you the results when you enter a key like it is when I try it.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
@Palios, Jason , as per @Mark Kromer MSFT 's suggestion, I am willing to provide you with a one-time free support ticket, if you do not have a support plan. Please let me know if you need this and I will send detail privately.
That will not be necessary, I have opened an Azure Support ticket as my organization does have a support plan.
Thanks for the help
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 5%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
I can reproduce this on the simplest JSON file. Is there any answer?
Seems Data Factory cannot parse JSON that well
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 17%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Make sure you choose the right documentForm (singleDocument or arrayOfDocuments in most cases). Most cases of parsing error are when the configurations are misplaced.