Powerbi report creation from Azure purview data model lineage

Question

question

AntoReniHuxleyAntokinsley-0522 asked Oct 10, '21 AntoReniHuxleyAntokinsley-0522 commented Oct 27, '21

Powerbi report creation from Azure purview data model lineage

I need to create a power bi report with the lineage of assets in Azure Purview. Below are the steps to be done for report creation from the scanned data model Purview studio.
1. Record the Lineage of the Scanned data model.
2. Use Rest APIs to extract the DataModel, Classifications, Glossary, Lineage in json/parquet format.
3. Build Power BI Report using json/parquet format.

I was able to extract the guid of all Azure SQL DB entities by using the below mentioned link.
https://docs.microsoft.com/en-us/azure/sql-database/scripts/sql-database-import-purview-labels

Now I am stuck extracting the lineage for all the guids taken in the previous step dynamically in postman client/powershell. Kindly let me know how to solve this.

azure-purview

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Answer 1 · 2021-10-11T18:28:38.383Z

KranthiPakala-MSFT answered Oct 11, '21 AntoReniHuxleyAntokinsley-0522 commented Oct 27, '21

Hi @antorenihuxleyantokinsley-0522,

Thanks for using Microsoft Q&A forum and posting your query here.

As per conversation with internal team, there is no good way to get lineage for multiple entities at a time.

You might be able to identify all of the process entities and GET /entity/bulk and extract the inputs/outputs from there.

Here is the endpoint that you need to use to get lineage info of the entity specified by GUID : Ref doc - Azure Purview Lineage - Get Lineage Graph

Get lineage info of the entity specified by GUID.

 GET {Endpoint}/catalog/api/atlas/v2/lineage/{guid}?direction={direction}

With optional parameters:

 GET {Endpoint}/catalog/api/atlas/v2/lineage/{guid}?depth={depth}&width={width}&direction={direction}&includeParent={includeParent}&getDerivedLineage={getDerivedLineage}

PyAPacheAtlas makes this easier : pyapacheatlas.core package — PyApacheAtlas 0.9.0 documentation (wjohnson.github.io)

Hope this info helps. Do let us know if you have further query

Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

· 4

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT · Oct 15, 2021 at 05:23 AM

Hi @antorenihuxleyantokinsley-0522,

Just checking in to see if the above answer helped. If this answers your query, do click and upvote for the same. And, if you have any further query do let us know.

0 ·

KranthiPakala-MSFT KranthiPakala-MSFT · Oct 15, 2021 at 05:41 AM

Hi @antorenihuxleyantokinsley-0522,

We still have not heard back from you. Just wanted to check if the above suggestion was helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

0 ·

AntoReniHuxleyAntokinsley-0522 · Oct 19, 2021 at 10:57 AM

@KranthiPakala-MSFT : Is there any docs/links for extracting other resource GUID rather than Azure SQL DB such as Azure blob storage resource GUID. Anything as the below link used for Azure SQL DB?
https://docs.microsoft.com/en-us/azure/sql-database/scripts/sql-database-import-purview-labels

0 ·

KranthiPakala-MSFT AntoReniHuxleyAntokinsley-0522 · Oct 27, 2021 at 06:48 PM

Hi there,

I don't see a specific doc related to those. And as this follow-up query is different than the original ask, I would recommend you to please open a new thread with your requirement as it will have high visibility/discoverability for other community readers and assist better on this.

Thank you

0 ·

question