question

AntoReniHuxleyAntokinsley-0522 avatar image
0 Votes"
AntoReniHuxleyAntokinsley-0522 asked AntoReniHuxleyAntokinsley-0522 commented

Powerbi report creation from Azure purview data model lineage

I need to create a power bi report with the lineage of assets in Azure Purview. Below are the steps to be done for report creation from the scanned data model Purview studio.
1. Record the Lineage of the Scanned data model.
2. Use Rest APIs to extract the DataModel, Classifications, Glossary, Lineage in json/parquet format.
3. Build Power BI Report using json/parquet format.

I was able to extract the guid of all Azure SQL DB entities by using the below mentioned link.
https://docs.microsoft.com/en-us/azure/sql-database/scripts/sql-database-import-purview-labels

Now I am stuck extracting the lineage for all the guids taken in the previous step dynamically in postman client/powershell. Kindly let me know how to solve this.

azure-purview
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered AntoReniHuxleyAntokinsley-0522 commented

Hi @antorenihuxleyantokinsley-0522,

Thanks for using Microsoft Q&A forum and posting your query here.

As per conversation with internal team, there is no good way to get lineage for multiple entities at a time.

You might be able to identify all of the process entities and GET /entity/bulk and extract the inputs/outputs from there.

Here is the endpoint that you need to use to get lineage info of the entity specified by GUID : Ref doc - Azure Purview Lineage - Get Lineage Graph

Get lineage info of the entity specified by GUID.

 GET {Endpoint}/catalog/api/atlas/v2/lineage/{guid}?direction={direction}

With optional parameters:

 GET {Endpoint}/catalog/api/atlas/v2/lineage/{guid}?depth={depth}&width={width}&direction={direction}&includeParent={includeParent}&getDerivedLineage={getDerivedLineage}

PyAPacheAtlas makes this easier : pyapacheatlas.core package — PyApacheAtlas 0.9.0 documentation (wjohnson.github.io)

Hope this info helps. Do let us know if you have further query


  • Please don't forget to click on 130616-image.png and upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @antorenihuxleyantokinsley-0522,

Just checking in to see if the above answer helped. If this answers your query, do click 130616-image.png and upvote 130671-image.png for the same. And, if you have any further query do let us know.

0 Votes 0 ·

Hi @antorenihuxleyantokinsley-0522,

We still have not heard back from you. Just wanted to check if the above suggestion was helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

0 Votes 0 ·

@KranthiPakala-MSFT : Is there any docs/links for extracting other resource GUID rather than Azure SQL DB such as Azure blob storage resource GUID. Anything as the below link used for Azure SQL DB?
https://docs.microsoft.com/en-us/azure/sql-database/scripts/sql-database-import-purview-labels

0 Votes 0 ·
KranthiPakala-MSFT avatar image KranthiPakala-MSFT AntoReniHuxleyAntokinsley-0522 ·

Hi there,

I don't see a specific doc related to those. And as this follow-up query is different than the original ask, I would recommend you to please open a new thread with your requirement as it will have high visibility/discoverability for other community readers and assist better on this.

Thank you

0 Votes 0 ·