Visualize Remote Monitoring data using Power BI
This tutorial will walk you through how to plug in your Remote Monitoring solution data from CosmosDB into Power BI. With this connection established, you can then create your own custom dashboards, and add them back onto your Remote Monitoring solution dashboard. This workstream allows for more specialized graphs to be created, in addition to the ones out of the box. You can then use this tutorial to integrate with other data streams or build custom dashboards to be consumed outside of your Remote Monitoring Solution. Building dashboards in Power BI means that you can also make each panel interact with one another as you select specific pieces. For example, you could have a filter that shows you only information about your simulated trucks and each piece of your dashboard would interact to show you only simulated truck information. If you would like to use a tool other than Power BI, you can also extend these steps to use your visualization tool of choice and hook into the Cosmos Database, or custom database if you've set one up.
- You must have a Remote Monitoring solution currently running
- You must have access to Azure Portal and your subscription on which the IoT Hub and Solution are running
- You must have Power BI desktop installed, any version will do
Information Needed from Azure Portal
Navigate to Azure Portal and sign-in if needed
On the left-hand panel, click Resource groups
Navigate to the Resource Group of which your Iot Solution is running on and click to be taken to that Resource Group's Overview page.
On that overview page click the item, which has type "Azure Cosmos DB Account", you will then be taken to the overview page of the Cosmos DB stream for that IoT Solution.
On the panel to the left, click the "Keys" section and take note of the following values to be used in Power BI:
Setting up the Stream in Power BI
Open up the Power BI desktop app and click "Get Data" from the top-left corner.
When asked to enter data, choose to Search for "Azure Cosmos DB" and select this connector. This connector essentially pulls data straight from the cosmos database of your Azure IoT Solution
Enter the information, which you have recorded above:
- Primary Key
Select all the tables to be imported into Power BI. This action will kick off the loading of the data. The longer your solution has been running, the longer it can take for the data to load (up to a few hours).
Once the data has finished loading, click "Edit Queries" on the top row of Power BI and expand all the tables by clicking the arrows in the yellow bar for each table. This will essentially expand to show all the columns. You will notice how data for things such as humidity, speed time, etc. are not of the correct type.
For example, the data coming into Power BI was changed into UNIX time when it came in through the connector. To adjust for this conversion, going forward you can create a new column and use this equation to get it into date time format:
#datetime(1970, 1, 1, 0, 0, 0) + #duration(0, 0, 0, [Document.device.msg.received]/1000)
Document.device.msg.received is just one of the columns with UNIX formatting and can be substituted with others that need conversion.
Other data points were converted to type String can be changed into Doubles or Int where appropriate using the same steps as above.
Creating a dashboard
Once the stream has been connected, you are ready to create your personalized dashboards! The dashboard below is an example of taking the telemetry being emitted by our simulated devices, and showing different pivots around it such as:
- Device Location on a map (right)
- Devices with their status and severity. (top left)
- Devices with rules in place, and if there are any alerts going off for them (bottom left)
Publishing the dashboard and refreshing the data
After you have successfully created your dashboards, we recommend that you publish your Power BI dashboards to share with others.
You'll also want to refresh the data on the published dashboard to make sure that you have the latest data set.
In this article, you learned about how to visualize remote monitoring data using Power BI
For more information about customizing the Remote Monitoring solution, see: