Quickstart: Create a graph database in Azure Cosmos DB using Python and the Azure portal

In this quickstart, you create and manage an Azure Cosmos DB Gremlin (graph) API account from the Azure portal, and add data by using a Python app cloned from GitHub. Azure Cosmos DB is a multi-model database service that lets you quickly create and query document, table, key-value, and graph databases with global distribution and horizontal scale capabilities.

Prerequisites

Note

This quickstart requires a graph database account created after December 20th, 2017. Existing accounts will support Python once they’re migrated to general availability.

Create a database account

Before you can create a graph database, you need to create a Gremlin (Graph) database account with Azure Cosmos DB.

  1. In a new browser window, sign in to the Azure portal.

  2. In the left menu, select Create a resource.

    Create a resource in the Azure portal

  3. On the New page, select Databases > Azure Cosmos DB.

    The Azure portal Databases pane

  4. On the Create Azure Cosmos DB Account page, enter the settings for the new Azure Cosmos DB account.

    Setting Value Description
    Subscription Your subscription Select the Azure subscription that you want to use for this Azure Cosmos DB account.
    Resource Group Create new

    Then enter the same name as Account Name
    Select Create new. Then enter a new resource group name for your account. For simplicity, use the same name as your Azure Cosmos DB account name.
    Account Name Enter a unique name Enter a unique name to identify your Azure Cosmos DB account. Your account URI will be gremlin.azure.com appended to your unique account name.

    The account name can use only lowercase letters, numbers, and hyphens (-), and must be between 3 and 31 characters long.
    API Gremlin (graph) The API determines the type of account to create. Azure Cosmos DB provides five APIs: Core (SQL) for document databases, Gremlin for graph databases, MongoDB for document databases, Azure Table, and Cassandra. You must create a separate account for each API.

    Select Gremlin (graph), because in this quickstart you are creating a table that works with the Gremlin API.

    Learn more about the Gremlin API.
    Location Select the region closest to your users Select a geographic location to host your Azure Cosmos DB account. Use the location that's closest to your users to give them the fastest access to the data.

    Select Review+Create. You can skip the Network and Tags section.

    The new account page for Azure Cosmos DB

  5. The account creation takes a few minutes. Wait for the portal to display the Congratulations! Your Azure Cosmos DB account was created page.

    Azure Cosmos DB account created page

Add a graph

You can now use the Data Explorer tool in the Azure portal to create a graph database.

  1. Select Data Explorer > New Graph.

    The Add Graph area is displayed on the far right, you may need to scroll right to see it.

    The Azure portal Data Explorer, Add Graph page

  2. In the Add graph page, enter the settings for the new graph.

    Setting Suggested value Description
    Database ID sample-database Enter sample-database as the name for the new database. Database names must be between 1 and 255 characters, and cannot contain / \ # ? or a trailing space.
    Throughput 400 RUs Change the throughput to 400 request units per second (RU/s). If you want to reduce latency, you can scale up the throughput later.
    Graph ID sample-graph Enter sample-graph as the name for your new collection. Graph names have the same character requirements as database IDs.
    Partition Key /pk All Cosmos DB accounts need a partition key to horizontally scale. Learn how to select an appropriate partition key in the Graph Data Partitioning article.
  3. Once the form is filled out, select OK.

Clone the sample application

Now let's switch to working with code. Let's clone a Gremlin API app from GitHub, set the connection string, and run it. You'll see how easy it is to work with data programmatically.

  1. Open a command prompt, create a new folder named git-samples, then close the command prompt.

    md "C:\git-samples"
    
  2. Open a git terminal window, such as git bash, and use the cd command to change to a folder to install the sample app.

    cd "C:\git-samples"
    
  3. Run the following command to clone the sample repository. This command creates a copy of the sample app on your computer.

    git clone https://github.com/Azure-Samples/azure-cosmos-db-graph-python-getting-started.git
    

Review the code

This step is optional. If you're interested in learning how the database resources are created in the code, you can review the following snippets. The snippets are all taken from the connect.py file in the C:\git-samples\azure-cosmos-db-graph-python-getting-started\ folder. Otherwise, you can skip ahead to Update your connection string.

  • The Gremlin client is initialized in line 104 in connect.py:

    ...
    client = client.Client('wss://<YOUR_ENDPOINT>.gremlin.cosmosdb.azure.com:443/','g', 
        username="/dbs/<YOUR_DATABASE>/colls/<YOUR_COLLECTION_OR_GRAPH>", 
        password="<YOUR_PASSWORD>")
    ...
    
  • A series of Gremlin steps are declared at the beginning of the connect.py file. They are then executed using the client.submitAsync() method:

    client.submitAsync(_gremlin_cleanup_graph)
    

Update your connection information

Now go back to the Azure portal to get your connection information and copy it into the app. These settings enable your app to communicate with your hosted database.

  1. In your Azure Cosmos DB account in the Azure portal, select Keys.

    Copy the first portion of the URI value.

    View and copy an access key in the Azure portal, Keys page

  2. Open the connect.py file and in line 104 paste the URI value over <YOUR_ENDPOINT> in here:

    client = client.Client('wss://<YOUR_ENDPOINT>.gremlin.cosmosdb.azure.com:443/','g', 
        username="/dbs/<YOUR_DATABASE>/colls/<YOUR_COLLECTION_OR_GRAPH>", 
        password="<YOUR_PASSWORD>")
    

    The URI portion of the client object should now look similar to this code:

    client = client.Client('wss://test.gremlin.cosmosdb.azure.com:443/','g', 
        username="/dbs/<YOUR_DATABASE>/colls/<YOUR_COLLECTION_OR_GRAPH>", 
        password="<YOUR_PASSWORD>")
    
  3. Change the second parameter of the client object to replace the <YOUR_DATABASE> and <YOUR_COLLECTION_OR_GRAPH> strings. If you used the suggested values, the parameter should look like this code:

    username="/dbs/sample-database/colls/sample-graph"

    The entire client object should now look like this code:

    client = client.Client('wss://test.gremlin.cosmosdb.azure.com:443/','g', 
        username="/dbs/sample-database/colls/sample-graph", 
        password="<YOUR_PASSWORD>")
    
  4. On the Keys page, use the copy button to copy the PRIMARY KEY and paste it over <YOUR_PASSWORD> in the password=<YOUR_PASSWORD> parameter.

    The entire client object definition should now look like this code:

    client = client.Client('wss://test.gremlin.cosmosdb.azure.com:443/','g', 
        username="/dbs/sample-database/colls/sample-graph", 
        password="asdb13Fadsf14FASc22Ggkr662ifxz2Mg==")
    
  5. Save the connect.py file.

Run the console app

  1. In the git terminal window, cd to the azure-cosmos-db-graph-python-getting-started folder.

    cd "C:\git-samples\azure-cosmos-db-graph-python-getting-started"
    
  2. In the git terminal window, use the following command to install the required Python packages.

    pip install -r requirements.txt
    
  3. In the git terminal window, use the following command to start the Python application.

    python connect.py
    

    The terminal window displays the vertices and edges being added to the graph.

    If you experience timeout errors, check that you updated the connection information correctly in Update your connection information, and also try running the last command again.

    Once the program stops, press Enter, then switch back to the Azure portal in your internet browser.

Review and add sample data

After the vertices and edges are inserted, you can now go back to Data Explorer and see the vertices added to the graph, and add additional data points.

  1. In your Azure Cosmos DB account in the Azure portal, select Data Explorer, expand sample-graph, select Graph, and then select Apply Filter.

    Create new documents in Data Explorer in the Azure portal

  2. In the Results list, notice three new users are added to the graph. You can move the vertices around by dragging and dropping, zoom in and out by scrolling the wheel of your mouse, and expand the size of the graph with the double-arrow.

    New vertices in the graph in Data Explorer in the Azure portal

  3. Let's add a few new users. Select the New Vertex button to add data to your graph.

    Create new documents in Data Explorer in the Azure portal

  4. Enter a label of person.

  5. Select Add property to add each of the following properties. Notice that you can create unique properties for each person in your graph. Only the id key is required.

    key value Notes
    pk /pk
    id ashley The unique identifier for the vertex. If you don't specify an id, one is generated for you.
    gender female
    tech java

    Note

    In this quickstart create a non-partitioned collection. However, if you create a partitioned collection by specifying a partition key during the collection creation, then you need to include the partition key as a key in each new vertex.

  6. Select OK. You may need to expand your screen to see OK on the bottom of the screen.

  7. Select New Vertex again and add an additional new user.

  8. Enter a label of person.

  9. Select Add property to add each of the following properties:

    key value Notes
    pk /pk
    id rakesh The unique identifier for the vertex. If you don't specify an id, one is generated for you.
    gender male
    school MIT
  10. Select OK.

  11. Select the Apply Filter button with the default g.V() filter to display all the values in the graph. All of the users now show in the Results list.

    As you add more data, you can use filters to limit your results. By default, Data Explorer uses g.V() to retrieve all vertices in a graph. You can change it to a different graph query, such as g.V().count(), to return a count of all the vertices in the graph in JSON format. If you changed the filter, change the filter back to g.V() and select Apply Filter to display all the results again.

  12. Now we can connect rakesh and ashley. Ensure ashley is selected in the Results list, then select the edit button next to Targets on lower right side. You may need to widen your window to see the Properties area.

    Change the target of a vertex in a graph

  13. In the Target box type rakesh, and in the Edge label box type knows, and then select the check.

    Add a connection between ashley and rakesh in Data Explorer

  14. Now select rakesh from the results list and see that ashley and rakesh are connected.

    Two vertices connected in Data Explorer

That completes the resource creation part of this tutorial. You can continue to add vertexes to your graph, modify the existing vertexes, or change the queries. Now let's review the metrics Azure Cosmos DB provides, and then clean up the resources.

Review SLAs in the Azure portal

The Azure portal monitors your Cosmos DB account throughput, storage, availability, latency, and consistency. Charts for metrics associated with an Azure Cosmos DB Service Level Agreement (SLA) show the SLA value compared to actual performance. This suite of metrics makes monitoring your SLAs transparent.

To review metrics and SLAs:

  1. Select Metrics in your Cosmos DB account's navigation menu.

  2. Select a tab such as Latency, and select a timeframe on the right. Compare the Actual and SLA lines on the charts.

    Azure Cosmos DB metrics suite

  3. Review the metrics on the other tabs.

Clean up resources

When you're done with your app and Azure Cosmos DB account, you can delete the Azure resources you created so you don't incur more charges. To delete the resources:

  1. In the Azure portal Search bar, search for and select Resource groups.

  2. From the list, select the resource group you created for this quickstart.

    Select the resource group to delete

  3. On the resource group Overview page, select Delete resource group.

    Delete the resource group

  4. In the next window, enter the name of the resource group to delete, and then select Delete.

Next steps

In this quickstart, you learned how to create an Azure Cosmos DB account, create a graph using the Data Explorer, and run a Python app to add data to the graph. You can now build more complex queries and implement powerful graph traversal logic using Gremlin.