In-database R analytics for SQL developers (tutorial)
The goal of this tutorial is to provide SQL programmers with hands-on experience building a machine learning solution in SQL Server. In this tutorial, you'll learn how to incorporate R into an application or BI solution by wrapping R code in stored procedures.
The same solution is available in Python. SQL Server 2017 is required. See In-database analytics for Python developers
The process of building an end to end solution typically consists of obtaining and cleaning data, data exploration and feature engineering, model training and tuning, and finally deployment of the model in production. Development and testing of the actual code is best performed using a dedicated development environment. For R, that might mean RStudio or R Tools for Visual Studio.
However, after the solution has been created, you can easily deploy it to SQL Server using Transact-SQL stored procedures in the familiar environment of Management Studio.
In this tutorial, we assume that you have been given all the R code needed for the solution, and focus on building and deploying the solution using SQL Server.
Download the sample dataset and the sample SQL script files to a local computer.
Execute a PowerShell script that creates a database and a table on the SQL Server 2017 instance and loads the sample data to the table.
Perform basic data exploration and visualization, by calling R packages and functions from Transact-SQL stored procedures.
Create new data features using custom SQL functions.
Build a machine learning model using R in stored procedures. Save the model to a SQL Server table.
After the model has been saved to the database, call the model for prediction from Transact-SQL by using stored procedures.
This tutorial uses a well-known public dataset, based on trips in New York city taxis. To make the sample code run quicker, we created a representative 1% sampling of the data. You'll use this data to build a binary classification model that predicts whether a particular trip is likely to get a tip or not, based on columns such as the time of day, distance, and pick-up location.
This tutorial is intended for users who are already familiar with fundamental database operations, such as creating databases and tables, importing data into tables, and creating SQL queries. All R code is provided, so no R development environment is required. An experienced SQL programmer should be able to complete this example by using Transact-SQL in SQL Server Management Studio, and by running the provided PowerShell scripts.
However, before starting the tutorial, you must complete these preparations:
- Connect to an instance of SQL Server 2016 with R Services, or SQL Server 2017 with Machine Learning Services and R enabled.
- The login that you use for this tutorial must have permissions to create databases and other objects, to upload data, select data, and run stored procedures.
We recommend that you do not use SQL Server Management Studio to write or test R code. If the code that you embed in a stored procedure has any problems, the information that is returned from the stored procedure is usually inadequate to understand the cause of the error.
For debugging, we recommend you use a tool such as R Tools for Visual Studio, or RStudio. The R scripts provided in this tutorial have already been developed and debugged using traditional R tools.