Branding and site provisioning solutions for SharePoint
The introduction of the Cloud Add-in Model and SharePoint Add-ins provides alternatives to existing, established ways of branding and provisioning SharePoint sites.
Up to now, you might have used the SharePoint feature framework, site templates, web templates, and site definitions to provision your sites and site collections.
The articles in this section provide information about using SharePoint Add-ins to provision and manage site branding, a pattern that is sometimes referred to as remote provisioning. The remote provisioning pattern shows you how to create custom SharePoint Add-ins that provision site branding and perform other site provisioning tasks.
This guidance applies to SharePoint Server 2013, SharePoint Server 2016, and SharePoint Online.
What you need to know about SharePoint
To use the branding and site provisioning capabilities in SharePoint, you need to be familiar with the following:
- Key SharePoint terms and concepts
- The hierarchy of SharePoint structural elements
- SharePoint Add-ins
- The file system and content databases, and how they work together
- File customization states and their long-term impact on upgrades
- Types of SharePoint sites and why you would use them
- Client-side programming in SharePoint with the .NET client-side object model (CSOM) and REST APIs
Terms and concepts
The following table lists terms and concepts that are useful to know as you start to work with SharePoint site provisioning and branding with the remote provisioning pattern.
Table 1: Key SharePoint terms and concepts
|Term or concept||Description||For more information|
|App web||The website from which an add-in is deployed.||Host webs, add-in webs, and SharePoint components in SharePoint|
|Approval workflow||Workflows specific to publishing sites that specify who approves the publication of a page and when.||- Work with a publishing approval workflow
- Get started with workflows in SharePoint 2013
|ClientContext||A central object that serves as a "center of gravity" for all SharePoint CSOM and JSOM operations.||T:Microsoft.SharePoint.Client.ClientContext|
|Cloud Add-in Model||SharePoint Add-ins are self-contained pieces of functionality that extend the capabilities of a SharePoint website. You can use the Cloud Add-in Model to author and deliver secure, reliable, flexible, and consistent SharePoint Add-ins.||Overview of SharePoint Add-ins|
|Content database||Content databases store all content for a site collection, including the following:
- Site documents and files in document libraries
- List data
- Web part properties
- User names and rights
|Database types and descriptions in SharePoint Server|
|CSOM||Client-side object model. A model for writing client-side code for SharePoint using the .NET Framework.||- Get started using the client object model with external data in SharePoint
- [MS-CSOM]: SharePoint Client Query Protocol
- SharePoint .NET Server, CSOM, JSOM, and REST API index
|Hive||SharePoint's physical files; the files in the file system. These files are distinct from content stored in a content database. The following is the location of the hive.
|Host web||The website on which an add-in is installed.||Host webs, add-in webs, and SharePoint components in SharePoint|
|OneDrive for Business||A personal library for storing and organizing work documents that are shareable within your organization.||- OneDrive for Business is different from OneDrive
- OneDrive for Business is different from your team site
|Remote provisioning||A model that provisions sites by using templates and code that runs outside SharePoint in a provider-hosted add-in.||- Site provisioning techniques and remote provisioning in SharePoint 2013
- Self-Service Site Provisioning using Apps for SharePoint 2013
|REST||A stateless architectural style that abstracts architectural elements and uses HTTP verbs to read and write data from webpages that contain XML files.||Set custom permissions on a list by using the REST interface|
|Root web||The first web inside of a site collection. The root web is also sometimes referred to as the "Web Application Root."|
|SharePoint Add-in||(Formerly "app for SharePoint") Lightweight web applications that integrate popular web standards and technologies to extend the capabilities of a SharePoint website by using the Cloud Add-in Model.||SharePoint Add-ins|
|SharePoint Online||Cloud-based SharePoint offering in Office 365.||SharePoint Online General Reference|
|Site||A group of sites that share the same owner and administrative settings, such as permissions.||T:Microsoft.SharePoint.Client.Web|
|Site collection||A group of sites that share the same owner and administrative settings, such as permissions.||Create a site collection in SharePoint Server|
|Site provisioning||A process for equipping sites with the features, structure, brand, and other functionality.||- Site provisioning techniques and remote provisioning in SharePoint 2013
- Self-Service Site Provisioning using Apps for SharePoint 2013
|Subsite||A single SharePoint site in a SharePoint site collection. A subsite can inherit navigation and permissions from a parent site, or it can have unique permissions and navigation. You can create subsites that are based on the root site collection, or sites based on other site collections. You can choose to inherit permissions from the site collection or specify unique permissions for the subsite.|
Hierarchy of structural elements
Conceptually, the hierarchy of SharePoint objects is expressed in terms of containers: the types of objects and the type of the hierarchy contain all the types of objects under them in the hierarchy. Table 2 lists the hierarchy of SharePoint structural elements.
Table 2. Hierarchy of SharePoint structural elements
|Object type (in hierarchical order)||Description|
|Web applications||Applications that exist on a server and respond to requests from a browser.
Web applications are the central structure in Internet Information Services (IIS).
In SharePoint, a web application is a website with a unique URL and a separate content database stored in SQL Server.
|Site collections||Containers of sites that define permissions, and that can define some aspects of branding, depending on the configuration, for all sites within the container.|
|Sites||A collection of lists, libraries, structure, navigation, and look and feel elements organized around a central topic or theme.
Sites that are children of other sites in the same site collection are sometimes called subsites.
A subsite is a site that is stored in a subfolder of the parent website.
A subsite can inherit permissions and navigation structure from its parent site, or administration and authoring permissions might be unique for the subsite.
Subsites can have child subsites.
|Apps, lists, and document libraries||Containers of content and data that are organized into specific structures.
Every site has its own Master Page Gallery.
In team sites, the master page comes from the site, not the site collection.
|Items||Individual pieces of content or data that are contained in add-ins, lists, and document libraries.|
SharePoint Add-ins are lightweight solutions that don't install on the SharePoint host server, which means they don't make excessive API calls to the host server. You can build SharePoint Add-ins by using the Cloud Add-in Model. Users can discover and download add-ins from AppSource (formerly the Office Store) or from the enterprise's App Catalog. For more information, see Overview of SharePoint Add-ins.
File system and content databases
To understand your branding options and the implications that site customization can have on upgrade and migration, you'll need to understand the SharePoint file system and content databases and how they work together.
SharePoint stores files in the file system ("hive").
In SharePoint Server 2013 and SharePoint Server 2016, this location is called the 15-hive or 16-hive.
The following is the path to this location:
SharePoint Server 2013:
%program files%/Common Files/Microsoft Shared/Web Server Extensions/15/
SharePoint Server 2016:
%program files%/Common Files/Microsoft Shared/Web Server Extensions/16/
The 15-hive and 16-hive include several subfolders that store files you'll use when branding and provisioning sites.
Content databases store SharePoint content objects, such as site collections. A content database is automatically installed for every site collection when you deploy SharePoint Server 2013 or SharePoint Server 2016. All the content for a site collection is stored in one content database on one server. However, a content database can be associated with more than one site collection, and you can attach content databases to a SharePoint web application. You might need to move content from one content database to another, for example when the size of the content will soon exceed the size of the content database.
Some characteristics of a content database vary depending on how the site collection is used. For example, sites are often write-intensive, while other types of content, such as read-only documents, are read-intensive. How content is used effects aspects of the content database, such as size and performance.
File customization states
The state of SharePoint files and content affects how easy its to apply updates, and controls whether SharePoint serves the file from the content database or the file system. By default, all SharePoint files are uncustomized and ghosted, and reside in matching states in the SharePoint file system and in the content database. When a file, a content database entry, or both are used in specific ways or changed, the state of that content might be affected.
Table 3. File and content states and their effects on upgrade
|File or content state||Definition||Comment|
|uncustomized||An attribute associated with a file that indicates that it hasn't been modified.||More than one copy of a file can point to the same source.
This makes it easier for designers to implement changes.
|customized||An attribute associated with a file that indicates that it has been modified.||After a file becomes customized, it becomes more difficult to apply broad updates.
Be careful about what you customize.
As a general rule, it's better to use the default SharePoint files and functionality than to customize system files or introduce customizations that need to be manually updated.
|ghosted||A file with a source that is stored outside the content database.||A pointer in the content database (the ghost of the file) still exists that tells SharePoint to look for the file's source on the server's file system.|
|unghosted||An uncustomized version of the source file resides in the content database.||Example: The SharePoint 2013 Design Manager creates a sandboxed solution to package branding files.
It's never added to the file system of the server; that's why, by definition its files are considered unghosted.
However, the files it deploys are still in an uncustomized state.
If a file has been customized, it won't be updated when you install new service packs or the SharePoint Online service is updated.
Branding and site provisioning with the Cloud Add-in Model
In SharePoint Server 2013 or SharePoint Server 2016, you can use custom CSOM code in SharePoint Add-ins to provision SharePoint site collections, sites, and subsites with branding elements. This site provisioning pattern is called remote provisioning. SharePoint is increasingly focused on cloud-based deployments, so this pattern was created to help you use SharePoint's out-of-the-box capabilities to provision site branding in a way that reduces complexity and long-term operational costs.
What can I do with the Cloud Add-in Model?
Sometimes there's no correlation between features in full trust code and the Cloud Add-in Model. When developing a customization based on SharePoint Add-ins and the Cloud Add-in Model, consider an alternative approach rather than a direct conversion, and strive to keep customizations as simple as possible. Here are some examples:
- Replace event receivers with remote event receivers (see Create a remote event receiver in SharePoint Add-ins).
- Replace site templates, web templates, and site definitions with remote provisioning. This works for both subsites and site collections.
- Replace timer jobs with Microsoft Azure.
Some things, such as HTTP modules and HTTP handlers, can't be built with the Cloud Add-in Model. Before you try to replicate an existing customization in the Cloud Add-in Model, first consider why these customizations were built and whether an out-of-the-box SharePoint feature can work.
Remote provisioning pattern
Remote provisioning uses new add-in patterns to move provisioning logic outside of the SharePoint farm entirely. This approach eliminates the need to use the feature framework or other customizations in the SharePoint farm, and instead enables you to control customizations outside of SharePoint. This approach makes it possible to update and change the provisioning engine without affecting SharePoint availability. For more information about the feature framework, see Site Definitions and Provisioning: the Feature Framework.
Aspects and implementations of the remote provisioning pattern are documented in detail in this section. You may find it useful to get started with the following introductions to the pattern:
- Self-Service Site Provisioning using Apps for SharePoint 2013
- SharePoint 2013 site provisioning techniques presentation video recording
- Why did we introduce SharePoint App pattern?
In the simplest implementation of the remote provisioning pattern, provisioning requirements are stored in a SQL Server or Azure SQL Database or XML file; a SharePoint Add-in then reads requirements from the data source, reads branding elements from their source location, and applies branding elements to the target site based on the provisioning requirements.
The branding and provisioning code samples follow this sequence of events to show the remote provisioning pattern.
Table 4. Basic remote provisioning sequence and associated samples
|1||The user requests a change to the site through a form, which kicks off an approval workflow. The data that the user submits via the request form are stored using potentially any data storage format (SQL, Azure SQL, XML).||SharePoint site provisioning solutions|
|2||If the workflow is approved, the SharePoint Add-in calls the stored data, and provisions the site according to the metadata that user submitted in step 1.||SharePoint site provisioning solutions|
|3||The SharePoint Add-in scopes provisioning to the instructions in the request form by using the data available in the add-in web and content database. During this stage, applicable branding elements are provisioned to the site.|
Table 4 lists the steps that might be typical of a remote provisioning scenario. The samples you use depend on the approach that works best for your enterprise. For example, if you don't have a business need to create a custom approval workflow, you won't use that sample.
Example of a site provisioning and branding workflow using the remote provisioning pattern
How remote provisioning affects pre-existing site content
Depending on the specific site elements that you want to provision, your code will override default or pre-existing site content with a hook for the remote provisioning SharePoint Add-in. The add-in will select site templates and other capabilities based on the provisioning requirements stored in the database, without configuring SharePoint at all.
The basic remote provisioning pattern is the same regardless of additional requirements. However, when you plan to use this pattern to provision site branding, map your brand development strategy in the context of the customization capabilities that SharePoint CSOM, JSOM, and REST APIs provide (the code samples described in this section use CSOM). Also consider:
- Site architecture. Are you building an Internet-facing site, an intranet site, or an extranet that requires authorized users to sign in through the Internet-facing site to access company data?
- The degree of control that specific users have to define and request provisioning requirements. Should users be able to specify custom provisioning options by using a form? Are changes applied to the site automatically, only after people with decision-making power approve the changes, or are they managed by a governance policy?
- The types of branding customizations you want to apply (structural, look, and feel, or both).
Branding and site provisioning code samples
The code samples described in this section show the core scenario and extend it to cover some more specific use cases. The articles in this section also include some code examples. The following tables list and describe the samples.
Table 5. Site provisioning samples
|Batch provisioning||Provisions site collections in a console app.||SharePoint site provisioning solutions|
|Provisioning.Pages||Shows how to use the remote provisioning model to provision a wiki page and add remote web parts and HTML from the wiki page.||SharePoint pages and the page model|
|SiteProvisioningWorkflow||Provisions site collections with a workflow on the host web and a remote event receiver.||SharePoint site provisioning solutions|
|SiteProvisioningWorkflowAppWeb||Provisions site collections with a workflow on the add-in web and a remote event receiver.||SharePoint site provisioning solutions|
The BatchProvisioning, SiteProvisioningWorkflow, and SiteProvisioningWorkflowAppWeb samples demonstrate the core concepts and functions of the remote provisioning pattern. The ProvisionWikiPages sample addresses a specific use case (wiki page provisioning).
Table 6. Branding samples
|Branding.Theme||Shows how to apply a theme (CSOM).||SharePoint site branding and page customization solutions|
|OD4B.Configuration.Async||Shows how to use the remote provisioning model to provision a wiki page and add remote web parts and HTML from the wiki page.||SharePoint site branding and page customization solutions|
|Provisioning.OnPrem.Async Provisioning.SiteCol.OnPrem||Shows how to use a service to encapsulate all the information in SharePoint host web to on-premises)||Shows how to use a service to encapsulate all the information in SharePoint host web to the add-in web, get a web, get a list of site collections in a specified web application, and create a content type with a specific ContentTypeId.
This sample is especially useful when you want to use the remote provisioning pattern to provision sites by using SharePoint Add-ins, but the CSOM member you need to complete your scenario isn't yet available in CSOM.
|SharePoint site provisioning solutions|
SharePoint branding workflow
SharePoint provides several web parts that you can use to incorporate data views, images, scripts, search results, and more into your site design. Composed looks provide an easy way for users to customize the look and feel of their site while reinforcing designer and IT department control over design details and look and feel options that are available, and both the theming engine and custom CSS capabilities open the door for more advanced branding customizations.
The branding design and development workflow for SharePoint websites closely resembles the design workflow the industry uses:
- Plan your site architecture and design.
- Create design assets using familiar web design tools and technologies.
- Build your site using SharePoint tools such as Design Manager.
- Package your site design, and use SharePoint Add-ins and the remote provisioning pattern to provision site branding.
Applying branding in SharePoint means modifying the look and feel of a default SharePoint site. This can include making both structural and cosmetic changes to the site's appearance.
Branding cost and complexity
Branding changes range from low-cost and simple to high-cost and complex. Through the UI, users can apply composed looks, which include a background image, color palette, fonts, and a master page associated with these elements, and a preview file associated with the master page. You can use the SharePoint theming engine to create your own themes, and you can create custom CSS to modify the look and feel of your site.
Although it's possible to create custom master pages and other structural elements as part of a custom branding project, the long-term cost of supporting structural customizations can be high, and might make it more costly for your organization to apply upgrades and support the long-term applicability of short-term investments in customization.
Branding SharePoint sites hosted on-premises or on a dedicated farm
You can use the remote provisioning pattern to brand team sites, publishing sites, and OneDrive for Business sites that are hosted on-premises or on a dedicated farm at both the site collection and subsite level.
Part of planning a SharePoint branding project is deciding which types of sites you want to build, brand, and provision. SharePoint Online licensing affects whether publishing site capabilities are available to you. Not all licenses provide full publishing site capabilities.
Table 7. Site options in SharePoint Online
|Office 365 edition||Team site||Publishing site||Notes|
|Enterprise||Yes||Yes||Includes a team site collection at the root web application for the domain that doesn't include publishing, and you can create new publishing site collections under that root web application.|
When should I customize?
Most functionality that you need to meet your business needs is available out-of-the-box in SharePoint. Therefore, before creating a customization, determine whether there's an actual business case for creating the customization and what the long-term costs of creating and supporting this customization would be to the enterprise. How are features and functionality provided for end users? Look at business goals and user experience considerations before technology.
When working with an existing custom SharePoint solution and weighing whether and how to migrate it to the Cloud Add-in Model, first understand why the customization was done and what purpose it serves.
When considering moving an existing customization from full trust code to the Cloud Add-in Model, there usually isn't a one-to-one relationship between features and functionality. Rather than trying to find a one-to-one match between server-side and client-side code, consider alternative approaches. Table 8 maps some commonly used concepts and functionality of SharePoint solutions to their equivalents in SharePoint Add-ins.
Table 8. Mapping SharePoint concepts to add-ins
|Task||In SharePoint solution||In SharePoint Add-ins||Guidance|
|Display information in SharePoint pages||Web parts||App parts||Web parts run on the SharePoint Server with user permission or full-permissions/elevated privilege.
App parts run in the browser or on an external server with an app identity with granted permissions. They are isolated on the client in their own domain.
Add-in parts are executed outside of SharePoint and incur no performance impact on the SharePoint Server.
Create add-in parts to install with your SharePoint Add-in
|Create and manage notifications||Event receivers and feature receivers||Remote event receivers and add-in event receivers||Event receivers and feature receivers require server-side code and can't notify external systems of events.
Remote event receivers use client-side code, can be used in SharePoint solutions or SharePoint Add-ins, and can notify external systems of events.
App event receivers execute code when add-ins are installed, uninstalled, or upgraded.
- Handle events in SharePoint Add-ins
- Create a remote event receiver in SharePoint Add-ins
|Access data||.NET server object model (SSOM), .NET client object model (CSOM), and OData||.NET client object model (CSOM, JSOM), OData, REST, cross-domain libraries||- Complete basic operations using SharePoint client library code
- Get to know the SharePoint REST service
- SharePoint .NET Server, CSOM, JSOM, and REST API index
|Package and deploy||Solution packages (WSPs, feature packages)||App Catalog and AppSource (Office Store)||Solution packages are difficult to deploy across a SharePoint farm. You can publish a SharePoint Add-in to AppSource if you want to make it publicly available or sell it. Use the add-in catalog to make a SharePoint Add-in available within your organization. Guidance and code samples in the solution pack demonstrate how to use SharePoint Add-ins to provision branding elements to your SharePoint site.
- Use the site collection App Catalog
- Make your solutions available in AppSource and within Office
- Choose patterns for developing and hosting your SharePoint Add-in
|Use external data||External content types||App-scoped external content types||SharePoint site administrators or SharePoint Designer users must create and/or install external content types, which can be installed only at the farm level.
App-scoped external content types apply only to the SharePoint Add-in for which they were created, require no administration, and can access OData sources.
- Add-in-scoped external content types in SharePoint
- Create an external content type from an OData source in SharePoint
|Add custom pages and master pages||Application pages and site pages||Web-hosted pages||Application pages are shared across all sites on the server and are hosted on SharePoint.
Site pages are hosted by SharePoint, and require that page controls be listed in a safe controls list.
While application pages are ideal for custom code, custom code on-site pages will break after customization. Instead, use web-hosted pages. They are designed to be customizable, support the use of built-in web parts on site pages, are hosted externally, and are available anywhere the add-in is installed.