Operator's manual for Dynamics 365 Guides
Welcome to Microsoft Dynamics 365 Guides! This operator's manual is designed to help operators understand how to use a holographic guide created with Dynamics 365 Guides. It describes everything that you, as the operator, need to know about the Dynamics 365 Guides user interface and how to accomplish tasks in a real-world environment, such as a busy factory floor. If you’re like other first-line workers in this type of environment, you probably have your hands full of tools and parts as you do your work. With Dynamics 365 Guides, you can stay heads-up and keep your tools in your hands as you follow step-by-step holographic instructions to accomplish your tasks.
First things first – calibrate your HoloLens
Dynamics 365 Guides uses holograms to show you exactly what you need to do to accomplish a real-world task. For example, your guide might show you how to assemble a door for a commercial aircraft. Since instructions are provided through holograms on Microsoft HoloLens, it’s extremely important to make sure that the holograms are aligned properly. Otherwise you might drill a hole in the wrong place or even assemble the wrong part! To make sure holograms are properly aligned, you need to calibrate your HoloLens device. You can do this by using the Calibration app that comes with your HoloLens.
Calibrate your HoloLens by using the Calibration app
Use the bloom gesture to open the Start menu.
Select + to view all apps, if Settings isn't pinned to Start.
To select something with your HoloLens device, gaze at it to target it, and then air tap to select it.
Select Open Calibration.
Follow the instructions on your screen.
Navigate with gaze and gestures
To navigate through a guide, you’ll use your gaze and a few gestures.
Gaze on HoloLens is pretty much as easy as it sounds. In some cases, you can select an item (an app, menu, or button, for example) just by gazing at a selection box next to the item. For example, when you first start the HoloLens app, you’ll gaze at the box to the left of Operate in the following dialog box to select Operate mode.
The selection is completed when the box is filled up by your gaze. Using gaze is extremely helpful if your hands are occupied with tools or parts.
In other cases in Dynamics 365 Guides, you use gaze to target an object, and then act on the target with a gesture, such as an air tap. In either case, when you gaze, make sure to turn your whole head—not just your eyes.
You’ll also need to use some gestures as you work with a guide. This section lists the most important gestures to know about.
The bloom gesture opens the Start menu or the Quick Actions menu, depending on which version of HoloLens you're using. Most of the time, you need to use the bloom gesture only once to get to Start, but sometimes you'll need to use it twice. If you're not sure what to do at any time, the bloom gesture is a good way to get reoriented.
To do the bloom gesture:
Hold out your hand with your palm up and your fingertips together.
Open your hand.
Use air tap, along with gaze, to select apps and other holograms and any gaze/dwell buttons. To do an air tap:
Gaze at a hologram.
Hold your hand straight out in front of you in a loose fist, then point your index finger straight up toward the ceiling. You don’t need to raise your whole arm—keep your elbow low and comfortable.
Tap your finger down, and then quickly raise it back up again.
The gesture frame
HoloLens has sensors that can see a few feet to either side of you. When you use gestures, you'll need to keep them inside that frame, or HoloLens won't see them. As you move around, the frame moves with you. When your hand is inside the frame, the cursor looks like a ring. When HoloLens can't see your hand, the cursor changes to a dot.
Need a tutorial on gestures?
For a tutorial on some basic gestures, use the bloom gesture to go to Start, and then select Learn Gestures. If you're having trouble with gestures, see HoloLens and holograms: FAQ.
Get started with the HoloLens app
Now that your HoloLens device is calibrated, and you know how to get around by gazing and using gestures, it’s time to open a guide and get some work done. Start by installing the app if someone hasn’t already installed it for you.
Install the HoloLens app
Make sure you have HoloLens build 10.0.14393.0 or later installed on your HoloLens device. We recommend updating to newer versions when available. See Manage updates to HoloLens for instructions on using Windows Update for Business.
On your HoloLens device, use the bloom gesture to open the Home menu, and then open the Microsoft Store app and search for “Dynamics 365 Guides”.
Select Install to download and install the Dynamics 365 Guides application.
Sign in to the HoloLens app
If you sign in with a brand new HoloLens device, you’ll be prompted to walk through the Setup wizard. In the Setup wizard, you can sign in with an existing account or create a new one, depending on the version of Windows that you’re running. The Setup wizard also walks you through steps to calibrate and prepare HoloLens. For more information on calibration, see the “First things first” section of this topic.
Open and sign in to HoloLens for the first time
Go to All Apps.
Select the down arrow.
Open the Dynamics 365 Guides application.
In the Welcome screen, select Sign in.
In the Email and accounts screen, select Work or school account, and then select Continue.
In the Work or school account screen, enter the credentials provided by your administrator. The credentials will look something like this: firstname.lastname@example.org. For example, if your user name is LauraO and you work for the Contoso company, the email name would be email@example.com.
Select an instance to use if you have more than one instance, and then select Continue.
In the Guides dialog box, gaze at the selection box for the guide you want to open.
In the Select Mode dialog box, gaze at the box to the left of Operate until the box fills, which selects that item.
Anchor your guide
The first thing you see when you open a guide is the anchoring instructions for the guide.
The screen above shows the anchoring instructions for a printed anchor. This screen would look different if you need to anchor your guide with a digital anchor. The anchoring instructions will tell you how to go about anchoring your guide.
Anchoring a guide is a crucial step, just like calibrating HoloLens. You anchor a guide to make sure that the holographic instructions line up with your real-world environment. If the holograms don’t line up, you’ll likely be confused when you try to do a task. You could even cause damage. For example, you might drill a hole in the wrong place.
Printed anchors vs digital anchors
There are two types of anchors: a printed anchor and a digital anchor. The way you anchor your guide depends on which method is used.
To anchor your guide using a printed anchor
Look for a printed anchor attached to a physical object in your real-world environment. The printed anchor looks like this:
On your HoloLens HoloLens, you’ll see a hologram that looks very similar to the printed anchor. Find the printed anchor in your real-world environment, and then align the anchor hologram with the printed anchor.
When the green box is aligned to the printed anchor, gaze at Confirm to select it.
When you see the Printed anchor found screen, follow the instructions on the screen, and then select Confirm to continue.
To anchor your guide with a digital anchor
With a digital anchor, you align a hologram on your HoloLens with a similar object in the real world.
To align the digital anchor with its real-world counterpart, air tap and hold to move the hologram, and tap and hold the blue spheres to rotate the hologram, if needed.
Where alignment information is stored
When you align your guide, if you’re using the Microsoft HoloLens Commercial Suite, the alignment information is stored on HoloLens so you don’t have to realign the guide every time you open it. You can realign a guide at any time, though, if you feel the holograms are out of alignment. For more information, read about the Anchor button in the next section.
Get oriented with the Step card
When you open a guide, you’ll see the Step card, which is the hub of everything you do in a guide. The Step card provides the instructions that you follow to complete a task. It also includes the two buttons that you use to navigate through a guide—the Next Step and Go Back buttons. As you go through the steps in a task, the Step card follows you on HoloLens to keep your instructions where you need them.
In addition to the Next Step and Go Back buttons, the Step card includes a number of different buttons and UI elements to help you take various actions.
Here’s a description of the buttons and other UI elements in the Step card:
|1||Home||Choose a different guide.|
|2||Follow mode||Have the Step card follow you around or lock it to a location.
If you turn off Follow mode, the Step card stays where it is. You can grab the card at any time by using the navigation bar to move it wherever you like. For more information, see the Follow and pinning section later in this topic.
|3||Anchor button||Re-anchor (realign) the guide.
HoloLens can sometimes lose tracking, which causes holograms to be misaligned. To fix this, you need to re-anchor the guide by gazing at a printed anchor or digital anchor again. For more information, see “Anchor your guide” earlier in this topic.
|4||Settings||Access the following settings:
- Fit box. Use to make sure you’re wearing your HoloLens device correctly. Fit is very important. Otherwise holograms might be misaligned in your environment. When you select this setting, you’ll see borders in your field of view to help you make sure you’re wearing the HoloLens properly.
- Build number. Shows the build of Dynamics 365 Guides that you’re using.
|5||Profile||Sign in and out.|
|6||Step progress||Shows where you are in the step.|
|7||Outline||Go to the Outline page.
Use the Outline page to quickly navigate around your guide. Here’s what the Outline page looks like for the Pylon wiring guide:
|8||Task name||The name of the task you're working on.|
|9||Task progress||Shows where you are in the task.|
Use a dotted line to help you find the focus area for a step
Step cards are linked by holographic dotted lines to physical areas in your work area. These dotted lines help you find the area where you need to take an action.
Dotted line tips and tricks
Follow the dotted line to find the physical area where you need to do the work. Follow the dotted line back to the Step card to read the instructions.
If the dotted line points behind you, step to the side, and then continue to follow the dotted line. Note that the dotted line might go through real-world objects at times.
Follow and pinning
You’ll notice that wherever you look, the Step card follows your gaze. As you’re working, you never have to worry about where your instructions are. You can stop the Step card from following you by turning the Follow mode behavior off from the navigation bar.
You can grab the navigation bar at any time to place the card where you like.
Turn off holograms
You can turn holograms off (or turn them back on) with a glance if you ever feel like they’re getting in the way. To turn off a hologram, gaze at the “eye” in the middle of the dotted line.
Useful links for more information
That's all the info you need to use a guide created with Dynamics 365 Guides! To learn more about Microsoft mixed-reality apps and HoloLens, here are some helpful links: