Overview of Dynamics 365 Remote Assist

With heads-up, hands-free video calling on Microsoft HoloLens, technicians can collaborate with remote experts on a PC or mobile device to troubleshoot issues in context.

Simulated real-life photo of a field technician wearing a HoloLens and communicating with a remote expert.

Use cases

  • Collaborative maintenance and repair: Empower technicians to solve problems faster the first time with Microsoft Dynamics 365 Remote Assist. By using heads-up, hands-free video calling on Microsoft HoloLens and mobile devices, technicians can receive guidance in context from remote collaborators.
  • Remote inspections: Empower onsite inspectors to collaborate with remote inspectors to evaluate and document asset quality.
  • Knowledge sharing and training: Document repairs via photos and videos and share them with the rest of your organization.

Watch a video about Dynamics 365 Remote Assist on Hololens 2 and mobile.

Benefits

  • Solve problems in real time: Technicians can share their real-time view with experts in remote locations to get the help they need while keeping both hands free to work on their tasks. This reduces travel time and cost.
  • Communicate detailed and complex instructions visually: Rather than communicating instructions via audio call, onsite workers and remote collaborators can use drawings and arrows to refer to specific parts of a machine or asset. These annotations are anchored in the Remote Assist user's space.
  • Scale expert knowledge: Enable experts from anywhere in the world to effectively share their knowledge.
  • Walk the site without being onsite: Reduce costs with remote inspections—combine video, screenshots, and annotations for more seamless workflows on the devices you already use.
  • Bring critical information into view: Technicians and inspectors can pull in work order information from Dynamics 365 Field Service and call the resource assigned to support them. Furthermore, technicians and inspectors no longer need to carry around paper manuals to perform their repair or inspection. Remote collaborators can insert reference images, schematics, and other helpful information in a technician or inspector's view, so they can refer to the schematic while working heads-up and hands-free.
  • Navigate Remote Assist on HoloLens with your voice: Remote Assist on HoloLens 1 and 2 provides a truly hands-free experience by supporting voice commands in these languages for all features, even in a loud, industrial environment.
  • Offer your customers a differentiated service offering: When selling a machine or equipment, include a Remote Assist subscription your customer can use to receive help from the experts who created the equipment.

Roles

  • Technician: A technician uses Remote Assist on their HoloLens or mobile device to share what they are seeing and request remote assistance.
  • Inspector or auditor: An inspector or auditor uses Remote Assist on their HoloLens or mobile device to evaluate and document asset quality.
  • Remote collaborator: A remote collaborator uses Teams on PC or mobile to join a Remote Assist call, see what a technician or inspector sees, and provide guidance in context.

Sample workflow for technicians and remote collaborators

  1. A technician arrives onsite to fix a machine, but encounters a complex machine that they're not familiar with. The technician puts on a HoloLens, signs in using iris scanning, and launches Remote Assist. (Or, they launch Remote Assist from their mobile device.)

  2. Because the technician's company has enabled Dynamics Field Service integration, the technician selects a booking and views the recommended remote collaborator who has more experience with that machine.

  3. A remote collaborator joins the mixed reality call on Microsoft Teams desktop and sees what the technician sees. They start recording the call so the technician can use it for future reference.

  4. The remote collaborator provides verbal instructions. When they want to draw attention to a part of the machine, the collaborator adds drawings and arrows onto their PC screen. These drawings and arrows appear in the technician's space and are anchored to the machine.

  5. The remote collaborator then shares a schematic from OneDrive, and it appears in the technician's space. The collaborator can also pull up the schematic and share their computer screen with the technician. The technician uses the schematic to finish the repair.

Screenshot of the HoloLens field of view, showing shared desktop controls

  1. The technician successfully repairs the machine, takes a snapshot of the repaired machine, and saves it to OneDrive. They thank the remote collaborator for their help, and end the call. Snapshots and files shared during the booking are posted to the Dynamics 365 Field Service booking, and the recording is saved online and shared with call participants.

Learn more about mixed reality

  • Mixed reality is a spectrum: Mixed reality blends the physical world with the digital world. Mixed reality physically anchors holographic images, data, text, and other digital information onto the physical world and enables you to interact with these holograms.
  • What is a hologram?: HoloLens 1 and 2 display holograms, which are objects made of light and sound that appear in the world around you, as if they were real objects. Holograms respond to your gaze, gestures, and voice commands, and can interact with real-world surfaces around you. With holograms, you can create digital objects that are part of your world.
  • Spatial anchoring: When a technician or remote collaborator makes drawings or adds arrows, these annotations are anchored in the physical world and stay in place as the Remote Assist user moves around.
  • What is the HoloLens 2? HoloLens 2 offers the most comfortable and immersive mixed reality experience available, with industry-leading solutions that deliver value in minutes—all enhanced by the reliability, security, and scalability of cloud and AI services from Microsoft. Learn more about HoloLens 2 features and technical specs here.
  • How is the HoloLens 2 improved from Hololens 1?: HoloLens 2 offers a more immersive, ergonomic, and instinctual experience.

Learn more about core concepts in mixed reality technology in the following article on core concepts.

Devices

Technicians and inspectors use Remote Assist on HoloLens 1, HoloLens 2, or AR-capable iOS or Android devices.

Remote collaborators use Microsoft Teams on a PC or a mobile device.

Integrate Dynamics 365 Field Service

In addition to using Remote Assist to consult with remote collaborators and resolve issues faster, technicians and inspectors work even more effectively when they use Dynamics 365 Field Service to view their schedules, perform and track work orders, manage customer assets, and more. When Remote Assist and Field Service are integrated, technicians and inspectors can see bookings in Remote Assist and automatically attach relevant call details and artifacts to their booking.

Screenshot of the HoloLens field of view, showing recent contacts and a booking detail pane.

Learn more here.

Next steps

For administrators

For technicians and inspectors

For remote collaborators

See also