HoloLens 即计算机视觉研究工具HoloLens as a tool for computer vision research

0900-1230,20180900 - 1230 September 8th, 2018

ECCV 2018 会议ECCV 2018 Conference


  • Marc PollefeysMarc Pollefeys
  • Shivkumar SwaminathanShivkumar Swaminathan
  • Johannes SchoenbergerJohannes Schoenberger
  • Andrew FitzgibbonAndrew Fitzgibbon


Microsoft HoloLens 是世界上第一个独立的全息计算机,但它也是强大的计算机视觉研究设备。Microsoft HoloLens is the world’s first self-contained, holographic computer, but it’s also a potent computer vision research device. 应用程序代码可以访问音频和视频流以及 surface 网格,这一切都是由 HoloLens 维持的高度准确的打印头跟踪。Application code can access audio and video streams and surface meshes, all in a world coordinate space maintained by HoloLens’ highly accurate head-tracking. 本教程将探讨 HoloLens 的新 "研究模式" 功能。This tutorial will dive into the new “Research Mode” capability of HoloLens. 我们将向你展示如何访问原始的打印头跟踪和深度传感器数据流,并使用每个流的内部函数和 extrinsics。We will show you how to access the raw head-tracking and depth sensor data streams, and make use of the intrinsics and extrinsics of each stream. 此外,我们还将演示 Azure 项目的 "Kinect" 中的 "航班深度检测" 技术的最近进步。We will also be demonstrating recent advances in time of flight depth-sensing technologies in the Kinect for Azure project.

查看研究模式的示例应用程序传感器会流式传输 一个示例,该应用程序会实时显示六个研究模式流中的任意一个。Sample application for viewing Research Mode sensor streams A sample HoloLens application that displays any of the six Research Mode streams in real time.


  • 0900–简介0900 – Introduction
  • 0930– HoloLens 研究模式0930 – HoloLens Research Mode
  • 1030–咖啡中断1030 – Coffee break
  • 1100–应用程序 & 演示1100 – Applications & Demos
  • 1130– Azure 深度传感器的 Kinect1130 – Kinect for Azure Depth Sensor
  • 1200– Q &1200 – Q & A
  • 1230–教程结束1230 – Tutorial ends

在本教程中,参加者将为您提供一系列计算机视觉研究任务和材料,使其能够使用设备快速入门。Attendees to this tutorial will leave with a good sense of how HoloLens can be used for a range of Computer Vision research tasks, and materials to quickly get them started using the device.