HoloLens 研究模式HoloLens Research Mode

研究模式是在 HoloLens (第一代) 裝置上引進,以提供金鑰感應器的存取權,特別是研究不打算進行部署的應用程式。Research Mode was introduced on HoloLens (1st Gen) devices to give access to key sensors, specifically for research applications that aren't intended for deployment. HoloLens 2 的研究模式會保留 HoloLens 1 的功能,但會新增下列資料流程的存取權:Research Mode for HoloLens 2 keeps the capabilities of HoloLens 1 but adds access to the following streams:

  • 可見的光線環境追蹤攝影機 -系統用來追蹤和地圖大樓的灰色縮放相機。Visible Light Environment Tracking Cameras - Gray-scale cameras used by the system for head tracking and map building.

  • 深度相機 –以兩種模式運作:Depth Camera – Operates in two modes:

    • AHAT、高頻率 (45 FPS) 用於手動追蹤的近深度感知。AHAT, high-frequency (45 FPS) near-depth sensing used for hand tracking. 與第一個版本的簡短擲回模式不同的是,AHAT 提供的虛擬深度與1計量以外的階段換行。Differently from the first version short-throw mode, AHAT gives pseudo-depth with phase wrap beyond 1 meter.
    • 長時間擲回、低頻率 (1-5 FPS) 空間對應所使用的深度感應Long-throw, low-frequency (1-5 FPS) far-depth sensing used by Spatial Mapping
  • 兩個版本的 IR 反射率串流 -由 HoloLens 用來計算深度。Two versions of the IR-reflectivity stream - Used by the HoloLens to compute depth. 這些影像會由紅外線發亮,並不受環境可見的光線影響。These images are illuminated by infrared and unaffected by ambient visible light.

如果您是使用 HoloLens 2,您也可以存取下列其他輸入:If you're using a HoloLens 2, you also have access to the additional inputs below:

  • 加速 計–由系統用來判斷沿著 X、Y 和 Z 軸和重力的線性加速。Accelerometer – Used by the system to determine linear acceleration along the X, Y, and Z axes and gravity.
  • 回轉 –系統用來判斷旋轉。Gyro – Used by the system to determine rotations.
  • 磁力計 –由系統用來估計絕對方向。Magnetometer – Used by the system to estimate absolute orientation.

重要

研究模式目前為公開預覽狀態。Research Mode is currently in Public Preview.

研究模式應用程式螢幕擷取畫面Research Mode app screenshot
測試應用程式的混合現實捕捉,可顯示研究模式中可用的八個感應器串流A mixed reality capture of a test application that displays the eight sensor streams available in Research Mode

使用量Usage

研究模式是專為學術和產業研究人員所設計,可在電腦視覺和機器人的領域中探索新構想。Research Mode is designed for academic and industrial researchers exploring new ideas in the fields of Computer Vision and Robotics. 它不適用於企業環境中部署的應用程式,或可透過 Microsoft Store 或其他散發通道使用的應用程式。It's not intended for applications deployed in enterprise environments or available through the Microsoft Store or other distribution channels.

此外,Microsoft 不保證未來的硬體或作業系統更新將會支援研究模式或同等功能。Additionally, Microsoft doesn't provide assurances that Research Mode or equivalent functionality is going to be supported in future hardware or OS updates. 不過,請勿讓您使用它來開發和測試新的想法!However, don't let that stop you from using it to develop and test new ideas!

安全性和效能Security and performance

即使使用研究模式功能的應用程式不在執行中,啟用 Research 模式仍會使用比使用 HoloLens 2 更高的電池電力。Enabling Research Mode uses more battery power than using the HoloLens 2 under normal conditions, even if the application using the Research Mode features isn't running. 啟用此模式也會降低裝置的整體安全性,因為應用程式可能會誤用感應器資料。Enabling this mode can also lower the overall security of your device because applications may misuse sensor data. 您可以在 HoloLens 安全性常見問題中找到裝置安全性的詳細資訊。You can find more information on device security in the HoloLens security FAQ.

裝置支援Device support

功能Feature HoloLens 第一代HoloLens first Gen HoloLens 2HoloLens 2
Head 追蹤攝影機Head Tracking Cameras ✔️✔️ ✔️✔️
IR 攝影機的深度 &Depth & IR Camera ✔️✔️ ✔️✔️
加速計Accelerometer ✔️✔️
迴轉儀Gyroscope ✔️✔️
磁力計Magnetometer ✔️✔️

啟用 Research 模式 (HoloLens first Gen 和 HoloLens 2) Enabling Research Mode (HoloLens first Gen and HoloLens 2)

研究模式是開發人員模式的延伸模組。Research Mode is an extension of Developer Mode. 開始之前,必須先啟用裝置的開發人員功能,才能存取研究模式設定:Before starting, the developer features of the device need to be enabled to access the Research Mode settings:

  • 開啟 [ 開始] 功能表 > 設定 ],然後選取 [ 更新]。Open Start Menu > Settings and select Updates.
  • 針對開發人員 選取並啟用 開發人員模式Select For Developers and enable Developer Mode.
  • 向下捲動並啟用 裝置入口網站Scroll down and enable Device Portal.

啟用開發人員功能之後,請連線 到裝置入口網站 以啟用研究模式功能:After the developer features are enabled, connect to the device portal to enable the Research Mode features:

  • 移至 裝置入口網站 中的 系統 > 研究模式Go to System > Research Mode in the Device Portal.
  • 選取 [ 允許存取感應器串流]。Select Allow access to sensor stream.
  • 從頁面頂端的 [ 電源 ] 功能表項目目重新開機裝置。Restart the device from the Power menu item at the top of the page.

當您重新開機裝置之後,透過 裝置入口網站 載入的應用程式就可以存取研究模式串流。Once you've restarted the device, the applications loaded through the Device Portal can access Research Mode streams.

HoloLens 裝置入口網站的 [研究模式] 索引標籤Research Mode tab of HoloLens Device Portal
HoloLens 裝置入口網站中的研究強制回應視窗Research Mode window in the HoloLens Device Portal

重要

從組建19041.1356 開始提供 HoloLens 2 的研究模式。Research Mode for HoloLens 2 is available beginning with build 19041.1356. 如果您需要在先前的組建中存取,請註冊我們的 Insider preview 計畫。If you need access in an earlier build, sign up for our Insider Preview program.

在您的應用程式中使用感應器資料Using sensor data in your apps

應用程式可以使用 媒體基礎 存取相片和攝影機串流的相同方式來存取感應器串流資料。Applications can access the sensor stream data in the same way that Media Foundation accesses photo and video camera streams.

所有適用于 HoloLens 開發的 Api 也都可在研究模式中取得。All APIs that work for HoloLens development are also available in Research Mode. 尤其是,應用程式會準確知道 HoloLens 在每個感應器畫面格捕獲時間的6DoF 空間中。In particular, the application knows precisely where HoloLens is in 6DoF space at each sensor frame capture time.

我們的範例應用程式會顯示研究模式串流存取、使用 內建函式和 extrinsics,以及記錄資料流程:We have sample applications showing Research Mode stream access, using the intrinsics and extrinsics, and recording streams:

支援Support

針對 HoloLens (第一代) ,請使用 HoloLensForCV 存放庫中的 問題追蹤 程式張貼意見反應,並追蹤已知問題。For HoloLens (first gen), use the issue tracker in the HoloLensForCV repository to post feedback and track known issues.

針對 HoloLens 2,請使用 HoloLens2ForCV 存放庫中的 問題追蹤 程式張貼意見反應,並追蹤已知問題。For HoloLens 2, use the issue tracker in the HoloLens2ForCV repository to post feedback and track known issues.

另請參閱See also