Share via

To construct stereoscopic view based on HoloLnes 2 using two independent real-time videos

이종현 1 Reputation point
2021-08-24T07:54:56.33+00:00

Hello, my name is Jong Hyeon Lee and I’m using HoloLens 2 for my university project.

My goal is to construct stereoscopic view based on HoloLens 2 using two independent real-time videos from USB camera module connected to PC through USB port.

I use Unity software (2019.3.7f1 version) in this project and I guess HoloLens 2 cannot directly use the USB port from the PC, because it operates on its own embedded OS.

I have two questions about the project.

• I would like to ask if the 3D view can be set up on binocular screens of HoloLens 2 Display with no latency.

• When the USB camera module video was sent to the HoloLens 2, there was a problem in that the resolution of the video was reduced.
So, I would like to ask about how to prevent video resolution from being reduced when sending video to HoloLens 2 Display.

I would appreciate it if you could refer to this and reply.

HoloLens Development
HoloLens Development
HoloLens: A family of Microsoft self-contained, holographic devices that enable engagement with digital content and interaction with holograms in the surrounding environment.Development: The process of researching, productizing, and refining new or existing technologies.
387 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Sarah Zhang 76 Reputation points
    2021-08-31T09:35:23.43+00:00

    Hello, Welcome to Microsoft Q&A,

    >> I would like to ask if the 3D view can be set up on binocular screens of HoloLens 2 Display with no latency.

    Thanks for your replying. Do you send the video stream from PC to HoloLens 2 using wireless network and calculate the stereoscopic view on the HoloLens 2? If so, since there is a latency in network transmission and the calculation of the stereo view also requires some time, there must be a certain amount of latency between the capture of the video frame and the display of the stereo view. To reduce the latency, you need to speed up the network transmission as much as possible and try to use a higher computing power device, such as a PC, to calculate the view, then transfer the final view to the HoloLens 2. You can consider using Holographic Remoting to use the PC resource to speed up the calculation in your app, please check this documentation -- Use PC resources to power your app with Holographic Remoting for more information. And as this documentation-- Connect to Bluetooth and USB-C devices said, HoloLens 2 supports connecting to the Ethernet adapters through USB-C, you can use the wired network to speed up the network transmission.

    >>When the USB camera module video was sent to the HoloLens 2, there was a problem in that the resolution of the video was reduced. So, I would like to ask about how to prevent video resolution from being reduced when sending video to HoloLens 2 Display.

    HoloLens 2 can support a single eye 2K resolution at most, so the 1920*1080 is supported. And the reduction of the video frame resolution during transmission should be related to the format of the source video and your network transmission method. It should be unrelated to the hardware device. What network framework did you use to transmit the video? Could you please provide a sample? Does your transfer method automatically compress the video to speed up the transmission?

    ----
    If the response is helpful, please click "Accept Answer" and upvote it.
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    0 comments