question

54576008 avatar image
0 Votes"
54576008 asked SarahZhang-MSFT answered

To construct stereoscopic view based on HoloLnes 2 using two independent real-time videos

Hello, my name is Jong Hyeon Lee and I’m using HoloLens 2 for my university project.

My goal is to construct stereoscopic view based on HoloLens 2 using two independent real-time videos from USB camera module connected to PC through USB port.

I use Unity software (2019.3.7f1 version) in this project and I guess HoloLens 2 cannot directly use the USB port from the PC, because it operates on its own embedded OS.

I have two questions about the project.

• I would like to ask if the 3D view can be set up on binocular screens of HoloLens 2 Display with no latency.

• When the USB camera module video was sent to the HoloLens 2, there was a problem in that the resolution of the video was reduced.
So, I would like to ask about how to prevent video resolution from being reduced when sending video to HoloLens 2 Display.


I would appreciate it if you could refer to this and reply.






hololens-development
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Could you please clarify that what is your USB camera module video specifically? What resolution do you require? And how do you use them to build a stereoscopic view? Do you only need HoloLens2 to display the video you are streaming, or do you need Hololens2 to do some graphics calculations? Could you please provide a specific use case?

0 Votes 0 ·

  1. Could you please clarify that what is your USB camera module video specifically?
    I use 'PS-EC 200' USB Endoscope Camera module video.

  2. What resolution do you require?
    I want to get at least 1920x1080 pixel solution.

  3. How do you use them to build a stereoscopic view?
    First, I have tried developing through Unity platform.
    Second, I have tried establishing a local server which can show camera module videos, but both methods have not succeeded.

  4. Do you only need HoloLens2 to display the video you are streaming, or do you need Hololens2 to do some graphics calculations?
    I want Hololens 2 to do 3D graphic calculations for binocular vision using two different USB camera module videos.
    Each USB camera module video does the role of each eye of binocular vision.



0 Votes 0 ·

1 Answer

SarahZhang-MSFT avatar image
0 Votes"
SarahZhang-MSFT answered

Hello, Welcome to Microsoft Q&A,

>> I would like to ask if the 3D view can be set up on binocular screens of HoloLens 2 Display with no latency.

Thanks for your replying. Do you send the video stream from PC to HoloLens 2 using wireless network and calculate the stereoscopic view on the HoloLens 2? If so, since there is a latency in network transmission and the calculation of the stereo view also requires some time, there must be a certain amount of latency between the capture of the video frame and the display of the stereo view. To reduce the latency, you need to speed up the network transmission as much as possible and try to use a higher computing power device, such as a PC, to calculate the view, then transfer the final view to the HoloLens 2. You can consider using Holographic Remoting to use the PC resource to speed up the calculation in your app, please check this documentation -- Use PC resources to power your app with Holographic Remoting for more information. And as this documentation-- Connect to Bluetooth and USB-C devices said, HoloLens 2 supports connecting to the Ethernet adapters through USB-C, you can use the wired network to speed up the network transmission.

>>When the USB camera module video was sent to the HoloLens 2, there was a problem in that the resolution of the video was reduced. So, I would like to ask about how to prevent video resolution from being reduced when sending video to HoloLens 2 Display.

HoloLens 2 can support a single eye 2K resolution at most, so the 1920*1080 is supported. And the reduction of the video frame resolution during transmission should be related to the format of the source video and your network transmission method. It should be unrelated to the hardware device. What network framework did you use to transmit the video? Could you please provide a sample? Does your transfer method automatically compress the video to speed up the transmission?


If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.