I have a question about HoloLens 2　(English edition)

緒方　将人 1 Reputation point
2021-10-13T08:18:51.157+00:00

I have a question about HoloLens 2.

I want to operate a 3D object with a hand gesture on the display of Hololends2 and output the coordinate data at the time of operation in Python.

There are three points I don't understand.
1: Manipulating 3D objects with hand gestures on the HoloLens 2 display
2: Display a 3D object that specifies the moving coordinates from HoloLens 2.
3: How to create programming to send and receive coordinate values ​​between HoloLens and PC

If you know even one solution, please let me know.

The ultimate goal is to display a 3D object (cube) on the HoloLens 2 display, move it with a pinch hand gesture, and move the hand of the robot arm according to the moved coordinates.
I want to operate a 3D object with a hand gesture on the display of HoloLens 2, read the real-time coordinates of the 3D object on a PC, and specify the coordinates of the arm robot with Python.

The method I understand is to display 3D objects using Unity and Visual Studio.

HoloLens Development
HoloLens Development
HoloLens: A family of Microsoft self-contained, holographic devices that enable engagement with digital content and interaction with holograms in the surrounding environment.Development: The process of researching, productizing, and refining new or existing technologies.
385 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Hernando Ren 2,166 Reputation points
    2021-10-14T07:49:07.967+00:00

    Hello, Welcome to Microsoft Q&A,

    You can take a look at MRTK, the Manipulation component allows for an object to be made movable which can meet your request. For the coordinate data, please refer to this doc to learn how to use spatial coordinate systems to reason about hologram position:Coordinate systems. And then, you can build a Wireless network to connect your HoloLens and the PC and create a TCP connection on both endpoints. For more information, please seeSockets

    ----
    If the answer is the right solution, please click Accept Answer and kindly upvote it. If you have extra questions about this answer, please click "Comment".
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.