How to extract 3d point cloud from mkv to e.g. ply file?

Max 20 Reputation points
2024-02-20T13:10:56.9366667+00:00

Hey guys, I am trying to use the Azure Kinect (AK) data in touchdesigner. When I am using the AK directly in touchdesigner, with a few steps I can use the depth color information to create a point cloud in real time. This works fine. I am struggeling with recorded files. How can I extract the depth and color information from the mkv file into a ply file (which I can import in touchdesigner)? It cannot be so difficult but I don't get it.

Azure Kinect DK
Azure Kinect DK
A Microsoft developer kit and peripheral device with advanced artificial intelligence sensors for sophisticated computer vision and speech models.
285 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. LeelaRajeshSayana-MSFT 13,456 Reputation points
    2024-02-20T20:26:02.6066667+00:00

    Hi @Max Greetings! Welcome to Microsoft Q&A forum. Thank you for posting this question here.

    If you are looking for options on the above file conversion through Azure Kinect Viewer, please note that tool does not have the inbuilt functionality to file to a different format. The Azure Kinect Sensor SDK provides a transformation sample termed as playback mode which you can leverage to extract a single frame from .mkv file and generate .ply data. The SDK also provides another mode of operation called as Capture mode which enables the device to record one capture (depth map + color image) and writes two color point cloud files (color_to_depth.ply and depth_to_color.ply) to the directory specified by the user.

    For more information on this transformation sample, please refer to the GitHub repository page Azure Kinect Transformation Example

    Hope this helps!

    If the response helped, please do click Accept Answer and Yes for the answer provided. Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.