unreal engine body tracking skeleton

ADRIAN BALLE 0 Reputation points
2023-07-30T20:40:55.3533333+00:00

I am trying to drive skeletal mesh using the azure kinect unreal engine plugin but the skeleton the plugin set up for you has very limited hand data and is not exactly like the one that is used in the azure kinect body tracking sdk. Where can I get the data for that skeleton. Something like the one form https://learn.microsoft.com/en-us/azure/kinect-dk/body-joints. The file has got to be stored somewhere in the sdk. Does anyone know? Has anyone already made an unreal engine skeleton to match the one in the body tracking sdk? My only other option is to make one but I would like it to be as accurate as possible.

Azure Kinect DK
Azure Kinect DK
A Microsoft developer kit and peripheral device with advanced artificial intelligence sensors for sophisticated computer vision and speech models.
287 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. LeelaRajeshSayana-MSFT 13,621 Reputation points
    2023-07-31T20:20:04.6533333+00:00

    Hi @ADRIAN BALLE Greetings! Welcome to Microsoft Q&A forum. Thank you for posting this question here.

    Here is the underlying source code for Azure Sensor SDK. I could not find any reference to the data in the SDK. I believe the skeleton data used in the Azure Kinect Body Tracking SDK is not stored in a file that you can access directly. Instead, it is generated by the SDK at runtime based on the data obtained from the Azure Kinect sensor.

    However, you may use the SDK functions to obtain the joint data and map it to the joints in your skeletal mesh in Unreal Engine. The joint data is provided in the form of a body frame, which contains the joint positions and orientations for each tracked body. You can use the functions provided by the SDK to access this data and use it to drive your skeletal mesh.

    Please also note that to use the Body Tracking SDK with Unreal, make sure you have added <SDK Installation Path>\tools to the environment variable PATH and copied dnn_model_2_0.onnx and cudnn64_7.dll to Program Files/Epic Games/UE_4.23/Engine/Binaries/Win64.

    Hope this helps!

    0 comments