question

AlexandreChapin-0143 avatar image
0 Votes"
AlexandreChapin-0143 asked SatishBoddu-MSFT answered

Error when trying to sync two Azure Kinect with "green screen" example

Hello,

It's already been a few days since I tried to test the following Green screen example but when I launch the code the program stay blocked when I try to get the captures from the master device. By lookin at the logs I get the following errors :

....
[2021-06-28 14:27:48.328] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 946066 type:Depth
[2021-06-28 14:27:48.395] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 1012733 type:Depth
[2021-06-28 14:27:48.461] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 1079400 type:Depth
[2021-06-28 14:27:48.529] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 1146066 type:Depth
.....

I investigated a lot on the problem without finding any solution.
I'm working with Windows 10 and with the v1.4.1 of the Azure Kinect SDK.
My computer got two GPU Nvidia Quatro RTX 6000 so I shouldn't have any problem with that.
Here is the firmware present in each camera (from the log file) :


[2021-06-28 14:27:44.735] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {8e095773-dbf1-4739-2bb9-d2020461d79f}
[2021-06-28 14:27:44.736] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000287401712
[2021-06-28 14:27:44.778] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (326): find_libusb_device(). Found non matching Container ID: {5e188cb9-bc2b-4fed-4f99-6a23b282a653}
[2021-06-28 14:27:44.779] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {8e095773-dbf1-4739-2bb9-d2020461d79f}
[2021-06-28 14:27:44.780] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000287401712
[2021-06-28 14:27:44.808] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (225): Device Info
[2021-06-28 14:27:44.808] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (226): K4A SDK version: 1.4.1
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (232): Serial Number: 000287401712
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (236): RGB Sensor Version: 1.6.110
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (239): Depth Sensor Version:1.6.79
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (242): Mic Array Version: 1.6.14
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (245): Sensor Config: 6109.7
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (248): Build type: Release
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (253): Signature type: MSFT
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (259):
[2021-06-28 14:27:45.041] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {5e188cb9-bc2b-4fed-4f99-6a23b282a653}
[2021-06-28 14:27:45.042] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000194794412
[2021-06-28 14:27:45.075] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {5e188cb9-bc2b-4fed-4f99-6a23b282a653}
[2021-06-28 14:27:45.075] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000194794412
[2021-06-28 14:27:45.103] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (225): Device Info
[2021-06-28 14:27:45.103] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (226): K4A SDK version: 1.4.1
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (232): Serial Number: 000194794412
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (236): RGB Sensor Version: 1.6.110
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (239): Depth Sensor Version:1.6.79
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (242): Mic Array Version: 1.6.14
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (245): Sensor Config: 6109.7
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (248): Build type: Release
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (253): Signature type: MSFT


And finally here is the config for each camera :

[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (868): k4a_device_start_cameras(). Starting camera's with the following config.
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (869): k4a_device_start_cameras(). color_format:0
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (870): k4a_device_start_cameras(). color_resolution:1
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (871): k4a_device_start_cameras(). depth_mode:4
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (872): k4a_device_start_cameras(). camera_fps:1
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (873): k4a_device_start_cameras(). synchronized_images_only:1
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (874): k4a_device_start_cameras(). depth_delay_off_color_usec:0
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (875): k4a_device_start_cameras(). wired_sync_mode:2
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (876): k4a_device_start_cameras(). subordinate_delay_off_master_usec:0
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (877): k4a_device_start_cameras(). disable_streaming_indicator:0
[2021-06-28 14:27:45.175] [info] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\dynlib\dynlib_windows.c (131): dynlib_create(). Depth Engine loaded C:\Users\achapin\Documents\Documents\SynchroCam\SynchroCam\depthengine_2_0.DLL
[2021-06-28 14:27:45.175] [info] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\deloader\deloader.cpp (51): verify_plugin(). Loaded Depth Engine version: 2.1.3
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (916): k4a_device_start_cameras(). k4a_device_start_cameras started
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (868): k4a_device_start_cameras(). Starting camera's with the following config.
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (869): k4a_device_start_cameras(). color_format:0
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (870): k4a_device_start_cameras(). color_resolution:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (871): k4a_device_start_cameras(). depth_mode:4
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (872): k4a_device_start_cameras(). camera_fps:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (873): k4a_device_start_cameras(). synchronized_images_only:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (874): k4a_device_start_cameras(). depth_delay_off_color_usec:80
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (875): k4a_device_start_cameras(). wired_sync_mode:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (876): k4a_device_start_cameras(). subordinate_delay_off_master_usec:0
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (877): k4a_device_start_cameras(). disable_streaming_indicator:0



Thank you by advance !

azure-kinect-dk
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@AlexandreChapin-0143 I have researched on Azure Kinect Sensor SDK Github Repo and looks like there are some similar issues open: https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues?q=is%3Aissue+is%3Aopen+releasing+capture+early+due+to+full+queue

Let me bring this to proper attention of our devs.

Thanks!

0 Votes 0 ·

Hello @AlexandreChapin-0143 , I have received some feedback from Product Team and we have the following questions to help us troubleshoot it. Thanks in advance for all your time so far:

  1. Are you able to collect data from a single Kinect?

  2. What is the USB chipset being used. Could you try a different one perhaps one from Intel.

  3. Is the 3.5mm audio cable being used <10m long?

Thank you!

0 Votes 0 ·

1 Answer

SatishBoddu-MSFT avatar image
0 Votes"
SatishBoddu-MSFT answered

Hello @AlexandreChapin-0143,

We have come across the capturesync_drop, releasing capture early due to a "full queue" issue but that was related to using a USB expansion card/hub.

We can suggest perhaps using a different USB chipset. Using USB controllers from Intel did not have this issue. We also assume the 3.5 mm audio cable is less than 10 meters long as specified in the Azure Kinect docs.

Synchronize multiple Azure Kinect DK devices


Please comment in the below section for further help in this matter, we are happy to help you.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.